-- Logs begin at Wed 2022-08-10 07:21:34 UTC, end at Wed 2022-08-10 08:17:43 UTC. -- Aug 10 07:49:15.371522 dv-cinder-781032-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 10 07:49:15.380607 dv-cinder-781032-4-smb devstack@keystone.service[80187]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 07:49:15 2022] *** Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: nodename: dv-cinder-781032-4-smb Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: machine: x86_64 Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: clock source: unix Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: pcre jit disabled Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: detected number of CPU cores: 4 Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: current working directory: / Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: detected binary path: /usr/bin/uwsgi-core Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: your processes number limit is 47680 Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: your memory page size is 4096 bytes Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: detected max file descriptor number: 2048 Aug 10 07:49:15.382588 dv-cinder-781032-4-smb devstack@keystone.service[80187]: lock engine: pthread robust mutexes Aug 10 07:49:15.383460 dv-cinder-781032-4-smb devstack@keystone.service[80187]: thunder lock: enabled Aug 10 07:49:15.383460 dv-cinder-781032-4-smb devstack@keystone.service[80187]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 10 07:49:15.383460 dv-cinder-781032-4-smb devstack@keystone.service[80187]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 07:49:15.422758 dv-cinder-781032-4-smb devstack@keystone.service[80187]: Python main interpreter initialized at 0x564b4df549c0 Aug 10 07:49:15.422758 dv-cinder-781032-4-smb devstack@keystone.service[80187]: python threads support enabled Aug 10 07:49:15.422758 dv-cinder-781032-4-smb devstack@keystone.service[80187]: your server socket listen backlog is limited to 100 connections Aug 10 07:49:15.422758 dv-cinder-781032-4-smb devstack@keystone.service[80187]: your mercy for graceful operations on workers is 90 seconds Aug 10 07:49:15.423141 dv-cinder-781032-4-smb devstack@keystone.service[80187]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 07:49:15.423219 dv-cinder-781032-4-smb devstack@keystone.service[80187]: *** Operational MODE: preforking *** Aug 10 07:49:15.423493 dv-cinder-781032-4-smb devstack@keystone.service[80187]: *** uWSGI is running in multiple interpreter mode *** Aug 10 07:49:15.423493 dv-cinder-781032-4-smb devstack@keystone.service[80187]: spawned uWSGI master process (pid: 80187) Aug 10 07:49:15.423704 dv-cinder-781032-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 10 07:49:15.425661 dv-cinder-781032-4-smb devstack@keystone.service[80187]: spawned uWSGI worker 1 (pid: 80194, cores: 1) Aug 10 07:49:15.425661 dv-cinder-781032-4-smb devstack@keystone.service[80187]: spawned uWSGI worker 2 (pid: 80195, cores: 1) Aug 10 07:49:15.425661 dv-cinder-781032-4-smb devstack@keystone.service[80187]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 07:49:20.979240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 07:49:20.979240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: from cryptography.utils import int_from_bytes Aug 10 07:49:20.980171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 07:49:20.980171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: from cryptography.utils import int_from_bytes Aug 10 07:49:20.980171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 07:49:20.980171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: from cryptography.utils import int_from_bytes Aug 10 07:49:20.980709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 07:49:20.980709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: from cryptography.utils import int_from_bytes Aug 10 07:49:21.030475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 07:49:21.030694 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 07:49:21.030782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 07:49:21.030866 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 07:49:21.030933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] command line args: [] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 07:49:21.030999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] command line args: [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 07:49:21.031114 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 07:49:21.031230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 07:49:21.031305 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ================================================================================ {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 07:49:21.031374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ================================================================================ {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 07:49:21.031536 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] admin_token = **** {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.031640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] admin_token = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.031808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] config_dir = [] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.031966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] config_dir = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.032047 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.032171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] config_source = [] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.032255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.032339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] debug = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.032412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] config_source = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.032546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.032807 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] debug = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.032807 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.032957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.033089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.033171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.033282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.033367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.033572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.033657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.033945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] list_limit = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.034055 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.034120 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] log_config_append = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.034186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.034245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.034307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] log_dir = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.034366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_config_append = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.034548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] log_file = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.034646 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.034721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.034782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_dir = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.034965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_file = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.035068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.035204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.035291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.035459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.035554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.035629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.035838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.035920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.036089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.036183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.036323 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.036403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.036519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.036599 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.036778 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.036866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.037013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.037097 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.037250 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.037371 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.037492 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.037607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.037720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.037892 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.038009 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.038185 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.038491 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.039102 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.039222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] publish_errors = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.039335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.039469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.039662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.039821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.039947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.040111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.040311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.040439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.040561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] publish_errors = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.040681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] standard_threads = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.040808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.040939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.041065 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.041180 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.041293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.041405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.041591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] use_journal = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.041591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] use_json = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.041809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.041923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] use_stderr = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.041923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] use_syslog = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.042135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.042256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.042378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] standard_threads = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.042500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.042615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.042728 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.042849 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.042964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.043077 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.043189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.043302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] use_journal = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.043415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.043540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] use_json = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.043540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] use_stderr = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.043781 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.043897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] use_syslog = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.044022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.044022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.044254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:49:21.044370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.044483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.044597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.044717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.044831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.044953 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.045126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.045245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.045443 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.045592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.045748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.045913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.046064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.046264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.046383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.046582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.046700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.046933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.047060 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.047266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.047382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.047594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.047717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.047940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.048059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.048297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.048416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.048615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.048732 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.048966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.049086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.049322 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.049441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.049657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.049821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.049991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.050182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.050348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.050475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.050598 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.050720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.050858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.050976 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.051096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.051211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.051325 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.051465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.051596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.051712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.052205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.052333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.052448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.052578 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.052696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.052817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.052968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.053094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.053210 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.053335 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.053451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.053570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.053692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.053807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.053921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.054044 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.054161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.054275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.055017 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.055142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.055264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.055461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.055579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.055701 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.055845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.055960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.056074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.056202 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.056326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.056441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.056562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.056676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.056790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.056911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.057028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.057140 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.057254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.057366 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.057479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.057601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.057718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.057831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.057945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.058058 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.058172 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.058294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.058414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.058535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.058650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.058763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.058908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.059036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.059152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.059257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.059355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.059459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.059594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.059759 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.059871 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.059992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.060093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.060189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.060308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.060418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.060529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.060593 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.060702 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.060809 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.060925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.061046 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.061174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.061298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.061415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.061536 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.061643 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.061766 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.061883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.061996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.062112 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.062112 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.062317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.062438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.062554 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.062673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.062789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.062789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.062996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.063110 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.063233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.063340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.063462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.063578 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.063682 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.063834 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.063964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.064083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.064187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.064301 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.064422 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.064540 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.064664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.064781 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.064896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.065011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.065131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.065131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.065356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.065474 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.065596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.065712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.065827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.065942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.066065 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.066182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.066297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.066411 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.066525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.066640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.066835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.066954 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.067069 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.067184 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.067298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.067419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.067545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.067672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.067822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.067941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.068056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.068171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.068292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.068407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.068531 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.068648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.068764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.068879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.068993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.069108 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.069231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.069356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.069473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.069594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.069710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.069826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.069956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.070084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.070201 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] auth.external = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.070317 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.070438 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.070595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.070729 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.070850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.070966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.071080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.071195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] auth.password = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.071318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.071463 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] auth.token = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.071589 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.external = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.071715 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.071938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.072055 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.072171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.072303 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.072431 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.072549 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.072665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.password = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.072789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.072908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.token = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.073023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.073147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.073271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.073388 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.073504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] credential.caching = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.073619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.073735 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.073859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.073978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.074094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.074209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.074325 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.074440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.074565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.074691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.074809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.074924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.075041 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.075157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.075281 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.075399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.075505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.075626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.075764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.075894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.076021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.076021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.076243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.076243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.076460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.076460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.076689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.076808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.076924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.077040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.077156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.077156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] federation.caching = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.077389 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.077515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.077633 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.077749 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.077865 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.077981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.078105 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.078224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.078340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.078456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.078572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.078687 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.078811 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.078929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.079045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.079161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.079277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.079393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.079569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.079826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.080010 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.080010 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.080284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.080284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.caching = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.080519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.080519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.080741 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.080741 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.080960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.081087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.081291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.081413 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.081530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.081646 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.081762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.081886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.082004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.082120 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.082235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.082353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.082468 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.082597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.082716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.082831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.082948 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.083064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.083169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.083283 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.083408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.083526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.083642 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.083773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.083893 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.084022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.084142 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.084142 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.084434 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.084552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.084667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.084792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.084910 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.085026 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.085141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.085257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.085373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.085498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.085615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.085731 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.085846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.085846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.086064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.086192 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.086311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.086426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.086543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.086658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.086773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.086773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.087000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.087116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.087231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.087346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.087460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.087585 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.087702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.087862 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.087980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.088095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.088211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.088340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.088459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.088574 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.088690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.088806 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.088921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.089046 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.089163 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.089278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.089393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.089580 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.089714 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.089841 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.089964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.090089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.090207 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.090324 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.090447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.090573 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.090691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.090808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.090924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.091040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.091155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.091280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.091404 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.091520 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.091636 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.091783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.091905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.092034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.092152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.092268 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.092384 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.092500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.092615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.092739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.092857 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.092973 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.093088 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.093203 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.093318 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.093442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.093559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.093674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.093790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.093906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.094021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.094121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.094217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.094332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.094447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.094562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.094686 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.094804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.094921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.095037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.095158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.095276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.095399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.095517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.095633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.095766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.095884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.096001 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.096253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.096368 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.096484 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.096599 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.096715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.096843 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.096961 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.097078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.097193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.097309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.097424 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.097549 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.097667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.097784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.097899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.098015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.098131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.098255 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.098372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.098488 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.098603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.098719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.098834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.098958 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.099076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.099192 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.099307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.099422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.099538 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.099653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.099833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.099967 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.100086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.100203 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.100318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.100442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.100561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.100676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.100799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.100799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.101018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.101641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.101763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.101879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.101994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.102110 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.102225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] resource.caching = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.102350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.102467 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.102583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.102698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.102813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.102928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.103053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.103171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.103286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.103402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.103517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.103632 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.103775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.103896 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.104012 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.104128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.104243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.104358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.104558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.104677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] role.caching = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.104793 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.104909 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] role.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.105024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.105140 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.105264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.105371 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.105529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] role.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.105649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.105766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] role.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.105882 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.106007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.106126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.106241 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.106357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.106474 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.106590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.106714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.106832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.106948 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.107063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.107178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.107309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.107428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.107551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.107669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.107872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.107992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.108120 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.108241 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.108356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.108472 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.108472 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.108690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.108814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.108932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.109048 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.109163 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.109163 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.109410 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.109410 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.109680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.109819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.110006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.110190 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.110367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.110367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.110678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.110797 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.110914 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.111030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.111147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.111272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.111391 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.111507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.111625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.111770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.111892 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.112021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.112142 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.112258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.112374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.112489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.112613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.112732 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.112848 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.112963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.113079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.113194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.113319 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.113437 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] token.caching = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.113553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.113668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.113785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.113900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.114025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.114143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.114259 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.114374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.114490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.114605 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.114730 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.114849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.114966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.115081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.115197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.115313 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.115437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.115555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.115671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.115815 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.115933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.116049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.116178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.116298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.116414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.116529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.116644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.116760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.117468 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.117587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.117703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.117818 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.117934 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.118050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.118175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.118175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.118395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.connection = **** {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.118395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.118633 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.118751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.118875 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.118993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.119119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.connection = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.119246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.119372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.119508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.119625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.119817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.119944 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.120074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.120194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.120311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.120427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.120542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.120657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.120782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.120899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.121016 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.121133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.121248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.121364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.121488 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.121605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.121721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.121837 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.121951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.122067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.122192 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.122310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.122426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.122541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.122656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.122772 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.122897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 07:49:21.123015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.123015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.123015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:49:21.123015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 07:49:21.150487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.150710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.150798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.150872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.150946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.151078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.161019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.161262 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.190664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.190886 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.191017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.191256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.244008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.244194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.295016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.295250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.295489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.295766 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.360905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.361100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.361210 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.361294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.361381 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.361510 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.361595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.361732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.361815 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.361959 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.362041 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.362152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.386298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.386469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.386634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.386718 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.386792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.386865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.386938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.387014 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.387146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.387229 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.387360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.387442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.387574 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.387666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.399003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.399195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.411958 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.412159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.412321 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.412404 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.412479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.412603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.412688 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.412816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.412899 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.413030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.413111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.413240 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.413322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.413454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:49:21.431095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.431306 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 07:49:21.431649 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.431778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.431883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 07:49:21.431998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 07:49:21.432144 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.432344 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.432427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.432546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 07:49:21.432645 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.432824 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.432908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.433102 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.433347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.433609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.444323 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.444551 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.444820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.445611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.445702 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.445902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.446177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.446464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.452554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.453391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.455584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.455907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.456194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.456479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.456559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.456765 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.456849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.457029 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.457111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.457300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.457390 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.457576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.457657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.457854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.457981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.458110 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.458254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.458387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.458546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.458682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.458911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.459184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.481348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.482089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.482830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.483118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.483589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.483908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.487683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.488004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.488285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.488516 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.488808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.489096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.495345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.495640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.496239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.496539 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.499716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.500030 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.500326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.500611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.500689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.500897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.500979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.501192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.501272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.501463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.501553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.501734 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.501815 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.502066 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.502349 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.502624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.518097 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.518382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.519089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.519376 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.522322 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.523506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.525485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.525785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.526665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.526970 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.530149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.531344 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.533299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.534527 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.536450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.536754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.537040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.537334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.537616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.537695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.537907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.537989 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.538281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.538575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.538886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.539183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.554039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.554838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.555105 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.555370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.555932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.556232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.556508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.556777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.562233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.563603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.563792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.564072 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.565214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.565497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.566827 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.567115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.567413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.567705 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.568028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.568335 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.568625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.568921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.569214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.569494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.579469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.579779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.580064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.580355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.580639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.580918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.581007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.581195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.581279 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.581481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.581768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.582056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.582340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.582626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.598284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.599875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.601860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.603399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.604806 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.606365 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.606460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.607875 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.607994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.608168 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.608452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.609468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.609758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.610064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.614789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.616435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.616519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.618123 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.619369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.619663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.619979 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.620259 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.621095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.621394 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.621687 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.621969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.628720 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.629089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.629456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.630481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.630834 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.631165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.638092 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.638382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.638670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.638766 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:49:21.638952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.639034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.639231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.639312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.639519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.639603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.639823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.639907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.640097 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.640178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.640430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.640512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.640706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.640848 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.641015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.641097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.641299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.641387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.641580 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.641668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.641846 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.641927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.642161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.642431 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:49:21.675798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564b4df549c0 pid: 80194 (default app) Aug 10 07:49:21.676037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564b4df549c0 pid: 80195 (default app) Aug 10 07:49:21.679485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3d45-ac92-4337-aae0-8dde1dcc1eca None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:21.679796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3d45-ac92-4337-aae0-8dde1dcc1eca None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:21.680073 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3d45-ac92-4337-aae0-8dde1dcc1eca None None] PATH_INFO: `/v3` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:21.684738 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Wed Aug 10 07:49:21 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:29.454328 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010a26-85cc-4c86-bc27-e1756865efd3 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:29.454903 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010a26-85cc-4c86-bc27-e1756865efd3 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:29.454903 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010a26-85cc-4c86-bc27-e1756865efd3 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:29.459281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:49:29.464695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be1ef1-55b4-42fb-95a3-7fc411d20792 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:29.465145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be1ef1-55b4-42fb-95a3-7fc411d20792 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:29.465232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be1ef1-55b4-42fb-95a3-7fc411d20792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:29.535670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: INFO dbcounter [None req-33be1ef1-55b4-42fb-95a3-7fc411d20792 None None] Registered counter for database keystone Aug 10 07:49:29.556244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG oslo_db.sqlalchemy.engines [None req-33be1ef1-55b4-42fb-95a3-7fc411d20792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 07:49:29.562535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writer thread running {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 07:49:29.745124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG passlib.handlers.bcrypt [None req-33be1ef1-55b4-42fb-95a3-7fc411d20792 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80194) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 07:49:29.745454 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG passlib.handlers.bcrypt [None req-33be1ef1-55b4-42fb-95a3-7fc411d20792 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80194) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 07:49:29.804822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-33be1ef1-55b4-42fb-95a3-7fc411d20792 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:29.806461 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-33be1ef1-55b4-42fb-95a3-7fc411d20792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:29.938847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 07:49:30.081260 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c010a26-85cc-4c86-bc27-e1756865efd3 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:30.153254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: INFO dbcounter [None req-7c010a26-85cc-4c86-bc27-e1756865efd3 None None] Registered counter for database keystone Aug 10 07:49:30.174593 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG oslo_db.sqlalchemy.engines [None req-7c010a26-85cc-4c86-bc27-e1756865efd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80195) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 07:49:30.181109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writer thread running {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 07:49:30.299816 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c010a26-85cc-4c86-bc27-e1756865efd3 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:30.305036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ba31e-1073-4831-b82f-e42e8a38f056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:30.305670 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ba31e-1073-4831-b82f-e42e8a38f056 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:30.305956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ba31e-1073-4831-b82f-e42e8a38f056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:30.306232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ba31e-1073-4831-b82f-e42e8a38f056 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:30.314643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ba31e-1073-4831-b82f-e42e8a38f056 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:30.367694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: WARNING keystone.common.rbac_enforcer.enforcer [None req-443ba31e-1073-4831-b82f-e42e8a38f056 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 07:49:30.367979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ba31e-1073-4831-b82f-e42e8a38f056 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:30.378730 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Aug 10 07:49:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 07:49:30.385705 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be1ef1-55b4-42fb-95a3-7fc411d20792 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:30.404630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be1ef1-55b4-42fb-95a3-7fc411d20792 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:30.418822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6fc42-c34f-45ac-a4d6-2051ebfa2bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:30.418822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6fc42-c34f-45ac-a4d6-2051ebfa2bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:30.418822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6fc42-c34f-45ac-a4d6-2051ebfa2bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:30.418822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6fc42-c34f-45ac-a4d6-2051ebfa2bd2 admin admin] PATH_INFO: `/v3/projects/5422809609a44bf7a3e055f250264a66` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:30.419330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6fc42-c34f-45ac-a4d6-2051ebfa2bd2 admin admin] RBAC: Authorizing `identity:get_project(project_id=5422809609a44bf7a3e055f250264a66)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:30.469269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: WARNING keystone.common.rbac_enforcer.enforcer [None req-25b6fc42-c34f-45ac-a4d6-2051ebfa2bd2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 07:49:30.469873 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6fc42-c34f-45ac-a4d6-2051ebfa2bd2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:30.474352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Aug 10 07:49:30 2022] GET /identity/v3/projects/5422809609a44bf7a3e055f250264a66 => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:32.467287 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6a441-fe9b-4a4a-b797-8d98f2abf7ca None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:32.467863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6a441-fe9b-4a4a-b797-8d98f2abf7ca None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:32.467863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6a441-fe9b-4a4a-b797-8d98f2abf7ca None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:32.471989 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:32.477939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5226f-9b7d-44b4-9ec4-f59f5f975802 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:32.478356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5226f-9b7d-44b4-9ec4-f59f5f975802 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:32.478500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5226f-9b7d-44b4-9ec4-f59f5f975802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:32.500215 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-81b5226f-9b7d-44b4-9ec4-f59f5f975802 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:32.501817 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-81b5226f-9b7d-44b4-9ec4-f59f5f975802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:32.510505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 07:49:32.533557 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6a441-fe9b-4a4a-b797-8d98f2abf7ca None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:32.546238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6a441-fe9b-4a4a-b797-8d98f2abf7ca None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:32.550530 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b8663-08da-4ff6-bfec-ca979a19ee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:32.551142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8663-08da-4ff6-bfec-ca979a19ee8c admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:32.551424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8663-08da-4ff6-bfec-ca979a19ee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:32.551695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8663-08da-4ff6-bfec-ca979a19ee8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:32.561039 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b8663-08da-4ff6-bfec-ca979a19ee8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:32.562823 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b8663-08da-4ff6-bfec-ca979a19ee8c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:32.573101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Aug 10 07:49:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 07:49:32.579006 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5226f-9b7d-44b4-9ec4-f59f5f975802 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:32.588359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5226f-9b7d-44b4-9ec4-f59f5f975802 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:32.592927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148db4ae-7a15-42c7-a85b-1c00dada539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:32.593568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148db4ae-7a15-42c7-a85b-1c00dada539b admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:32.593857 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148db4ae-7a15-42c7-a85b-1c00dada539b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:32.594137 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148db4ae-7a15-42c7-a85b-1c00dada539b admin admin] PATH_INFO: `/v3/users/0923d37e739345a694121096914c323e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:32.595510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148db4ae-7a15-42c7-a85b-1c00dada539b admin admin] RBAC: Authorizing `identity:get_user(user_id=0923d37e739345a694121096914c323e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:32.597425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148db4ae-7a15-42c7-a85b-1c00dada539b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:32.599057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Aug 10 07:49:32 2022] GET /identity/v3/users/0923d37e739345a694121096914c323e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:34.659635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb556d-3f62-4d63-b7cb-ca3a636c6872 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:34.660223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb556d-3f62-4d63-b7cb-ca3a636c6872 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:34.660223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb556d-3f62-4d63-b7cb-ca3a636c6872 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:34.661526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:34.667548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f08c1-354f-49d8-9a65-4201d50e7ea4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:34.668095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f08c1-354f-49d8-9a65-4201d50e7ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:34.668396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f08c1-354f-49d8-9a65-4201d50e7ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:34.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0a4f08c1-354f-49d8-9a65-4201d50e7ea4 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:34.689041 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0a4f08c1-354f-49d8-9a65-4201d50e7ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:34.735823 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feef58e-2043-4fac-a62c-68512f3939f1 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:34.736116 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feef58e-2043-4fac-a62c-68512f3939f1 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:34.736374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feef58e-2043-4fac-a62c-68512f3939f1 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:34.737747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:49:34.744143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb45c9-a48f-4a82-ac68-c96132f2241c None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:34.744431 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb45c9-a48f-4a82-ac68-c96132f2241c None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:34.744712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb45c9-a48f-4a82-ac68-c96132f2241c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:34.775953 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:34.790126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG passlib.handlers.bcrypt [None req-4feb45c9-a48f-4a82-ac68-c96132f2241c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80195) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 07:49:34.790560 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG passlib.handlers.bcrypt [None req-4feb45c9-a48f-4a82-ac68-c96132f2241c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80195) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 07:49:34.799605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f08c1-354f-49d8-9a65-4201d50e7ea4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:34.824255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:34.837720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-4feb45c9-a48f-4a82-ac68-c96132f2241c None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:34.839365 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4feb45c9-a48f-4a82-ac68-c96132f2241c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:34.907575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f08c1-354f-49d8-9a65-4201d50e7ea4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:34.941476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:49:34.943952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be10646-14fc-464c-bb6c-729daff3eec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:34.944605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be10646-14fc-464c-bb6c-729daff3eec3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:34.944910 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be10646-14fc-464c-bb6c-729daff3eec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:34.945189 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be10646-14fc-464c-bb6c-729daff3eec3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:34.957719 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be10646-14fc-464c-bb6c-729daff3eec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:49:34.964719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb45c9-a48f-4a82-ac68-c96132f2241c None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-5be10646-14fc-464c-bb6c-729daff3eec3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:49:34.967021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:34.967966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:34.968769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:34.968769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:34.968769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:34.968769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:34.968769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:49:34.968769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:49:34.968769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:49:34.968769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:49:34.968769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:49:34.968769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:49:34.968769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:49:34.968769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:49:34.968769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:49:34.973977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be10646-14fc-464c-bb6c-729daff3eec3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:35.057361 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:35.067638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb45c9-a48f-4a82-ac68-c96132f2241c None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:35.070313 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:35.076047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be10646-14fc-464c-bb6c-729daff3eec3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:35.105929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d32abb-d831-4a86-804f-0433f155939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:35.106800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d32abb-d831-4a86-804f-0433f155939f None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:35.107093 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d32abb-d831-4a86-804f-0433f155939f None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:35.107376 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d32abb-d831-4a86-804f-0433f155939f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:35.112458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7900bf-48b8-4b98-ab2a-09545671e22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:35.113073 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7900bf-48b8-4b98-ab2a-09545671e22d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:35.113359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7900bf-48b8-4b98-ab2a-09545671e22d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:35.113636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7900bf-48b8-4b98-ab2a-09545671e22d None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:35.114319 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7900bf-48b8-4b98-ab2a-09545671e22d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:35.114624 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7900bf-48b8-4b98-ab2a-09545671e22d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:35.116067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7900bf-48b8-4b98-ab2a-09545671e22d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:35.128152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:49:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:49:35.134234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7900bf-48b8-4b98-ab2a-09545671e22d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:35.181866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d32abb-d831-4a86-804f-0433f155939f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:35.183572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d32abb-d831-4a86-804f-0433f155939f None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:35.291830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:49:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 07:49:35.297966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d32abb-d831-4a86-804f-0433f155939f None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:35.301197 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:35.343316 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7900bf-48b8-4b98-ab2a-09545671e22d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:35.377152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660a90f-2b3e-4832-82b6-6a214197feb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:35.377821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660a90f-2b3e-4832-82b6-6a214197feb7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:35.378107 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660a90f-2b3e-4832-82b6-6a214197feb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:35.378390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660a90f-2b3e-4832-82b6-6a214197feb7 None admin] PATH_INFO: `/v3/users/0923d37e739345a694121096914c323e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:35.379534 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660a90f-2b3e-4832-82b6-6a214197feb7 None admin] RBAC: Authorizing `identity:get_user(user_id=0923d37e739345a694121096914c323e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:35.381045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660a90f-2b3e-4832-82b6-6a214197feb7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:35.383209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:49:35 2022] GET /identity/v3/users/0923d37e739345a694121096914c323e => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:35.388810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660a90f-2b3e-4832-82b6-6a214197feb7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:35.400199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d32abb-d831-4a86-804f-0433f155939f None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:35.404261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:35.434341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1b89b-2682-4a8b-a0f6-6b84209e28ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:35.435119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1b89b-2682-4a8b-a0f6-6b84209e28ff None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:35.435411 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1b89b-2682-4a8b-a0f6-6b84209e28ff None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:35.435690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1b89b-2682-4a8b-a0f6-6b84209e28ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:35.455063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1b89b-2682-4a8b-a0f6-6b84209e28ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:35.456598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1b89b-2682-4a8b-a0f6-6b84209e28ff None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-c6e1b89b-2682-4a8b-a0f6-6b84209e28ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:49:35.475977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:35.477117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:49:35.478261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:49:35.478261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:49:35.478261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:49:35.478261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:49:35.483147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1b89b-2682-4a8b-a0f6-6b84209e28ff None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:35.499570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660a90f-2b3e-4832-82b6-6a214197feb7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:35.535059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f8c4c-579a-438a-8575-4955e05e333a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:35.535703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f8c4c-579a-438a-8575-4955e05e333a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:35.536020 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f8c4c-579a-438a-8575-4955e05e333a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:35.536297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f8c4c-579a-438a-8575-4955e05e333a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:35.537447 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f8c4c-579a-438a-8575-4955e05e333a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:35.538901 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f8c4c-579a-438a-8575-4955e05e333a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:35.540503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:49:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:49:35.541846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:35.546883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f8c4c-579a-438a-8575-4955e05e333a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:35.588302 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1b89b-2682-4a8b-a0f6-6b84209e28ff None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:35.623141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fce3d-e503-42b2-a9b1-bc5e31ab2b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:35.623776 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fce3d-e503-42b2-a9b1-bc5e31ab2b5e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:35.624058 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fce3d-e503-42b2-a9b1-bc5e31ab2b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:35.624327 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fce3d-e503-42b2-a9b1-bc5e31ab2b5e None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:35.624977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fce3d-e503-42b2-a9b1-bc5e31ab2b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:35.625275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fce3d-e503-42b2-a9b1-bc5e31ab2b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:35.626666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fce3d-e503-42b2-a9b1-bc5e31ab2b5e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:35.628645 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:35.644678 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 10/20] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:49:35.648708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f8c4c-579a-438a-8575-4955e05e333a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:35.686207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667015f5-6201-4ef3-bc5b-266ba32a450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:35.686820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667015f5-6201-4ef3-bc5b-266ba32a450a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:35.687019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667015f5-6201-4ef3-bc5b-266ba32a450a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:35.687294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667015f5-6201-4ef3-bc5b-266ba32a450a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:35.688071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667015f5-6201-4ef3-bc5b-266ba32a450a None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.domain.id=default, user.id=0923d37e739345a694121096914c323e) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:35.688384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667015f5-6201-4ef3-bc5b-266ba32a450a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:35.689888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667015f5-6201-4ef3-bc5b-266ba32a450a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:35.698193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 11/21] 10.222.0.30 () {56 vars in 1322 bytes} [Wed Aug 10 07:49:35 2022] GET /identity/v3/role_assignments?user.id=0923d37e739345a694121096914c323e&scope.domain.id=default&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:38.073779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fcde4-233a-4f9b-9d6b-6b6135948482 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:38.074810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fcde4-233a-4f9b-9d6b-6b6135948482 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:38.075315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fcde4-233a-4f9b-9d6b-6b6135948482 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:38.076909 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 11/22] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:38.082573 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b008220-7da5-44f1-9c85-d28e612a0d0b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:38.083445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b008220-7da5-44f1-9c85-d28e612a0d0b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:38.083962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b008220-7da5-44f1-9c85-d28e612a0d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:38.120790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8b008220-7da5-44f1-9c85-d28e612a0d0b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:38.122370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8b008220-7da5-44f1-9c85-d28e612a0d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:38.218486 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 12/23] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:38.256599 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fcde4-233a-4f9b-9d6b-6b6135948482 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:38.375961 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244f5b3-689d-4e01-b7ba-eee098f4475d None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:38.376319 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244f5b3-689d-4e01-b7ba-eee098f4475d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:38.376524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244f5b3-689d-4e01-b7ba-eee098f4475d None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:38.378042 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:49:38.383982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee730ad-de5f-4ad9-b52d-e44977064562 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:38.384274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee730ad-de5f-4ad9-b52d-e44977064562 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:38.384559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee730ad-de5f-4ad9-b52d-e44977064562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:38.421474 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6ee730ad-de5f-4ad9-b52d-e44977064562 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:38.425291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6ee730ad-de5f-4ad9-b52d-e44977064562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:38.433679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fcde4-233a-4f9b-9d6b-6b6135948482 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:38.478614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:38.536169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7c61d-2dfd-482c-a77d-b76e28d48770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:38.537038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7c61d-2dfd-482c-a77d-b76e28d48770 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:38.537428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7c61d-2dfd-482c-a77d-b76e28d48770 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:38.537794 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7c61d-2dfd-482c-a77d-b76e28d48770 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:38.547514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 14/25] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:49:38.549753 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a9f9-5351-4ee7-9520-f0ad157f82d6 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:38.550277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a9f9-5351-4ee7-9520-f0ad157f82d6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:38.550725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a9f9-5351-4ee7-9520-f0ad157f82d6 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:38.552888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 15/26] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:38.559454 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86bd9-27a2-4396-9895-c54ba9a7c4e4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:38.560000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86bd9-27a2-4396-9895-c54ba9a7c4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:38.560481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86bd9-27a2-4396-9895-c54ba9a7c4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:38.569557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:38.575925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7c61d-2dfd-482c-a77d-b76e28d48770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:49:38.584032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-dba86bd9-27a2-4396-9895-c54ba9a7c4e4 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:38.586105 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dba86bd9-27a2-4396-9895-c54ba9a7c4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:38.668526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 16/27] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:38.669213 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba86bd9-27a2-4396-9895-c54ba9a7c4e4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-f2c7c61d-2dfd-482c-a77d-b76e28d48770 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:49:38.693674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:38.694562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:38.695464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:38.695464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:38.695464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:38.695464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:38.695464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:49:38.695464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:49:38.695464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:49:38.695464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:49:38.695464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:49:38.695464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:49:38.695464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:49:38.695464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:49:38.699929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 12/28] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:49:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:49:38.701302 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da637c5-b329-4bf0-8770-0c8f1e955f98 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:38.701588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da637c5-b329-4bf0-8770-0c8f1e955f98 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:38.701859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da637c5-b329-4bf0-8770-0c8f1e955f98 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:38.703373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 13/29] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:38.705519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da637c5-b329-4bf0-8770-0c8f1e955f98 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:38.780608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba86bd9-27a2-4396-9895-c54ba9a7c4e4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:38.817942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ea40a-a772-4896-bf36-8c32930debe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:38.818567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ea40a-a772-4896-bf36-8c32930debe0 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:38.818852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ea40a-a772-4896-bf36-8c32930debe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:38.819128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ea40a-a772-4896-bf36-8c32930debe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:38.819877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ea40a-a772-4896-bf36-8c32930debe0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:38.820592 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da637c5-b329-4bf0-8770-0c8f1e955f98 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:38.821368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ea40a-a772-4896-bf36-8c32930debe0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:38.825303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:38.858765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d3de7-a978-45fe-a802-096409e9ad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:38.859385 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d3de7-a978-45fe-a802-096409e9ad9e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:38.859672 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d3de7-a978-45fe-a802-096409e9ad9e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:38.860044 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d3de7-a978-45fe-a802-096409e9ad9e None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:38.860901 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d3de7-a978-45fe-a802-096409e9ad9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:38.861218 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d3de7-a978-45fe-a802-096409e9ad9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:38.862653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d3de7-a978-45fe-a802-096409e9ad9e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:38.880517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 14/30] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:49:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:38.881397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d3de7-a978-45fe-a802-096409e9ad9e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:38.923354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:38.961490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 17/31] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Aug 10 07:49:38 2022] POST /identity/v3/roles => generated 219 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:49:38.963207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7af384-a380-4085-a5f2-8f4d672965be None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:38.963670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7af384-a380-4085-a5f2-8f4d672965be None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:38.964113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7af384-a380-4085-a5f2-8f4d672965be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:38.985949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-eb7af384-a380-4085-a5f2-8f4d672965be None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:38.987835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-eb7af384-a380-4085-a5f2-8f4d672965be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:39.026005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d3de7-a978-45fe-a802-096409e9ad9e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:39.067044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 18/32] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:39.068415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7af384-a380-4085-a5f2-8f4d672965be None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:39.079349 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306d7b5-1ba5-425c-98f2-90cedbb50d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:39.082556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306d7b5-1ba5-425c-98f2-90cedbb50d0b None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:39.082848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306d7b5-1ba5-425c-98f2-90cedbb50d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:39.083116 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306d7b5-1ba5-425c-98f2-90cedbb50d0b None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:39.083832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306d7b5-1ba5-425c-98f2-90cedbb50d0b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:39.085621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306d7b5-1ba5-425c-98f2-90cedbb50d0b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:39.247198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7af384-a380-4085-a5f2-8f4d672965be None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:39.266185 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 15/33] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Aug 10 07:49:38 2022] POST /identity/v3/roles => generated 225 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:49:39.267187 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306d7b5-1ba5-425c-98f2-90cedbb50d0b None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:39.275904 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:39.289936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf1423-2dd4-4fe9-8250-76778525a01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:39.290760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf1423-2dd4-4fe9-8250-76778525a01f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:39.292195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf1423-2dd4-4fe9-8250-76778525a01f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:39.292195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf1423-2dd4-4fe9-8250-76778525a01f None admin] PATH_INFO: `/v3/users/0923d37e739345a694121096914c323e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:39.293482 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf1423-2dd4-4fe9-8250-76778525a01f None admin] RBAC: Authorizing `identity:get_user(user_id=0923d37e739345a694121096914c323e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:39.295181 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf1423-2dd4-4fe9-8250-76778525a01f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:39.300313 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 19/34] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:49:39 2022] GET /identity/v3/users/0923d37e739345a694121096914c323e => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:39.303424 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf1423-2dd4-4fe9-8250-76778525a01f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:39.452613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf1423-2dd4-4fe9-8250-76778525a01f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:39.492380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:39.499336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c872415-f133-4c0d-8704-bdd62a4091e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:39.500506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872415-f133-4c0d-8704-bdd62a4091e3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:39.501198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872415-f133-4c0d-8704-bdd62a4091e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:39.501676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872415-f133-4c0d-8704-bdd62a4091e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:39.503338 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c872415-f133-4c0d-8704-bdd62a4091e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:39.504399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306d7b5-1ba5-425c-98f2-90cedbb50d0b None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:39.505300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c872415-f133-4c0d-8704-bdd62a4091e3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:39.507531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 20/35] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:49:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:49:39.514977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c872415-f133-4c0d-8704-bdd62a4091e3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:39.583648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880246c-05ee-4257-b5e2-18ff64b65448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:39.584354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880246c-05ee-4257-b5e2-18ff64b65448 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:39.584653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880246c-05ee-4257-b5e2-18ff64b65448 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:39.584969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880246c-05ee-4257-b5e2-18ff64b65448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:39.599491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880246c-05ee-4257-b5e2-18ff64b65448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:39.601733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880246c-05ee-4257-b5e2-18ff64b65448 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:39.601884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-9880246c-05ee-4257-b5e2-18ff64b65448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:49:39.622677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:39.623596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:49:39.624502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:49:39.624502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:49:39.624502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:49:39.624502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 16/36] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:49:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:49:39.626171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c48c2-aeaf-49ac-92d2-dcf2fdd97889 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:39.626466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c48c2-aeaf-49ac-92d2-dcf2fdd97889 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:39.626749 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c48c2-aeaf-49ac-92d2-dcf2fdd97889 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:39.628141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 17/37] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:39.633217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c48c2-aeaf-49ac-92d2-dcf2fdd97889 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:39.652145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c872415-f133-4c0d-8704-bdd62a4091e3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:39.696321 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a5ea0-ede6-4430-81c5-989ff4c7a12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:39.697171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a5ea0-ede6-4430-81c5-989ff4c7a12f None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:39.697476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a5ea0-ede6-4430-81c5-989ff4c7a12f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:39.697758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a5ea0-ede6-4430-81c5-989ff4c7a12f None admin] PATH_INFO: `/v3/domains/default/users/0923d37e739345a694121096914c323e/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:39.699950 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a5ea0-ede6-4430-81c5-989ff4c7a12f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0923d37e739345a694121096914c323e, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:39.701432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a5ea0-ede6-4430-81c5-989ff4c7a12f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:39.718548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 21/38] 10.222.0.30 () {58 vars in 1361 bytes} [Wed Aug 10 07:49:39 2022] PUT /identity/v3/domains/default/users/0923d37e739345a694121096914c323e/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:49:39.722199 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ad6a2-e990-4792-a561-f13ab87009c8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:39.722784 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ad6a2-e990-4792-a561-f13ab87009c8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:39.723327 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ad6a2-e990-4792-a561-f13ab87009c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:39.750637 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-685ad6a2-e990-4792-a561-f13ab87009c8 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:39.753449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-685ad6a2-e990-4792-a561-f13ab87009c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:39.773716 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c48c2-aeaf-49ac-92d2-dcf2fdd97889 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:39.824904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b5285-c0ed-473c-9d1b-1ab4507a3763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:39.826558 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b5285-c0ed-473c-9d1b-1ab4507a3763 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:39.826843 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b5285-c0ed-473c-9d1b-1ab4507a3763 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:39.827312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b5285-c0ed-473c-9d1b-1ab4507a3763 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:39.828543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b5285-c0ed-473c-9d1b-1ab4507a3763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:39.828861 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b5285-c0ed-473c-9d1b-1ab4507a3763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:39.830312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b5285-c0ed-473c-9d1b-1ab4507a3763 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:39.843688 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 18/39] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:39.845141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cee4d-e862-4039-91f5-dbaa338ae478 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:39.845459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cee4d-e862-4039-91f5-dbaa338ae478 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:39.845723 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cee4d-e862-4039-91f5-dbaa338ae478 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:39.851807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 19/40] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:39.851807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cee4d-e862-4039-91f5-dbaa338ae478 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:39.861697 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 22/41] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:39.863096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23e7a-c0dd-4f71-9332-86eec8b124b9 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:39.863393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23e7a-c0dd-4f71-9332-86eec8b124b9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:39.863670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23e7a-c0dd-4f71-9332-86eec8b124b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:39.873431 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:39.891768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-78c23e7a-c0dd-4f71-9332-86eec8b124b9 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:39.891768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-78c23e7a-c0dd-4f71-9332-86eec8b124b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:39.948448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:39.971250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 23/42] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:39.972344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c23e7a-c0dd-4f71-9332-86eec8b124b9 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:39.998600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cee4d-e862-4039-91f5-dbaa338ae478 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:40.049546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbbe7f-b5e2-4ca8-bfb9-015ffad47929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:40.050272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbbe7f-b5e2-4ca8-bfb9-015ffad47929 None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:40.050563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbbe7f-b5e2-4ca8-bfb9-015ffad47929 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:40.050839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbbe7f-b5e2-4ca8-bfb9-015ffad47929 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:40.051784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbbe7f-b5e2-4ca8-bfb9-015ffad47929 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:40.053500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbbe7f-b5e2-4ca8-bfb9-015ffad47929 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:40.086750 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c23e7a-c0dd-4f71-9332-86eec8b124b9 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:40.096150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 20/43] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:49:39 2022] POST /identity/v3/projects => generated 301 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:49:40.096150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbbe7f-b5e2-4ca8-bfb9-015ffad47929 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:40.146733 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb546d73-c40b-4993-b286-5fa89725d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:40.147540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb546d73-c40b-4993-b286-5fa89725d54f None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:40.148466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb546d73-c40b-4993-b286-5fa89725d54f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:40.148838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb546d73-c40b-4993-b286-5fa89725d54f None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:40.149666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb546d73-c40b-4993-b286-5fa89725d54f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:40.151478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb546d73-c40b-4993-b286-5fa89725d54f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:40.170058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 24/44] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Aug 10 07:49:39 2022] POST /identity/v3/roles => generated 223 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:49:40.192387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:40.260240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbbe7f-b5e2-4ca8-bfb9-015ffad47929 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:40.324377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eac737-48fc-4797-8815-59357ffe1565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:40.325052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eac737-48fc-4797-8815-59357ffe1565 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:40.325337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eac737-48fc-4797-8815-59357ffe1565 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:40.325615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eac737-48fc-4797-8815-59357ffe1565 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:40.326876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eac737-48fc-4797-8815-59357ffe1565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:40.328409 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eac737-48fc-4797-8815-59357ffe1565 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:40.330434 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 21/45] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:49:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:40.337011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb546d73-c40b-4993-b286-5fa89725d54f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:40.394025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:40.463626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb546d73-c40b-4993-b286-5fa89725d54f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:40.502128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d1b8b-bf9e-4bf9-873a-e077f356f9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:40.502769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d1b8b-bf9e-4bf9-873a-e077f356f9e5 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:40.503060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d1b8b-bf9e-4bf9-873a-e077f356f9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:40.503343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d1b8b-bf9e-4bf9-873a-e077f356f9e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:40.504066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d1b8b-bf9e-4bf9-873a-e077f356f9e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:40.505576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d1b8b-bf9e-4bf9-873a-e077f356f9e5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:40.538233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 25/46] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:49:40 2022] POST /identity/v3/projects => generated 312 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:49:41.814812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e0a71-8c22-4b68-9946-9e1661c3443b None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:41.815327 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e0a71-8c22-4b68-9946-9e1661c3443b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:41.815433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e0a71-8c22-4b68-9946-9e1661c3443b None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:41.816763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 22/47] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:41.822700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01794cf5-f1de-4f45-9262-d7fbc58bb639 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:41.823137 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01794cf5-f1de-4f45-9262-d7fbc58bb639 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:41.823261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01794cf5-f1de-4f45-9262-d7fbc58bb639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:41.841922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-01794cf5-f1de-4f45-9262-d7fbc58bb639 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:41.843147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-01794cf5-f1de-4f45-9262-d7fbc58bb639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:41.912840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 26/48] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:41.936141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e0a71-8c22-4b68-9946-9e1661c3443b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:42.042298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e0a71-8c22-4b68-9946-9e1661c3443b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:42.072782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:42.079550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835afe1f-cae9-4c89-a302-93a776e8cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:42.080237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835afe1f-cae9-4c89-a302-93a776e8cb53 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:42.080526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835afe1f-cae9-4c89-a302-93a776e8cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:42.080806 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835afe1f-cae9-4c89-a302-93a776e8cb53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:42.091293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835afe1f-cae9-4c89-a302-93a776e8cb53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-835afe1f-cae9-4c89-a302-93a776e8cb53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:49:42.096133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:42.097003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:42.097828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:42.097828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:42.097828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:42.097828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:42.097828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:49:42.097828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:49:42.097828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:49:42.097828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:49:42.097828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:49:42.097828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:49:42.097828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:49:42.097828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:49:42.097828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 23/49] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:49:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:49:42.104100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01794cf5-f1de-4f45-9262-d7fbc58bb639 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:42.130388 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:42.209014 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01794cf5-f1de-4f45-9262-d7fbc58bb639 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:42.244967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3afeb-a2cf-44b8-9bd1-bdc06cfca720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:42.245592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3afeb-a2cf-44b8-9bd1-bdc06cfca720 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:42.245867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3afeb-a2cf-44b8-9bd1-bdc06cfca720 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:42.246137 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3afeb-a2cf-44b8-9bd1-bdc06cfca720 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:42.246814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3afeb-a2cf-44b8-9bd1-bdc06cfca720 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:42.247111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3afeb-a2cf-44b8-9bd1-bdc06cfca720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:42.248519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3afeb-a2cf-44b8-9bd1-bdc06cfca720 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:42.260408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 27/50] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:49:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:42.267215 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835afe1f-cae9-4c89-a302-93a776e8cb53 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:42.372994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835afe1f-cae9-4c89-a302-93a776e8cb53 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:42.408903 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16cbe7-0a68-4bcc-9cb1-2fd12aeb3629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:42.409543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16cbe7-0a68-4bcc-9cb1-2fd12aeb3629 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:42.409827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16cbe7-0a68-4bcc-9cb1-2fd12aeb3629 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:42.410100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16cbe7-0a68-4bcc-9cb1-2fd12aeb3629 None admin] PATH_INFO: `/v3/users/0923d37e739345a694121096914c323e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:42.411489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16cbe7-0a68-4bcc-9cb1-2fd12aeb3629 None admin] RBAC: Authorizing `identity:get_user(user_id=0923d37e739345a694121096914c323e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:42.412969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16cbe7-0a68-4bcc-9cb1-2fd12aeb3629 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:42.415281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 24/51] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:49:42 2022] GET /identity/v3/users/0923d37e739345a694121096914c323e => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:42.420758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3afeb-a2cf-44b8-9bd1-bdc06cfca720 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:42.510398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:42.527601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3afeb-a2cf-44b8-9bd1-bdc06cfca720 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:42.563260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa05cd9-28a4-44bc-95d4-0cd8fe42848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:42.563930 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa05cd9-28a4-44bc-95d4-0cd8fe42848d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:42.564218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa05cd9-28a4-44bc-95d4-0cd8fe42848d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:42.564494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa05cd9-28a4-44bc-95d4-0cd8fe42848d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:42.565624 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa05cd9-28a4-44bc-95d4-0cd8fe42848d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:42.567075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa05cd9-28a4-44bc-95d4-0cd8fe42848d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:42.568684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 28/52] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:49:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:42.575392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16cbe7-0a68-4bcc-9cb1-2fd12aeb3629 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:42.579497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0c905-d0b1-4eac-81c1-a3724fe9b002 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:42.579820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0c905-d0b1-4eac-81c1-a3724fe9b002 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:42.580104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0c905-d0b1-4eac-81c1-a3724fe9b002 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:42.581442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 29/53] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:42.587244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987ca4f-8739-4580-a68a-393bbc63ff84 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:42.587534 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987ca4f-8739-4580-a68a-393bbc63ff84 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:42.587842 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987ca4f-8739-4580-a68a-393bbc63ff84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:42.606118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3987ca4f-8739-4580-a68a-393bbc63ff84 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:42.607319 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3987ca4f-8739-4580-a68a-393bbc63ff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:42.637300 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:42.675783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 30/54] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:49:42.680900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16cbe7-0a68-4bcc-9cb1-2fd12aeb3629 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:42.700217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987ca4f-8739-4580-a68a-393bbc63ff84 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:42.718106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6518c3-f04c-401f-bc68-428036fd4763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:42.718723 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6518c3-f04c-401f-bc68-428036fd4763 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:42.719009 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6518c3-f04c-401f-bc68-428036fd4763 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:42.719291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6518c3-f04c-401f-bc68-428036fd4763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:42.720064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6518c3-f04c-401f-bc68-428036fd4763 None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.domain.id=default, user.id=0923d37e739345a694121096914c323e) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:42.720374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6518c3-f04c-401f-bc68-428036fd4763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:42.721824 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6518c3-f04c-401f-bc68-428036fd4763 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:42.730830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 25/55] 10.222.0.30 () {56 vars in 1322 bytes} [Wed Aug 10 07:49:42 2022] GET /identity/v3/role_assignments?user.id=0923d37e739345a694121096914c323e&scope.domain.id=default&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:42.797975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:42.818560 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987ca4f-8739-4580-a68a-393bbc63ff84 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:42.859204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680652a-edd9-41f8-9ff8-03d80bbe83a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:42.859906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680652a-edd9-41f8-9ff8-03d80bbe83a9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:42.860172 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680652a-edd9-41f8-9ff8-03d80bbe83a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:42.860460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680652a-edd9-41f8-9ff8-03d80bbe83a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:42.861672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680652a-edd9-41f8-9ff8-03d80bbe83a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:42.863194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680652a-edd9-41f8-9ff8-03d80bbe83a9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:42.865235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 31/56] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:49:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:49:42.871456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6518c3-f04c-401f-bc68-428036fd4763 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:42.981759 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6518c3-f04c-401f-bc68-428036fd4763 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:43.003571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:43.016808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618cf85-1ea4-4e95-a60f-6a584ac99bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:43.017464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618cf85-1ea4-4e95-a60f-6a584ac99bd8 None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:43.017764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618cf85-1ea4-4e95-a60f-6a584ac99bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:43.018045 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618cf85-1ea4-4e95-a60f-6a584ac99bd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:43.018700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618cf85-1ea4-4e95-a60f-6a584ac99bd8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:43.020188 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618cf85-1ea4-4e95-a60f-6a584ac99bd8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:43.048101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 26/57] 10.222.0.30 () {60 vars in 1140 bytes} [Wed Aug 10 07:49:42 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:49:45.096506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f542c-a0d9-45d5-8247-24619e60458c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:45.097037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f542c-a0d9-45d5-8247-24619e60458c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:45.097037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f542c-a0d9-45d5-8247-24619e60458c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:45.098462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 32/58] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:45.104237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26dad2-e0b2-4139-97da-dbe7586d50bc None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:45.104644 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26dad2-e0b2-4139-97da-dbe7586d50bc None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:45.104830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26dad2-e0b2-4139-97da-dbe7586d50bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:45.123758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-8b26dad2-e0b2-4139-97da-dbe7586d50bc None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:45.126409 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8b26dad2-e0b2-4139-97da-dbe7586d50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:45.194560 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 27/59] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:45.218990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f542c-a0d9-45d5-8247-24619e60458c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:45.322408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f542c-a0d9-45d5-8247-24619e60458c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:45.357156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cca44-809f-44e9-9f85-dae5e505650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:45.357796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cca44-809f-44e9-9f85-dae5e505650e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:45.358080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cca44-809f-44e9-9f85-dae5e505650e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:45.358357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cca44-809f-44e9-9f85-dae5e505650e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:45.359495 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cca44-809f-44e9-9f85-dae5e505650e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:45.361003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cca44-809f-44e9-9f85-dae5e505650e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:45.362580 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 33/60] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:49:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:45.368282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26dad2-e0b2-4139-97da-dbe7586d50bc None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:45.470770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26dad2-e0b2-4139-97da-dbe7586d50bc None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:45.473451 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:45.508796 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac368949-d75a-4fc7-bf9e-4f73a02a3daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:45.509415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac368949-d75a-4fc7-bf9e-4f73a02a3daa None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:45.509709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac368949-d75a-4fc7-bf9e-4f73a02a3daa None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:45.509991 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac368949-d75a-4fc7-bf9e-4f73a02a3daa None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:45.510648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac368949-d75a-4fc7-bf9e-4f73a02a3daa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:45.512139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac368949-d75a-4fc7-bf9e-4f73a02a3daa None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:45.540992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 28/61] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:49:45 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:49:48.797703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4faab88-b5ed-4038-8892-6d305acd7864 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:48.798858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4faab88-b5ed-4038-8892-6d305acd7864 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:48.799353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4faab88-b5ed-4038-8892-6d305acd7864 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:48.801083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 34/62] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:48.807881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076d05a-7bea-412b-b9d6-2e975b3b923f None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:48.808760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076d05a-7bea-412b-b9d6-2e975b3b923f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:48.809233 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076d05a-7bea-412b-b9d6-2e975b3b923f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:48.836934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-8076d05a-7bea-412b-b9d6-2e975b3b923f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:48.838564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8076d05a-7bea-412b-b9d6-2e975b3b923f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:48.949763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 29/63] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:48.993902 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4faab88-b5ed-4038-8892-6d305acd7864 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:49.016011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:49.050718 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2874a-702e-478b-96e8-6a085cdae7c6 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.051358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2874a-702e-478b-96e8-6a085cdae7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.051890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2874a-702e-478b-96e8-6a085cdae7c6 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.053712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 30/64] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:49.059552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c79f-d14e-4e0f-a9e1-edd9723487d9 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.060121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c79f-d14e-4e0f-a9e1-edd9723487d9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.060629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c79f-d14e-4e0f-a9e1-edd9723487d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.093785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-7bc3c79f-d14e-4e0f-a9e1-edd9723487d9 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:49.095602 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7bc3c79f-d14e-4e0f-a9e1-edd9723487d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:49.108826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4faab88-b5ed-4038-8892-6d305acd7864 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:49.149194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230472c-01ec-47b6-81bd-7592453551d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:49.150095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230472c-01ec-47b6-81bd-7592453551d7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.150522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230472c-01ec-47b6-81bd-7592453551d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.150941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230472c-01ec-47b6-81bd-7592453551d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.166951 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230472c-01ec-47b6-81bd-7592453551d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-6230472c-01ec-47b6-81bd-7592453551d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:49:49.172494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:49.173561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:49.174554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:49.174554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:49.174554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:49.174554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:49.174554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:49:49.174554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:49:49.174554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:49:49.174554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:49:49.174554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:49:49.174554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:49:49.174554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:49:49.174554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:49:49.176789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 35/65] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:49:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:49:49.185091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230472c-01ec-47b6-81bd-7592453551d7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:49.275642 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 31/66] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:49:49.285622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459be0-fa1f-4d86-84ca-bf1087687b4a None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.286112 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459be0-fa1f-4d86-84ca-bf1087687b4a None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.286614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459be0-fa1f-4d86-84ca-bf1087687b4a None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.288234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 32/67] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:49.288815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:49.300709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f1e9-91c2-40ee-bf68-3fbadb6b4534 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.301891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f1e9-91c2-40ee-bf68-3fbadb6b4534 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.302544 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f1e9-91c2-40ee-bf68-3fbadb6b4534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.312679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230472c-01ec-47b6-81bd-7592453551d7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:49.337249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-db48f1e9-91c2-40ee-bf68-3fbadb6b4534 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:49.338767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-db48f1e9-91c2-40ee-bf68-3fbadb6b4534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:49.357158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:49.358669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f0ddc-82b2-47ca-a059-3317145cb76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:49.359366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f0ddc-82b2-47ca-a059-3317145cb76d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.359722 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f0ddc-82b2-47ca-a059-3317145cb76d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.360161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f0ddc-82b2-47ca-a059-3317145cb76d None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.360884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f0ddc-82b2-47ca-a059-3317145cb76d None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:49.361194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f0ddc-82b2-47ca-a059-3317145cb76d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:49.362974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f0ddc-82b2-47ca-a059-3317145cb76d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:49.371396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 36/68] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:49:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:49.372241 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f0ddc-82b2-47ca-a059-3317145cb76d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:49.426641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 33/69] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:49:49.429700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9c121-11f3-4dbd-878a-987d8e57699f None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.430375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9c121-11f3-4dbd-878a-987d8e57699f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.431068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9c121-11f3-4dbd-878a-987d8e57699f None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.433838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 34/70] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:49.435372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9c121-11f3-4dbd-878a-987d8e57699f None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:49.507757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f0ddc-82b2-47ca-a059-3317145cb76d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:49.546552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47ce87-c255-464e-aca7-c4b2b79fd2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:49.547203 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47ce87-c255-464e-aca7-c4b2b79fd2bf None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.547524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47ce87-c255-464e-aca7-c4b2b79fd2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.547797 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47ce87-c255-464e-aca7-c4b2b79fd2bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.557247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:49.560997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47ce87-c255-464e-aca7-c4b2b79fd2bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-5e47ce87-c255-464e-aca7-c4b2b79fd2bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:49:49.565938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:49.566787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:49.567558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:49.567558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:49.567558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:49.567558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:49.567558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:49:49.567558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:49:49.567558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:49:49.567558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:49:49.567558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:49:49.567558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:49:49.567558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:49:49.567558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:49:49.567558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 37/71] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:49:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:49:49.568208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802bfb-2e2c-406b-a67e-d8c4d8be3311 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.568566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802bfb-2e2c-406b-a67e-d8c4d8be3311 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.568816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802bfb-2e2c-406b-a67e-d8c4d8be3311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.577229 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9c121-11f3-4dbd-878a-987d8e57699f None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:49.591088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4b802bfb-2e2c-406b-a67e-d8c4d8be3311 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:49.592595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4b802bfb-2e2c-406b-a67e-d8c4d8be3311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:49.614827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0ae36-ab92-4f1a-a017-fd85a8f4a2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:49.615466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0ae36-ab92-4f1a-a017-fd85a8f4a2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.615776 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0ae36-ab92-4f1a-a017-fd85a8f4a2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.616063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0ae36-ab92-4f1a-a017-fd85a8f4a2a5 None admin] PATH_INFO: `/v3/users/6e48447e02b346eea64eb71c1e6414e1` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.632206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0ae36-ab92-4f1a-a017-fd85a8f4a2a5 None admin] RBAC: Authorizing `identity:get_user(user_id=6e48447e02b346eea64eb71c1e6414e1)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:49.634172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0ae36-ab92-4f1a-a017-fd85a8f4a2a5 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:49.635884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 35/72] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:49:49 2022] GET /identity/v3/users/6e48447e02b346eea64eb71c1e6414e1 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:49.636679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0ae36-ab92-4f1a-a017-fd85a8f4a2a5 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:49.652155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:49.663147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 38/73] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:49.664985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4017f0-5041-4383-b0ce-48412970102f None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.665281 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4017f0-5041-4383-b0ce-48412970102f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.665558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4017f0-5041-4383-b0ce-48412970102f None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.666894 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 39/74] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:49.667527 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4017f0-5041-4383-b0ce-48412970102f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:49.759740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0ae36-ab92-4f1a-a017-fd85a8f4a2a5 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:49.789062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4017f0-5041-4383-b0ce-48412970102f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:49.799282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb651b-0029-45c1-9173-c86f534794e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:49.799948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb651b-0029-45c1-9173-c86f534794e8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.800232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb651b-0029-45c1-9173-c86f534794e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.800514 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb651b-0029-45c1-9173-c86f534794e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.812997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb651b-0029-45c1-9173-c86f534794e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:49:49.818237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-fbfb651b-0029-45c1-9173-c86f534794e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:49:49.818647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:49.819490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:49.821194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:49.821194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:49.821194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:49.821194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:49.821194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:49:49.821194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:49:49.821194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:49:49.821194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:49:49.821194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:49:49.821194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:49:49.821194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:49:49.821194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:49:49.821947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 36/75] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:49:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:49:49.822050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb651b-0029-45c1-9173-c86f534794e8 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:49.831361 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe23ac-4612-4c4a-a22f-949e52aaab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:49.832002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe23ac-4612-4c4a-a22f-949e52aaab82 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.832280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe23ac-4612-4c4a-a22f-949e52aaab82 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.832560 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe23ac-4612-4c4a-a22f-949e52aaab82 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.833237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe23ac-4612-4c4a-a22f-949e52aaab82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:49.833536 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe23ac-4612-4c4a-a22f-949e52aaab82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:49.834947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe23ac-4612-4c4a-a22f-949e52aaab82 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:49.843706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 40/76] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:49:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:49.844960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f48e4-209b-4638-b292-ef071f1f3bbf None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.845247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f48e4-209b-4638-b292-ef071f1f3bbf None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.845542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f48e4-209b-4638-b292-ef071f1f3bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:49.863973 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-638f48e4-209b-4638-b292-ef071f1f3bbf None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:49.865163 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-638f48e4-209b-4638-b292-ef071f1f3bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:49.897340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:49.934594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb651b-0029-45c1-9173-c86f534794e8 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:49.939968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 41/77] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:49.941699 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f48e4-209b-4638-b292-ef071f1f3bbf None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:49.985200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1760fd-525b-47ac-8ade-a23a0e2a3a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:49.985825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1760fd-525b-47ac-8ade-a23a0e2a3a98 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:49.986118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1760fd-525b-47ac-8ade-a23a0e2a3a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:49.986401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1760fd-525b-47ac-8ade-a23a0e2a3a98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:50.052111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f48e4-209b-4638-b292-ef071f1f3bbf None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:50.072279 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1760fd-525b-47ac-8ade-a23a0e2a3a98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:50.074294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1760fd-525b-47ac-8ade-a23a0e2a3a98 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:50.080732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:50.091682 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bbe1e-6b96-4196-881a-d875b86bfc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:50.092353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bbe1e-6b96-4196-881a-d875b86bfc34 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:50.092630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bbe1e-6b96-4196-881a-d875b86bfc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:50.092901 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bbe1e-6b96-4196-881a-d875b86bfc34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:50.102833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45bbe1e-6b96-4196-881a-d875b86bfc34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c45bbe1e-6b96-4196-881a-d875b86bfc34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:49:50.108314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:50.109178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:50.110089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:50.110089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:50.110089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:50.110089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:50.110089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:49:50.110089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:49:50.110089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:49:50.110089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:49:50.110089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:49:50.110089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:49:50.110089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:49:50.110089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:49:50.110089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 42/78] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:49:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:49:50.110858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bbe1e-6b96-4196-881a-d875b86bfc34 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:50.156476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:50.196966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 37/79] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:49:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:49:50.197826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1760fd-525b-47ac-8ade-a23a0e2a3a98 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:50.240943 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bbe1e-6b96-4196-881a-d875b86bfc34 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:50.280764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0440b-f62c-4e6b-a286-c33de1a6cf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:50.281366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0440b-f62c-4e6b-a286-c33de1a6cf10 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:50.281653 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0440b-f62c-4e6b-a286-c33de1a6cf10 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:50.281923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0440b-f62c-4e6b-a286-c33de1a6cf10 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:50.282583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0440b-f62c-4e6b-a286-c33de1a6cf10 None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:50.282888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0440b-f62c-4e6b-a286-c33de1a6cf10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:50.284299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0440b-f62c-4e6b-a286-c33de1a6cf10 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:50.292825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 43/80] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:49:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:50.293673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0440b-f62c-4e6b-a286-c33de1a6cf10 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:50.314760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1760fd-525b-47ac-8ade-a23a0e2a3a98 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:50.352712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112ce5f-b64a-4b5d-a4e9-d84f45175d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:50.353275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112ce5f-b64a-4b5d-a4e9-d84f45175d66 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:50.353554 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112ce5f-b64a-4b5d-a4e9-d84f45175d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:50.353826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112ce5f-b64a-4b5d-a4e9-d84f45175d66 None admin] PATH_INFO: `/v3/users/0923d37e739345a694121096914c323e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:50.355132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112ce5f-b64a-4b5d-a4e9-d84f45175d66 None admin] RBAC: Authorizing `identity:get_user(user_id=0923d37e739345a694121096914c323e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:50.356713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112ce5f-b64a-4b5d-a4e9-d84f45175d66 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:50.358027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:50.358286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 38/81] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:49:50 2022] GET /identity/v3/users/0923d37e739345a694121096914c323e => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:50.359459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112ce5f-b64a-4b5d-a4e9-d84f45175d66 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:50.401789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:50.419507 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0440b-f62c-4e6b-a286-c33de1a6cf10 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:50.464500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80870e5a-af68-4049-b32d-f807accf9f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:50.465136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870e5a-af68-4049-b32d-f807accf9f4c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:50.465419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870e5a-af68-4049-b32d-f807accf9f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:50.465696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870e5a-af68-4049-b32d-f807accf9f4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:50.466818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80870e5a-af68-4049-b32d-f807accf9f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:50.469356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80870e5a-af68-4049-b32d-f807accf9f4c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:50.471484 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 44/82] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:49:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:50.472676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80870e5a-af68-4049-b32d-f807accf9f4c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:50.486528 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112ce5f-b64a-4b5d-a4e9-d84f45175d66 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:50.534191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cdc83-4f22-4c05-931d-b0f6b625efed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:50.534877 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cdc83-4f22-4c05-931d-b0f6b625efed None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:50.535191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cdc83-4f22-4c05-931d-b0f6b625efed None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:50.535470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cdc83-4f22-4c05-931d-b0f6b625efed None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:50.536269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cdc83-4f22-4c05-931d-b0f6b625efed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:50.536668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cdc83-4f22-4c05-931d-b0f6b625efed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:50.538618 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cdc83-4f22-4c05-931d-b0f6b625efed None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:50.549880 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 39/83] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:49:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:50.550485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cdc83-4f22-4c05-931d-b0f6b625efed None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:50.599553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80870e5a-af68-4049-b32d-f807accf9f4c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:50.614694 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:50.638187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83b915-9fba-42b0-a6d3-89564379ea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:50.638920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b915-9fba-42b0-a6d3-89564379ea0d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:50.639245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b915-9fba-42b0-a6d3-89564379ea0d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:50.639514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b915-9fba-42b0-a6d3-89564379ea0d None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:50.640767 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83b915-9fba-42b0-a6d3-89564379ea0d None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:50.642236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83b915-9fba-42b0-a6d3-89564379ea0d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:50.643908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 45/84] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:49:50 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:50.646308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83b915-9fba-42b0-a6d3-89564379ea0d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:50.660189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:50.665086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cdc83-4f22-4c05-931d-b0f6b625efed None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:50.700981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d628e95-4159-44ef-aaa1-f0de56a320f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:50.701629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d628e95-4159-44ef-aaa1-f0de56a320f5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:50.701925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d628e95-4159-44ef-aaa1-f0de56a320f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:50.702221 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d628e95-4159-44ef-aaa1-f0de56a320f5 None admin] PATH_INFO: `/v3/users/6e48447e02b346eea64eb71c1e6414e1` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:50.703639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d628e95-4159-44ef-aaa1-f0de56a320f5 None admin] RBAC: Authorizing `identity:get_user(user_id=6e48447e02b346eea64eb71c1e6414e1)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:50.705353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d628e95-4159-44ef-aaa1-f0de56a320f5 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:50.707108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 40/85] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:49:50 2022] GET /identity/v3/users/6e48447e02b346eea64eb71c1e6414e1 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:50.707961 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d628e95-4159-44ef-aaa1-f0de56a320f5 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:50.761506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83b915-9fba-42b0-a6d3-89564379ea0d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:50.803157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f9924-75e9-4af2-b6a1-ecbdf0a91a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:50.803807 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9924-75e9-4af2-b6a1-ecbdf0a91a7d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:50.804528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9924-75e9-4af2-b6a1-ecbdf0a91a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:50.804812 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9924-75e9-4af2-b6a1-ecbdf0a91a7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:50.833232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d628e95-4159-44ef-aaa1-f0de56a320f5 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:50.864347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:50.871218 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544c086-1c02-4167-b503-dee9c8a6facf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:50.871807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544c086-1c02-4167-b503-dee9c8a6facf None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:50.872098 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544c086-1c02-4167-b503-dee9c8a6facf None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:50.872377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544c086-1c02-4167-b503-dee9c8a6facf None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:50.873037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544c086-1c02-4167-b503-dee9c8a6facf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:50.874490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544c086-1c02-4167-b503-dee9c8a6facf None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:50.887952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f9924-75e9-4af2-b6a1-ecbdf0a91a7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:50.889738 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f9924-75e9-4af2-b6a1-ecbdf0a91a7d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:50.904498 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 41/86] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:49:50 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:49:50.906456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544c086-1c02-4167-b503-dee9c8a6facf None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:50.945578 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:51.030015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 46/87] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:49:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:49:51.031227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f9924-75e9-4af2-b6a1-ecbdf0a91a7d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:51.044971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544c086-1c02-4167-b503-dee9c8a6facf None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:51.099866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44c2eb-d18f-461f-9f76-7804186f14e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:51.100524 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44c2eb-d18f-461f-9f76-7804186f14e0 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:51.100815 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44c2eb-d18f-461f-9f76-7804186f14e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:51.101098 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44c2eb-d18f-461f-9f76-7804186f14e0 None admin] PATH_INFO: `/v3/users/6e48447e02b346eea64eb71c1e6414e1` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:51.102308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44c2eb-d18f-461f-9f76-7804186f14e0 None admin] RBAC: Authorizing `identity:get_user(user_id=6e48447e02b346eea64eb71c1e6414e1)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:51.103813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44c2eb-d18f-461f-9f76-7804186f14e0 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:51.105430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 42/88] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:49:50 2022] GET /identity/v3/users/6e48447e02b346eea64eb71c1e6414e1 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:51.106270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44c2eb-d18f-461f-9f76-7804186f14e0 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:51.154296 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:51.188560 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f9924-75e9-4af2-b6a1-ecbdf0a91a7d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:51.241593 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edda59-11b6-452c-820b-c0d3fee6eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:51.242243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edda59-11b6-452c-820b-c0d3fee6eced None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:51.242533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edda59-11b6-452c-820b-c0d3fee6eced None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:51.242814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edda59-11b6-452c-820b-c0d3fee6eced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:51.243556 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edda59-11b6-452c-820b-c0d3fee6eced None admin] RBAC: Adding query filter params (role.id=9d10ee7e27e242ba801222cf0264ea8d, scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6, user.id=6e48447e02b346eea64eb71c1e6414e1) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:51.243915 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edda59-11b6-452c-820b-c0d3fee6eced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:51.245393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edda59-11b6-452c-820b-c0d3fee6eced None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:51.252268 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 47/89] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:49:51 2022] GET /identity/v3/role_assignments?user.id=6e48447e02b346eea64eb71c1e6414e1&scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6&role.id=9d10ee7e27e242ba801222cf0264ea8d => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:51.252967 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:51.253180 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edda59-11b6-452c-820b-c0d3fee6eced None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:51.260586 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44c2eb-d18f-461f-9f76-7804186f14e0 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:51.324034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fcd4a-82f2-4ef2-8a7d-325c95c34971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:51.325126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fcd4a-82f2-4ef2-8a7d-325c95c34971 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:51.325666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fcd4a-82f2-4ef2-8a7d-325c95c34971 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:51.327397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fcd4a-82f2-4ef2-8a7d-325c95c34971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:51.420852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edda59-11b6-452c-820b-c0d3fee6eced None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:51.477101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7c81-3f3b-4f7a-a129-46c5523ca322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:51.477759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7c81-3f3b-4f7a-a129-46c5523ca322 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:51.479220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7c81-3f3b-4f7a-a129-46c5523ca322 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:51.479508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7c81-3f3b-4f7a-a129-46c5523ca322 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:51.480874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef7c81-3f3b-4f7a-a129-46c5523ca322 None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:51.482410 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef7c81-3f3b-4f7a-a129-46c5523ca322 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:51.486075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 48/90] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:49:51 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:51.487963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7c81-3f3b-4f7a-a129-46c5523ca322 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:51.512115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fcd4a-82f2-4ef2-8a7d-325c95c34971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:51.513783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fcd4a-82f2-4ef2-8a7d-325c95c34971 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:51.519497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:51.661804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7c81-3f3b-4f7a-a129-46c5523ca322 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:51.768477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:51.780793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 43/91] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:49:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:49:51.782030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fcd4a-82f2-4ef2-8a7d-325c95c34971 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:51.782399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e8410-5860-446b-8312-cf2a52d11c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:51.783197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e8410-5860-446b-8312-cf2a52d11c83 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:51.783622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e8410-5860-446b-8312-cf2a52d11c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:51.784056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e8410-5860-446b-8312-cf2a52d11c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:51.908325 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fcd4a-82f2-4ef2-8a7d-325c95c34971 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:51.959775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11041e-04d7-4f6c-a578-c051b64b56fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:51.959775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11041e-04d7-4f6c-a578-c051b64b56fb None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:51.959775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11041e-04d7-4f6c-a578-c051b64b56fb None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:51.959775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11041e-04d7-4f6c-a578-c051b64b56fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:51.960466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11041e-04d7-4f6c-a578-c051b64b56fb None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6, user.id=0923d37e739345a694121096914c323e) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:51.960466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11041e-04d7-4f6c-a578-c051b64b56fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:51.960466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11041e-04d7-4f6c-a578-c051b64b56fb None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:51.967766 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 44/92] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:49:51 2022] GET /identity/v3/role_assignments?user.id=0923d37e739345a694121096914c323e&scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:51.968514 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11041e-04d7-4f6c-a578-c051b64b56fb None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:51.969773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e8410-5860-446b-8312-cf2a52d11c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:51.972433 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e8410-5860-446b-8312-cf2a52d11c83 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:52.020887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:52.051051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:52.120031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11041e-04d7-4f6c-a578-c051b64b56fb None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:52.167095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc36a1-a66d-458e-8dc5-2d3730cb19b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:52.168219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc36a1-a66d-458e-8dc5-2d3730cb19b5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:52.168659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc36a1-a66d-458e-8dc5-2d3730cb19b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:52.169033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc36a1-a66d-458e-8dc5-2d3730cb19b5 None admin] PATH_INFO: `/v3/projects/4e6e0e6aefcf412fae7f705c0c9d082e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:52.173891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc36a1-a66d-458e-8dc5-2d3730cb19b5 None admin] RBAC: Authorizing `identity:get_project(project_id=4e6e0e6aefcf412fae7f705c0c9d082e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:52.173891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc36a1-a66d-458e-8dc5-2d3730cb19b5 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:52.174145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 45/93] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:49:51 2022] GET /identity/v3/projects/4e6e0e6aefcf412fae7f705c0c9d082e => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:52.182807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc36a1-a66d-458e-8dc5-2d3730cb19b5 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:52.236128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 49/94] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:49:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:49:52.241867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e8410-5860-446b-8312-cf2a52d11c83 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:52.331429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc36a1-a66d-458e-8dc5-2d3730cb19b5 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:52.356791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:52.373092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05916f5e-1c7f-42b4-a76c-dd98229b41c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:52.373829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05916f5e-1c7f-42b4-a76c-dd98229b41c7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:52.374220 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05916f5e-1c7f-42b4-a76c-dd98229b41c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:52.374505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05916f5e-1c7f-42b4-a76c-dd98229b41c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:52.375710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05916f5e-1c7f-42b4-a76c-dd98229b41c7 None admin] RBAC: Adding query filter params (role.id=9d10ee7e27e242ba801222cf0264ea8d, scope.project.id=4e6e0e6aefcf412fae7f705c0c9d082e, user.id=6e48447e02b346eea64eb71c1e6414e1) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:52.376246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05916f5e-1c7f-42b4-a76c-dd98229b41c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:52.378473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05916f5e-1c7f-42b4-a76c-dd98229b41c7 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:52.390083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 46/95] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:49:52 2022] GET /identity/v3/role_assignments?user.id=6e48447e02b346eea64eb71c1e6414e1&scope.project.id=4e6e0e6aefcf412fae7f705c0c9d082e&role.id=9d10ee7e27e242ba801222cf0264ea8d => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:49:52.457100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e8410-5860-446b-8312-cf2a52d11c83 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:52.474670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:52.511745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96e6cf-03a7-4a9a-bc3a-db3a5028aa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:52.512432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96e6cf-03a7-4a9a-bc3a-db3a5028aa41 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:52.512724 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96e6cf-03a7-4a9a-bc3a-db3a5028aa41 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:52.513010 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96e6cf-03a7-4a9a-bc3a-db3a5028aa41 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:52.514839 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96e6cf-03a7-4a9a-bc3a-db3a5028aa41 None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:52.516712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96e6cf-03a7-4a9a-bc3a-db3a5028aa41 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:52.519716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 50/96] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:49:52 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:49:52.527616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05916f5e-1c7f-42b4-a76c-dd98229b41c7 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:52.671533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05916f5e-1c7f-42b4-a76c-dd98229b41c7 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:52.716409 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea8c99-235e-48b7-8e20-825cf22dd508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:52.718105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea8c99-235e-48b7-8e20-825cf22dd508 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:52.718601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea8c99-235e-48b7-8e20-825cf22dd508 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:52.719246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea8c99-235e-48b7-8e20-825cf22dd508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:52.720314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea8c99-235e-48b7-8e20-825cf22dd508 None admin] RBAC: Adding query filter params (role.id=a5a6c597145c4b23983d1b04377af7ed, scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6, user.id=6e48447e02b346eea64eb71c1e6414e1) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:52.720839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea8c99-235e-48b7-8e20-825cf22dd508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:52.722849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea8c99-235e-48b7-8e20-825cf22dd508 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:52.732708 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 47/97] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:49:52 2022] GET /identity/v3/role_assignments?user.id=6e48447e02b346eea64eb71c1e6414e1&scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6&role.id=a5a6c597145c4b23983d1b04377af7ed => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:54.082793 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c41dc-8239-490b-a8a0-503c7cf28271 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:54.083286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c41dc-8239-490b-a8a0-503c7cf28271 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:54.083357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c41dc-8239-490b-a8a0-503c7cf28271 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:54.084852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 51/98] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:54.098299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864fd47-2a9e-4bef-bedf-52141df17ebc None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:54.099245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864fd47-2a9e-4bef-bedf-52141df17ebc None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:54.099775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864fd47-2a9e-4bef-bedf-52141df17ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:54.140805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b864fd47-2a9e-4bef-bedf-52141df17ebc None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:54.142774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b864fd47-2a9e-4bef-bedf-52141df17ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:54.200505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:54.231260 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 48/99] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:49:54.256604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c41dc-8239-490b-a8a0-503c7cf28271 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:54.298558 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f4d32-744d-4ced-832d-e9047d749f35 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:54.298990 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f4d32-744d-4ced-832d-e9047d749f35 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:54.299443 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f4d32-744d-4ced-832d-e9047d749f35 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:54.302227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 49/100] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:54.308832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc16002-43c6-460c-9130-8253a116d89f None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:54.309273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc16002-43c6-460c-9130-8253a116d89f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:54.309716 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc16002-43c6-460c-9130-8253a116d89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:54.348298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-ccc16002-43c6-460c-9130-8253a116d89f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:54.349506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ccc16002-43c6-460c-9130-8253a116d89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:54.494223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c41dc-8239-490b-a8a0-503c7cf28271 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:54.537728 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 50/101] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:49:54.570287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b097b71-aa26-4ed2-8975-8dd85cb14307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:54.571296 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b097b71-aa26-4ed2-8975-8dd85cb14307 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:54.571852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b097b71-aa26-4ed2-8975-8dd85cb14307 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:54.572348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b097b71-aa26-4ed2-8975-8dd85cb14307 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:54.587795 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc16002-43c6-460c-9130-8253a116d89f None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:54.595764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b097b71-aa26-4ed2-8975-8dd85cb14307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-9b097b71-aa26-4ed2-8975-8dd85cb14307 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:49:54.597379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:54.598270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:54.599579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:54.599579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:54.599579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:54.599579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:54.599579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:49:54.599579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:49:54.599579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:49:54.599579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:49:54.599579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:49:54.599579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:49:54.599579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:49:54.599579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:49:54.599579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 52/102] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:49:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:49:54.607798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b097b71-aa26-4ed2-8975-8dd85cb14307 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:54.719776 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:54.810264 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc16002-43c6-460c-9130-8253a116d89f None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:54.830810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:54.894893 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a5886-f0af-4dc9-a666-c2da438967ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:54.895897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a5886-f0af-4dc9-a666-c2da438967ea None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:54.896192 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a5886-f0af-4dc9-a666-c2da438967ea None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:54.896582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a5886-f0af-4dc9-a666-c2da438967ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:54.897770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b097b71-aa26-4ed2-8975-8dd85cb14307 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:54.901185 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a5886-f0af-4dc9-a666-c2da438967ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:54.903338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a5886-f0af-4dc9-a666-c2da438967ea None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:54.906167 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 51/103] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:49:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:49:54.919760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a5886-f0af-4dc9-a666-c2da438967ea None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:54.959292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b9f49-8602-4ef2-9d6e-c5528c0702f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:54.959951 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b9f49-8602-4ef2-9d6e-c5528c0702f5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:54.960236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b9f49-8602-4ef2-9d6e-c5528c0702f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:54.960579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b9f49-8602-4ef2-9d6e-c5528c0702f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:54.961278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b9f49-8602-4ef2-9d6e-c5528c0702f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:54.961697 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b9f49-8602-4ef2-9d6e-c5528c0702f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:54.963126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b9f49-8602-4ef2-9d6e-c5528c0702f5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:54.986038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 53/104] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:49:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:54.987355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb25aba-21ed-4797-be3f-de9f7793183a None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:54.987902 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb25aba-21ed-4797-be3f-de9f7793183a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:54.988310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb25aba-21ed-4797-be3f-de9f7793183a None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:54.996044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 54/105] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:54.997661 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb25aba-21ed-4797-be3f-de9f7793183a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:55.101608 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a5886-f0af-4dc9-a666-c2da438967ea None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:55.146901 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6a84-e295-45f7-883b-38c8cf331fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:55.150447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6a84-e295-45f7-883b-38c8cf331fcd None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:55.150910 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6a84-e295-45f7-883b-38c8cf331fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:55.151441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6a84-e295-45f7-883b-38c8cf331fcd None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:55.153311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d6a84-e295-45f7-883b-38c8cf331fcd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:55.155664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d6a84-e295-45f7-883b-38c8cf331fcd None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:55.221502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 52/106] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:49:54 2022] POST /identity/v3/projects => generated 302 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:49:55.222699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783dd63-8fca-4dbd-81f0-56d47c7cf4be None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:55.222914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783dd63-8fca-4dbd-81f0-56d47c7cf4be None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:55.223200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783dd63-8fca-4dbd-81f0-56d47c7cf4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:55.246235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb25aba-21ed-4797-be3f-de9f7793183a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:55.249197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:55.250497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-f783dd63-8fca-4dbd-81f0-56d47c7cf4be None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:55.252497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f783dd63-8fca-4dbd-81f0-56d47c7cf4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:55.301597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:55.307710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06325e-7edf-4228-9737-ea4555abbf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:55.308763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06325e-7edf-4228-9737-ea4555abbf86 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:55.309177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06325e-7edf-4228-9737-ea4555abbf86 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:55.310548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06325e-7edf-4228-9737-ea4555abbf86 None admin] PATH_INFO: `/v3/users/6e48447e02b346eea64eb71c1e6414e1` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:55.312608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06325e-7edf-4228-9737-ea4555abbf86 None admin] RBAC: Authorizing `identity:get_user(user_id=6e48447e02b346eea64eb71c1e6414e1)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:55.314146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06325e-7edf-4228-9737-ea4555abbf86 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:55.319799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 55/107] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:49:54 2022] GET /identity/v3/users/6e48447e02b346eea64eb71c1e6414e1 => generated 275 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:55.319799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c5ee2-0d9c-4b53-ac51-65da6e9f54fe None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:55.319799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c5ee2-0d9c-4b53-ac51-65da6e9f54fe None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:55.319799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c5ee2-0d9c-4b53-ac51-65da6e9f54fe None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:55.321910 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 56/108] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:55.328830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c5ee2-0d9c-4b53-ac51-65da6e9f54fe None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:55.385276 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 53/109] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:55.386645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ad83-17db-40c3-9896-b655081d2599 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:55.386937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ad83-17db-40c3-9896-b655081d2599 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:55.387204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ad83-17db-40c3-9896-b655081d2599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:55.437597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d5d3ad83-17db-40c3-9896-b655081d2599 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:55.440836 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d5d3ad83-17db-40c3-9896-b655081d2599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:55.544260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c5ee2-0d9c-4b53-ac51-65da6e9f54fe None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:55.549816 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 54/110] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:55.553355 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3ad83-17db-40c3-9896-b655081d2599 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:55.598321 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976db5a-ca22-40df-9be9-c72fbe6aeb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:55.599145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976db5a-ca22-40df-9be9-c72fbe6aeb44 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:55.599715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976db5a-ca22-40df-9be9-c72fbe6aeb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:55.600040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976db5a-ca22-40df-9be9-c72fbe6aeb44 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:55.604644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976db5a-ca22-40df-9be9-c72fbe6aeb44 None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:55.606285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976db5a-ca22-40df-9be9-c72fbe6aeb44 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:55.608301 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 57/111] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:49:55 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:55.608900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976db5a-ca22-40df-9be9-c72fbe6aeb44 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:55.680506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:55.751837 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:55.777521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3ad83-17db-40c3-9896-b655081d2599 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:55.821896 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2954202-436e-414a-adc4-19913d4d7de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:55.822556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2954202-436e-414a-adc4-19913d4d7de6 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:55.822850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2954202-436e-414a-adc4-19913d4d7de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:55.823135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2954202-436e-414a-adc4-19913d4d7de6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:55.829361 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976db5a-ca22-40df-9be9-c72fbe6aeb44 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:55.841103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2954202-436e-414a-adc4-19913d4d7de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-f2954202-436e-414a-adc4-19913d4d7de6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:49:55.847598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:55.848491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:55.849239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:55.849239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:55.849239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:55.849239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:55.849239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:49:55.849239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:49:55.849239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:49:55.849239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:49:55.849239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:49:55.849239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:49:55.849239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:49:55.849239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:49:55.849854 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 55/112] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:49:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:49:55.851638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2954202-436e-414a-adc4-19913d4d7de6 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:55.891422 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690b2b0-fcfe-4744-a7d0-1dfa2446e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:55.892129 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690b2b0-fcfe-4744-a7d0-1dfa2446e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:55.892497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690b2b0-fcfe-4744-a7d0-1dfa2446e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:55.892805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690b2b0-fcfe-4744-a7d0-1dfa2446e2b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:55.916037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690b2b0-fcfe-4744-a7d0-1dfa2446e2b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-3690b2b0-fcfe-4744-a7d0-1dfa2446e2b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:49:55.924208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:55.925102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:55.925850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:55.925850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:55.925850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:55.925850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:55.925850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:49:55.925850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:49:55.925850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:49:55.925850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:49:55.925850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:49:55.925850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:49:55.925850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:49:55.925850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:49:55.926402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 58/113] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:49:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:49:55.932359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690b2b0-fcfe-4744-a7d0-1dfa2446e2b6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:56.005837 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2954202-436e-414a-adc4-19913d4d7de6 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:56.046477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67811898-fae2-4bea-8276-ab63e700a202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:56.047816 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67811898-fae2-4bea-8276-ab63e700a202 None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:56.048307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67811898-fae2-4bea-8276-ab63e700a202 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:56.048779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67811898-fae2-4bea-8276-ab63e700a202 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6/users/6e48447e02b346eea64eb71c1e6414e1/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:56.051756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67811898-fae2-4bea-8276-ab63e700a202 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9c0cc72f061412b9d0108f4fefb40a6, user_id=6e48447e02b346eea64eb71c1e6414e1, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:56.053902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67811898-fae2-4bea-8276-ab63e700a202 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:56.056664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:56.061597 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690b2b0-fcfe-4744-a7d0-1dfa2446e2b6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:56.084428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 56/114] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:49:55 2022] PUT /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6/users/6e48447e02b346eea64eb71c1e6414e1/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:49:56.084428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2581268-58eb-411e-ae4f-ed87ef4d521b None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:56.084428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2581268-58eb-411e-ae4f-ed87ef4d521b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:56.084428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2581268-58eb-411e-ae4f-ed87ef4d521b None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:56.090570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 57/115] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:56.091202 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2581268-58eb-411e-ae4f-ed87ef4d521b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:56.113705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:56.149616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9678a52-e88f-4022-808d-b387479eda3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:56.150310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678a52-e88f-4022-808d-b387479eda3d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:56.150599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678a52-e88f-4022-808d-b387479eda3d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:56.150942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678a52-e88f-4022-808d-b387479eda3d None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:56.151630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9678a52-e88f-4022-808d-b387479eda3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:56.151960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9678a52-e88f-4022-808d-b387479eda3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:56.153401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9678a52-e88f-4022-808d-b387479eda3d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:56.174344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 59/116] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:49:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:56.179826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d947e-a2b0-4045-9f4a-7978b56f54ef None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:56.183232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d947e-a2b0-4045-9f4a-7978b56f54ef None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:56.183546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d947e-a2b0-4045-9f4a-7978b56f54ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:56.227464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-718d947e-a2b0-4045-9f4a-7978b56f54ef None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:56.230681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-718d947e-a2b0-4045-9f4a-7978b56f54ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:56.321268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2581268-58eb-411e-ae4f-ed87ef4d521b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:56.346952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 60/117] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:56.351110 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d947e-a2b0-4045-9f4a-7978b56f54ef None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:56.373706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7636f1-d88f-447f-b594-6c67f34fa0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:56.374728 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7636f1-d88f-447f-b594-6c67f34fa0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:56.375203 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7636f1-d88f-447f-b594-6c67f34fa0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:56.375675 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7636f1-d88f-447f-b594-6c67f34fa0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:56.377007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7636f1-d88f-447f-b594-6c67f34fa0f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:56.377684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7636f1-d88f-447f-b594-6c67f34fa0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:56.380357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7636f1-d88f-447f-b594-6c67f34fa0f5 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:56.393724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 58/118] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:49:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:56.395022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e79c3f-6cdf-4144-b9ca-86db5ceff456 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:56.395316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e79c3f-6cdf-4144-b9ca-86db5ceff456 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:56.395642 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e79c3f-6cdf-4144-b9ca-86db5ceff456 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:56.399814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 59/119] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:56.399814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e79c3f-6cdf-4144-b9ca-86db5ceff456 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:56.481546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:56.497109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d947e-a2b0-4045-9f4a-7978b56f54ef None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:56.505829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:56.542351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc40305-cb71-4264-8795-94df397f3af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:56.543300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc40305-cb71-4264-8795-94df397f3af4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:56.543882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc40305-cb71-4264-8795-94df397f3af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:56.544388 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc40305-cb71-4264-8795-94df397f3af4 None admin] PATH_INFO: `/v3/users/bd21fa5bd78c4eab954e855b9a4a1663` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:56.556512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e79c3f-6cdf-4144-b9ca-86db5ceff456 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:56.564600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc40305-cb71-4264-8795-94df397f3af4 None admin] RBAC: Authorizing `identity:get_user(user_id=bd21fa5bd78c4eab954e855b9a4a1663)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:56.567577 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc40305-cb71-4264-8795-94df397f3af4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:56.570980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 61/120] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:49:56 2022] GET /identity/v3/users/bd21fa5bd78c4eab954e855b9a4a1663 => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:56.572772 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc40305-cb71-4264-8795-94df397f3af4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:56.599402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b0420-3d0e-4265-a11b-81a7fa37f8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:56.600065 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b0420-3d0e-4265-a11b-81a7fa37f8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:56.600356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b0420-3d0e-4265-a11b-81a7fa37f8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:56.600647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b0420-3d0e-4265-a11b-81a7fa37f8a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:56.615066 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b0420-3d0e-4265-a11b-81a7fa37f8a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-a30b0420-3d0e-4265-a11b-81a7fa37f8a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:49:56.620562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:56.621511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:56.622922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:56.622922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:56.622922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:56.622922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:56.622922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:49:56.622922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:49:56.622922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:49:56.622922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:49:56.622922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:49:56.622922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:49:56.622922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:49:56.622922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:49:56.622922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 60/121] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:49:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:49:56.623576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f196f7-0760-466f-ac3e-84fd7afa503d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:56.623576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f196f7-0760-466f-ac3e-84fd7afa503d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:56.623576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f196f7-0760-466f-ac3e-84fd7afa503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:56.650584 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-56f196f7-0760-466f-ac3e-84fd7afa503d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:56.651825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-56f196f7-0760-466f-ac3e-84fd7afa503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:56.731842 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc40305-cb71-4264-8795-94df397f3af4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:56.738585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 61/122] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:49:56.739840 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f196f7-0760-466f-ac3e-84fd7afa503d None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:56.784720 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caabfb-af37-4c78-abfb-475578f61cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:56.785611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caabfb-af37-4c78-abfb-475578f61cdd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:56.786111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caabfb-af37-4c78-abfb-475578f61cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:56.786664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caabfb-af37-4c78-abfb-475578f61cdd None admin] PATH_INFO: `/v3/users/0923d37e739345a694121096914c323e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:56.788086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46caabfb-af37-4c78-abfb-475578f61cdd None admin] RBAC: Authorizing `identity:get_user(user_id=0923d37e739345a694121096914c323e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:56.790832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46caabfb-af37-4c78-abfb-475578f61cdd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:56.793155 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 62/123] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:49:56 2022] GET /identity/v3/users/0923d37e739345a694121096914c323e => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:56.794310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caabfb-af37-4c78-abfb-475578f61cdd None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:56.816502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:56.825397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:56.881387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f196f7-0760-466f-ac3e-84fd7afa503d None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:56.934747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caabfb-af37-4c78-abfb-475578f61cdd None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:56.940919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f77253-5687-4864-88b6-213ce6f6b909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:56.941583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f77253-5687-4864-88b6-213ce6f6b909 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:56.941870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f77253-5687-4864-88b6-213ce6f6b909 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:56.942146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f77253-5687-4864-88b6-213ce6f6b909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:56.980844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496168d-60be-4c67-923f-f97f5c301f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:56.981990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496168d-60be-4c67-923f-f97f5c301f9e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:56.982766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496168d-60be-4c67-923f-f97f5c301f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:56.983580 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496168d-60be-4c67-923f-f97f5c301f9e None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:56.984494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496168d-60be-4c67-923f-f97f5c301f9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:56.984988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496168d-60be-4c67-923f-f97f5c301f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:56.986596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496168d-60be-4c67-923f-f97f5c301f9e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:57.003136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 63/124] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:49:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:57.003798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496168d-60be-4c67-923f-f97f5c301f9e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:57.045441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f77253-5687-4864-88b6-213ce6f6b909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:57.048059 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f77253-5687-4864-88b6-213ce6f6b909 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:57.108329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:57.121288 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:57.138141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496168d-60be-4c67-923f-f97f5c301f9e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:57.170079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 62/125] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:49:57.171268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f77253-5687-4864-88b6-213ce6f6b909 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:57.175761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e9c3e-56c6-4cbf-8d7b-f6d1947e0c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:57.175964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e9c3e-56c6-4cbf-8d7b-f6d1947e0c3e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:57.176156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e9c3e-56c6-4cbf-8d7b-f6d1947e0c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:57.176565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e9c3e-56c6-4cbf-8d7b-f6d1947e0c3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:57.191355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e9c3e-56c6-4cbf-8d7b-f6d1947e0c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-0f1e9c3e-56c6-4cbf-8d7b-f6d1947e0c3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:49:57.197370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:57.198320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:57.199193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:57.199193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:57.199193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:57.199193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:57.199193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:49:57.199193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:49:57.199193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:49:57.199193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:49:57.199193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:49:57.199193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:49:57.199193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:49:57.199193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:49:57.199193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 64/126] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:49:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:49:57.200667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e9c3e-56c6-4cbf-8d7b-f6d1947e0c3e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:57.294285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f77253-5687-4864-88b6-213ce6f6b909 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:57.329094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e9c3e-56c6-4cbf-8d7b-f6d1947e0c3e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:57.334088 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5fba9-e833-410c-b177-e1c57c7b6a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:57.334999 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5fba9-e833-410c-b177-e1c57c7b6a4c None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:57.336096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5fba9-e833-410c-b177-e1c57c7b6a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:57.336575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5fba9-e833-410c-b177-e1c57c7b6a4c None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:57.338094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5fba9-e833-410c-b177-e1c57c7b6a4c None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:57.339835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5fba9-e833-410c-b177-e1c57c7b6a4c None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:57.342399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 63/127] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:49:57 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:57.343468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5fba9-e833-410c-b177-e1c57c7b6a4c None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:57.372652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adac2fb-7e36-4f37-8046-5f75debf09ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:57.373722 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adac2fb-7e36-4f37-8046-5f75debf09ea None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:57.374067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adac2fb-7e36-4f37-8046-5f75debf09ea None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:57.374348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adac2fb-7e36-4f37-8046-5f75debf09ea None admin] PATH_INFO: `/v3/users/6e48447e02b346eea64eb71c1e6414e1` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:57.375683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adac2fb-7e36-4f37-8046-5f75debf09ea None admin] RBAC: Authorizing `identity:get_user(user_id=6e48447e02b346eea64eb71c1e6414e1)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:57.377378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adac2fb-7e36-4f37-8046-5f75debf09ea None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:57.379330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 65/128] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:49:57 2022] GET /identity/v3/users/6e48447e02b346eea64eb71c1e6414e1 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:57.380106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adac2fb-7e36-4f37-8046-5f75debf09ea None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:57.382754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:57.397020 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:57.522194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adac2fb-7e36-4f37-8046-5f75debf09ea None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:57.537995 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5fba9-e833-410c-b177-e1c57c7b6a4c None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:57.565176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5525c7-9358-4d10-9c7a-aee69ab055b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:57.565745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5525c7-9358-4d10-9c7a-aee69ab055b8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:57.566031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5525c7-9358-4d10-9c7a-aee69ab055b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:57.566306 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5525c7-9358-4d10-9c7a-aee69ab055b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:57.566993 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5525c7-9358-4d10-9c7a-aee69ab055b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:57.567297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5525c7-9358-4d10-9c7a-aee69ab055b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:57.568799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5525c7-9358-4d10-9c7a-aee69ab055b8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:57.578462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 66/129] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:49:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:57.579176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5525c7-9358-4d10-9c7a-aee69ab055b8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:57.609350 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb63e8-eb7c-46be-ab7a-90419c353db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:57.611011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb63e8-eb7c-46be-ab7a-90419c353db6 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:57.611934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb63e8-eb7c-46be-ab7a-90419c353db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:57.612783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb63e8-eb7c-46be-ab7a-90419c353db6 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:57.615511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb63e8-eb7c-46be-ab7a-90419c353db6 None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:57.619349 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb63e8-eb7c-46be-ab7a-90419c353db6 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:57.622880 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 64/130] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:49:57 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:57.624885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb63e8-eb7c-46be-ab7a-90419c353db6 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:57.656743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:57.699459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5525c7-9358-4d10-9c7a-aee69ab055b8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:57.738377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64286afd-d181-4fa2-bca4-3d89f37bffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:57.739189 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286afd-d181-4fa2-bca4-3d89f37bffab None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:57.739487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286afd-d181-4fa2-bca4-3d89f37bffab None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:57.739805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286afd-d181-4fa2-bca4-3d89f37bffab None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6/users/0923d37e739345a694121096914c323e/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:57.743250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64286afd-d181-4fa2-bca4-3d89f37bffab None admin] RBAC: Authorizing `identity:create_grant(project_id=c9c0cc72f061412b9d0108f4fefb40a6, user_id=0923d37e739345a694121096914c323e, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:57.744952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64286afd-d181-4fa2-bca4-3d89f37bffab None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:57.766587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 67/131] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:49:57 2022] PUT /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6/users/0923d37e739345a694121096914c323e/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:49:57.768084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64286afd-d181-4fa2-bca4-3d89f37bffab None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:57.835860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:57.842996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb63e8-eb7c-46be-ab7a-90419c353db6 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:57.887149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64175bfd-64cd-49b8-bf3d-b66c6bb6fc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:57.894095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64175bfd-64cd-49b8-bf3d-b66c6bb6fc25 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:57.894749 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64175bfd-64cd-49b8-bf3d-b66c6bb6fc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:57.895223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64175bfd-64cd-49b8-bf3d-b66c6bb6fc25 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:57.897203 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64175bfd-64cd-49b8-bf3d-b66c6bb6fc25 None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:57.898942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64175bfd-64cd-49b8-bf3d-b66c6bb6fc25 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:57.901360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 65/132] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:49:57 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:57.902425 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64175bfd-64cd-49b8-bf3d-b66c6bb6fc25 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:57.920044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64286afd-d181-4fa2-bca4-3d89f37bffab None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:57.953678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:57.966159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eef3c-c8a4-4716-9162-910983370ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:57.966897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eef3c-c8a4-4716-9162-910983370ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:57.967188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eef3c-c8a4-4716-9162-910983370ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:57.967463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eef3c-c8a4-4716-9162-910983370ad1 None admin] PATH_INFO: `/v3/users/6e48447e02b346eea64eb71c1e6414e1` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:57.968864 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680eef3c-c8a4-4716-9162-910983370ad1 None admin] RBAC: Authorizing `identity:get_user(user_id=6e48447e02b346eea64eb71c1e6414e1)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:57.970811 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680eef3c-c8a4-4716-9162-910983370ad1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:57.972622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 68/133] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:49:57 2022] GET /identity/v3/users/6e48447e02b346eea64eb71c1e6414e1 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:57.973586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eef3c-c8a4-4716-9162-910983370ad1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:58.040692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64175bfd-64cd-49b8-bf3d-b66c6bb6fc25 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:58.091668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f943165-c66c-40b5-9ac3-aafedc5801b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:58.092208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943165-c66c-40b5-9ac3-aafedc5801b3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:58.092502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943165-c66c-40b5-9ac3-aafedc5801b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:58.092789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943165-c66c-40b5-9ac3-aafedc5801b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:58.093541 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f943165-c66c-40b5-9ac3-aafedc5801b3 None admin] RBAC: Adding query filter params (role.id=199c92884fb24ba2ac1498b774df4a0b, scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6, user.id=bd21fa5bd78c4eab954e855b9a4a1663) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:58.093852 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f943165-c66c-40b5-9ac3-aafedc5801b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:58.095329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f943165-c66c-40b5-9ac3-aafedc5801b3 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:58.102393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 66/134] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:49:57 2022] GET /identity/v3/role_assignments?user.id=bd21fa5bd78c4eab954e855b9a4a1663&scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6&role.id=199c92884fb24ba2ac1498b774df4a0b => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:58.103018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f943165-c66c-40b5-9ac3-aafedc5801b3 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:58.123382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eef3c-c8a4-4716-9162-910983370ad1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:58.155567 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:58.184109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5de645-a2b4-4ebd-b6b0-c2c8c6c003c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:58.185386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5de645-a2b4-4ebd-b6b0-c2c8c6c003c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:58.185897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5de645-a2b4-4ebd-b6b0-c2c8c6c003c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:58.186435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5de645-a2b4-4ebd-b6b0-c2c8c6c003c0 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6/users/6e48447e02b346eea64eb71c1e6414e1/roles/a5a6c597145c4b23983d1b04377af7ed` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:58.190299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5de645-a2b4-4ebd-b6b0-c2c8c6c003c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9c0cc72f061412b9d0108f4fefb40a6, user_id=6e48447e02b346eea64eb71c1e6414e1, role_id=a5a6c597145c4b23983d1b04377af7ed)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:58.192882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5de645-a2b4-4ebd-b6b0-c2c8c6c003c0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:58.218960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 69/135] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:49:57 2022] PUT /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6/users/6e48447e02b346eea64eb71c1e6414e1/roles/a5a6c597145c4b23983d1b04377af7ed => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:49:58.225827 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321dc1-5611-4d24-8f1f-21090a3338b8 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:58.226842 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321dc1-5611-4d24-8f1f-21090a3338b8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:58.227195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321dc1-5611-4d24-8f1f-21090a3338b8 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:58.231821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 70/136] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:58.237468 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f36191-ec6a-4e4a-97f1-5c84039ccac0 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:58.237670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f36191-ec6a-4e4a-97f1-5c84039ccac0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:58.238071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f36191-ec6a-4e4a-97f1-5c84039ccac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:58.286267 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-16f36191-ec6a-4e4a-97f1-5c84039ccac0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:58.287662 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-16f36191-ec6a-4e4a-97f1-5c84039ccac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:58.295765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f943165-c66c-40b5-9ac3-aafedc5801b3 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:58.403586 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c1f5f-f46e-41e1-a1e3-1d40d68a9e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:58.405512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1f5f-f46e-41e1-a1e3-1d40d68a9e6e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:58.405957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1f5f-f46e-41e1-a1e3-1d40d68a9e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:58.406424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1f5f-f46e-41e1-a1e3-1d40d68a9e6e None admin] PATH_INFO: `/v3/projects/4e6e0e6aefcf412fae7f705c0c9d082e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:58.413134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c1f5f-f46e-41e1-a1e3-1d40d68a9e6e None admin] RBAC: Authorizing `identity:get_project(project_id=4e6e0e6aefcf412fae7f705c0c9d082e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:58.416103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c1f5f-f46e-41e1-a1e3-1d40d68a9e6e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:58.422464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 67/137] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:49:58 2022] GET /identity/v3/projects/4e6e0e6aefcf412fae7f705c0c9d082e => generated 312 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:58.428173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:58.429157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c1f5f-f46e-41e1-a1e3-1d40d68a9e6e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:58.467785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 71/138] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:49:58.504313 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f36191-ec6a-4e4a-97f1-5c84039ccac0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:58.621056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:58.629111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c1f5f-f46e-41e1-a1e3-1d40d68a9e6e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:58.696193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f36191-ec6a-4e4a-97f1-5c84039ccac0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:58.708164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47d5ea-d2af-4c88-b116-ac0afa6e3f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:58.708865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47d5ea-d2af-4c88-b116-ac0afa6e3f6e None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:58.709150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47d5ea-d2af-4c88-b116-ac0afa6e3f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:58.709433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47d5ea-d2af-4c88-b116-ac0afa6e3f6e None admin] PATH_INFO: `/v3/projects/4e6e0e6aefcf412fae7f705c0c9d082e/users/6e48447e02b346eea64eb71c1e6414e1/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:58.712421 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47d5ea-d2af-4c88-b116-ac0afa6e3f6e None admin] RBAC: Authorizing `identity:create_grant(project_id=4e6e0e6aefcf412fae7f705c0c9d082e, user_id=6e48447e02b346eea64eb71c1e6414e1, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:58.714150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47d5ea-d2af-4c88-b116-ac0afa6e3f6e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:58.747755 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 68/139] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:49:58 2022] PUT /identity/v3/projects/4e6e0e6aefcf412fae7f705c0c9d082e/users/6e48447e02b346eea64eb71c1e6414e1/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:49:58.786505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fd050-5925-4d1b-95b0-529682103717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:58.787271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fd050-5925-4d1b-95b0-529682103717 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:58.787582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fd050-5925-4d1b-95b0-529682103717 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:58.787914 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fd050-5925-4d1b-95b0-529682103717 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:58.789505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fd050-5925-4d1b-95b0-529682103717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:58.791226 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fd050-5925-4d1b-95b0-529682103717 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:58.793164 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 72/140] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:49:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:58.798952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47d5ea-d2af-4c88-b116-ac0afa6e3f6e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:58.984222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47d5ea-d2af-4c88-b116-ac0afa6e3f6e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:59.028840 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581d927-0d1b-4bc0-a15c-2e15d2a93892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:59.029848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581d927-0d1b-4bc0-a15c-2e15d2a93892 None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:59.030341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581d927-0d1b-4bc0-a15c-2e15d2a93892 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:59.030829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581d927-0d1b-4bc0-a15c-2e15d2a93892 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:59.031700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581d927-0d1b-4bc0-a15c-2e15d2a93892 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:59.033399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581d927-0d1b-4bc0-a15c-2e15d2a93892 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:59.062922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 69/141] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:49:58 2022] POST /identity/v3/users => generated 283 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:49:59.133669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681fbd-ed7f-4e05-9451-3d429696aae7 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:59.133962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681fbd-ed7f-4e05-9451-3d429696aae7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:59.134288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681fbd-ed7f-4e05-9451-3d429696aae7 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:59.135900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 73/142] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:49:59.142112 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e4f79-f44b-4e65-b105-9b63f1e91554 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:59.142953 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e4f79-f44b-4e65-b105-9b63f1e91554 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:59.143502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e4f79-f44b-4e65-b105-9b63f1e91554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:59.187427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-dc9e4f79-f44b-4e65-b105-9b63f1e91554 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:49:59.189626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-dc9e4f79-f44b-4e65-b105-9b63f1e91554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:49:59.202381 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:59.282678 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 70/143] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 10 07:49:59.318330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf681fbd-ed7f-4e05-9451-3d429696aae7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:59.415351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:59.474082 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf681fbd-ed7f-4e05-9451-3d429696aae7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:59.525817 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f5953-e96a-497b-991b-e16d8d83a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:59.527331 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f5953-e96a-497b-991b-e16d8d83a968 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:59.527877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f5953-e96a-497b-991b-e16d8d83a968 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:59.528494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f5953-e96a-497b-991b-e16d8d83a968 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:59.542506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f5953-e96a-497b-991b-e16d8d83a968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-cf8f5953-e96a-497b-991b-e16d8d83a968 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:49:59.550616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:49:59.551606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:49:59.552426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:49:59.552426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:49:59.552426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:49:59.552426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:49:59.552426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:49:59.552426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:49:59.552426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:49:59.552426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:49:59.552426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:49:59.552426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:49:59.552426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:49:59.552426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:49:59.555744 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 74/144] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:49:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:49:59.563086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e4f79-f44b-4e65-b105-9b63f1e91554 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:59.691969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e4f79-f44b-4e65-b105-9b63f1e91554 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:59.740638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33131b-a58e-46e8-8625-9e752b85932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:59.742649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33131b-a58e-46e8-8625-9e752b85932d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:59.743148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33131b-a58e-46e8-8625-9e752b85932d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:59.743722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33131b-a58e-46e8-8625-9e752b85932d None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:59.744649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33131b-a58e-46e8-8625-9e752b85932d None admin] RBAC: Adding query filter params (name=member) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:49:59.745158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33131b-a58e-46e8-8625-9e752b85932d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:59.746746 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33131b-a58e-46e8-8625-9e752b85932d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:59.756356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 71/145] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:49:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:59.763819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f5953-e96a-497b-991b-e16d8d83a968 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:59.896599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f5953-e96a-497b-991b-e16d8d83a968 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:49:59.915198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:49:59.948785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884368a-5608-439e-9049-90e2346fec2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:49:59.949847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884368a-5608-439e-9049-90e2346fec2c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:49:59.950286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884368a-5608-439e-9049-90e2346fec2c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:49:59.950747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884368a-5608-439e-9049-90e2346fec2c None admin] PATH_INFO: `/v3/users/6e48447e02b346eea64eb71c1e6414e1` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:49:59.952470 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884368a-5608-439e-9049-90e2346fec2c None admin] RBAC: Authorizing `identity:get_user(user_id=6e48447e02b346eea64eb71c1e6414e1)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:49:59.954043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884368a-5608-439e-9049-90e2346fec2c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:49:59.956322 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 75/146] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:49:59 2022] GET /identity/v3/users/6e48447e02b346eea64eb71c1e6414e1 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:49:59.962446 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33131b-a58e-46e8-8625-9e752b85932d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:49:59.980224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:00.136737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33131b-a58e-46e8-8625-9e752b85932d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:00.183718 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933fcac-db63-4fb7-a819-7f2bd8a1e9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:00.184750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933fcac-db63-4fb7-a819-7f2bd8a1e9fd None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:00.185319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933fcac-db63-4fb7-a819-7f2bd8a1e9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:00.185791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933fcac-db63-4fb7-a819-7f2bd8a1e9fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:00.276091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933fcac-db63-4fb7-a819-7f2bd8a1e9fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:00.278682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933fcac-db63-4fb7-a819-7f2bd8a1e9fd None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:00.293096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:00.434473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 72/147] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:49:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 07:50:00.440328 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884368a-5608-439e-9049-90e2346fec2c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:00.556709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ced8-2b8b-4926-b7ba-66e3c1e36874 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:00.557058 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ced8-2b8b-4926-b7ba-66e3c1e36874 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:00.557270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ced8-2b8b-4926-b7ba-66e3c1e36874 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:00.559160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 73/148] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:00.566787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d67516-5274-4b27-81da-7ba25580d4f0 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:00.567091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d67516-5274-4b27-81da-7ba25580d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:00.567341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d67516-5274-4b27-81da-7ba25580d4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:00.592776 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884368a-5608-439e-9049-90e2346fec2c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:00.603784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-f4d67516-5274-4b27-81da-7ba25580d4f0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:00.605268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f4d67516-5274-4b27-81da-7ba25580d4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:00.642180 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62001db4-d220-44cf-8ae4-6703786ae762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:00.643241 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62001db4-d220-44cf-8ae4-6703786ae762 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:00.643772 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62001db4-d220-44cf-8ae4-6703786ae762 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:00.645039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62001db4-d220-44cf-8ae4-6703786ae762 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:00.646641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62001db4-d220-44cf-8ae4-6703786ae762 None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:00.648687 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62001db4-d220-44cf-8ae4-6703786ae762 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:00.651142 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 76/149] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:00 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:00.663175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62001db4-d220-44cf-8ae4-6703786ae762 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:00.762023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 74/150] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:00.780212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:00.793810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d67516-5274-4b27-81da-7ba25580d4f0 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:00.879761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62001db4-d220-44cf-8ae4-6703786ae762 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:00.880116 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:00.964112 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2420a-b3a8-463b-9615-3ac646fbc1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:00.964754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2420a-b3a8-463b-9615-3ac646fbc1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:00.965045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2420a-b3a8-463b-9615-3ac646fbc1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:00.965331 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2420a-b3a8-463b-9615-3ac646fbc1a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:00.966082 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2420a-b3a8-463b-9615-3ac646fbc1a3 None admin] RBAC: Adding query filter params (role.id=9d10ee7e27e242ba801222cf0264ea8d, scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6, user.id=6e48447e02b346eea64eb71c1e6414e1) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:00.966395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2420a-b3a8-463b-9615-3ac646fbc1a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:00.967911 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2420a-b3a8-463b-9615-3ac646fbc1a3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:00.987562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 77/151] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:00 2022] GET /identity/v3/role_assignments?user.id=6e48447e02b346eea64eb71c1e6414e1&scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6&role.id=9d10ee7e27e242ba801222cf0264ea8d => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:01.024154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d67516-5274-4b27-81da-7ba25580d4f0 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:01.105630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5a4ff-6b02-4c0a-a166-6512b0ad232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:01.106474 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a4ff-6b02-4c0a-a166-6512b0ad232c None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:01.106894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a4ff-6b02-4c0a-a166-6512b0ad232c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:01.107187 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a4ff-6b02-4c0a-a166-6512b0ad232c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:01.124994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5a4ff-6b02-4c0a-a166-6512b0ad232c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-11c5a4ff-6b02-4c0a-a166-6512b0ad232c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:01.130733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:01.131609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:01.132545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:01.132545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:01.132545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:01.132545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:01.132545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:01.132545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:01.132545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:01.132545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:01.132545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:01.132545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:01.132545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:01.132545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:01.132545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 75/152] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:50:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:01.141545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2420a-b3a8-463b-9615-3ac646fbc1a3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:01.281423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2420a-b3a8-463b-9615-3ac646fbc1a3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:01.300459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:01.331762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eed39-b9a1-479f-93c1-1a511ce73046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:01.332407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eed39-b9a1-479f-93c1-1a511ce73046 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:01.332693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eed39-b9a1-479f-93c1-1a511ce73046 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:01.333122 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eed39-b9a1-479f-93c1-1a511ce73046 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:01.334033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eed39-b9a1-479f-93c1-1a511ce73046 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:01.334440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eed39-b9a1-479f-93c1-1a511ce73046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:01.337199 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eed39-b9a1-479f-93c1-1a511ce73046 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:01.352031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 78/153] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:01.358305 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5a4ff-6b02-4c0a-a166-6512b0ad232c None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:01.503385 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:01.512037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5a4ff-6b02-4c0a-a166-6512b0ad232c None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:01.555144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e415b1-a89d-4aae-aeba-aef4b85d32c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:01.556065 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e415b1-a89d-4aae-aeba-aef4b85d32c7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:01.556357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e415b1-a89d-4aae-aeba-aef4b85d32c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:01.556747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e415b1-a89d-4aae-aeba-aef4b85d32c7 None admin] PATH_INFO: `/v3/users/0923d37e739345a694121096914c323e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:01.558222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e415b1-a89d-4aae-aeba-aef4b85d32c7 None admin] RBAC: Authorizing `identity:get_user(user_id=0923d37e739345a694121096914c323e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:01.559759 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e415b1-a89d-4aae-aeba-aef4b85d32c7 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:01.562189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 76/154] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:01 2022] GET /identity/v3/users/0923d37e739345a694121096914c323e => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:01.569447 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eed39-b9a1-479f-93c1-1a511ce73046 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:01.759923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eed39-b9a1-479f-93c1-1a511ce73046 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:01.824022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b652df3-ec26-41bb-9fc7-99aff8ffcdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:01.824985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b652df3-ec26-41bb-9fc7-99aff8ffcdab None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:01.825485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b652df3-ec26-41bb-9fc7-99aff8ffcdab None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:01.825959 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b652df3-ec26-41bb-9fc7-99aff8ffcdab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:01.896671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:01.924983 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b652df3-ec26-41bb-9fc7-99aff8ffcdab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:01.926500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b652df3-ec26-41bb-9fc7-99aff8ffcdab None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:02.071381 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 79/155] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:02.080049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e415b1-a89d-4aae-aeba-aef4b85d32c7 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:02.279265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e415b1-a89d-4aae-aeba-aef4b85d32c7 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:02.335333 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd665ca-8f45-4a28-88bd-91850481edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:02.336884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd665ca-8f45-4a28-88bd-91850481edeb None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:02.337381 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd665ca-8f45-4a28-88bd-91850481edeb None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:02.337853 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd665ca-8f45-4a28-88bd-91850481edeb None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:02.344723 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd665ca-8f45-4a28-88bd-91850481edeb None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:02.346567 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd665ca-8f45-4a28-88bd-91850481edeb None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:02.348609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 77/156] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:02 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:02.354987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b652df3-ec26-41bb-9fc7-99aff8ffcdab None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:02.468907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:02.496496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b652df3-ec26-41bb-9fc7-99aff8ffcdab None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:02.519678 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3e0c1-8826-497c-a4e1-2df0eff1370a None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:02.520751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3e0c1-8826-497c-a4e1-2df0eff1370a None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:02.521249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3e0c1-8826-497c-a4e1-2df0eff1370a None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:02.523261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 78/157] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:02.528772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb727c3-bb51-428d-93a8-9d2a2fad5aae None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:02.536229 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb727c3-bb51-428d-93a8-9d2a2fad5aae None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:02.536503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb727c3-bb51-428d-93a8-9d2a2fad5aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:02.542792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7b1c3-e647-44f8-b256-8b12e95cb88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:02.543422 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7b1c3-e647-44f8-b256-8b12e95cb88d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:02.543704 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7b1c3-e647-44f8-b256-8b12e95cb88d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:02.544004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7b1c3-e647-44f8-b256-8b12e95cb88d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:02.544740 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7b1c3-e647-44f8-b256-8b12e95cb88d None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6, user.id=0923d37e739345a694121096914c323e) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:02.545232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7b1c3-e647-44f8-b256-8b12e95cb88d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:02.546851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7b1c3-e647-44f8-b256-8b12e95cb88d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:02.558006 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 80/158] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:02 2022] GET /identity/v3/role_assignments?user.id=0923d37e739345a694121096914c323e&scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:02.569160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-8eb727c3-bb51-428d-93a8-9d2a2fad5aae None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:02.570464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8eb727c3-bb51-428d-93a8-9d2a2fad5aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:02.624190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:02.650568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3b427-68bb-48c5-aed4-a6313c8766f1 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:02.651213 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3b427-68bb-48c5-aed4-a6313c8766f1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:02.651760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3b427-68bb-48c5-aed4-a6313c8766f1 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:02.654268 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 81/159] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:02.661279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835698e-2ead-4367-af0b-b587686b09e6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:02.661840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835698e-2ead-4367-af0b-b587686b09e6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:02.662325 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835698e-2ead-4367-af0b-b587686b09e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:02.690433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 79/160] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:02.725173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f835698e-2ead-4367-af0b-b587686b09e6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:02.726991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f835698e-2ead-4367-af0b-b587686b09e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:02.737265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb727c3-bb51-428d-93a8-9d2a2fad5aae None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:02.870941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 82/161] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:02.912976 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835698e-2ead-4367-af0b-b587686b09e6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:02.936347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb727c3-bb51-428d-93a8-9d2a2fad5aae None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:03.000980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63446c2-7026-4b87-a3f2-654d68d9cd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:03.001913 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63446c2-7026-4b87-a3f2-654d68d9cd55 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:03.002363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63446c2-7026-4b87-a3f2-654d68d9cd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:03.002808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63446c2-7026-4b87-a3f2-654d68d9cd55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:03.021171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63446c2-7026-4b87-a3f2-654d68d9cd55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-b63446c2-7026-4b87-a3f2-654d68d9cd55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:03.026200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:03.027146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:03.028035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:03.028035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:03.028035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:03.028035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:03.028035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:03.028035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:03.028035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:03.028035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:03.028035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:03.028035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:03.028035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:03.028035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:03.032261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 80/162] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:03.039380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63446c2-7026-4b87-a3f2-654d68d9cd55 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:03.078972 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:03.089344 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:03.131837 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835698e-2ead-4367-af0b-b587686b09e6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:03.174952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01e7c8-d2dd-4e13-b1cf-07592c6009fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:03.176103 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01e7c8-d2dd-4e13-b1cf-07592c6009fc None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:03.176611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01e7c8-d2dd-4e13-b1cf-07592c6009fc None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:03.177113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01e7c8-d2dd-4e13-b1cf-07592c6009fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:03.192907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01e7c8-d2dd-4e13-b1cf-07592c6009fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-cd01e7c8-d2dd-4e13-b1cf-07592c6009fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:03.198502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:03.199428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:03.200230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:03.200230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:03.200230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:03.200230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:03.200230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:03.200230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:03.200230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:03.200230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:03.200230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:03.200230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:03.200230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:03.200230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:03.203092 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 83/163] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:50:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:03.204863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc2262-4143-4669-84ca-6a454fc86374 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:03.205509 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc2262-4143-4669-84ca-6a454fc86374 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:03.206001 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc2262-4143-4669-84ca-6a454fc86374 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:03.207998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 84/164] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:03.213195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc2262-4143-4669-84ca-6a454fc86374 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:03.263630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63446c2-7026-4b87-a3f2-654d68d9cd55 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:03.334914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe0c69-c3c7-4602-8498-babc2fabd914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:03.336166 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe0c69-c3c7-4602-8498-babc2fabd914 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:03.337503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe0c69-c3c7-4602-8498-babc2fabd914 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:03.338731 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe0c69-c3c7-4602-8498-babc2fabd914 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:03.340088 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe0c69-c3c7-4602-8498-babc2fabd914 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:03.342164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe0c69-c3c7-4602-8498-babc2fabd914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:03.344795 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe0c69-c3c7-4602-8498-babc2fabd914 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:03.368162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 81/165] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:03.372063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e172-4bf4-4d0a-b475-c39070879ffe None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:03.373752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e172-4bf4-4d0a-b475-c39070879ffe None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:03.374289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e172-4bf4-4d0a-b475-c39070879ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:03.415461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-21e0e172-4bf4-4d0a-b475-c39070879ffe None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:03.420452 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-21e0e172-4bf4-4d0a-b475-c39070879ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:03.448761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc2262-4143-4669-84ca-6a454fc86374 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:03.512678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:03.523763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8531c-a343-4111-8b84-d7ba9b0e0f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:03.524749 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8531c-a343-4111-8b84-d7ba9b0e0f36 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:03.525415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8531c-a343-4111-8b84-d7ba9b0e0f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:03.525953 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8531c-a343-4111-8b84-d7ba9b0e0f36 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:03.526463 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 82/166] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:03.532178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0e172-4bf4-4d0a-b475-c39070879ffe None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:03.532982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8531c-a343-4111-8b84-d7ba9b0e0f36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:03.533507 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8531c-a343-4111-8b84-d7ba9b0e0f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:03.535324 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8531c-a343-4111-8b84-d7ba9b0e0f36 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:03.545589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:03.556437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 85/167] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:03.561747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8531c-a343-4111-8b84-d7ba9b0e0f36 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:03.688252 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0e172-4bf4-4d0a-b475-c39070879ffe None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:03.735531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8531c-a343-4111-8b84-d7ba9b0e0f36 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:03.743189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a7afd-773f-491d-823c-5da872ecbec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:03.744573 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a7afd-773f-491d-823c-5da872ecbec2 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:03.744939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a7afd-773f-491d-823c-5da872ecbec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:03.745226 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a7afd-773f-491d-823c-5da872ecbec2 None admin] PATH_INFO: `/v3/users/bd21fa5bd78c4eab954e855b9a4a1663` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:03.746830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a7afd-773f-491d-823c-5da872ecbec2 None admin] RBAC: Authorizing `identity:get_user(user_id=bd21fa5bd78c4eab954e855b9a4a1663)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:03.749424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a7afd-773f-491d-823c-5da872ecbec2 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:03.751495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 83/168] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:03 2022] GET /identity/v3/users/bd21fa5bd78c4eab954e855b9a4a1663 => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:03.752633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a7afd-773f-491d-823c-5da872ecbec2 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:03.783052 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf30b93-19e8-449f-8538-e6def5f521b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:03.784542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf30b93-19e8-449f-8538-e6def5f521b0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:03.785238 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf30b93-19e8-449f-8538-e6def5f521b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:03.785673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf30b93-19e8-449f-8538-e6def5f521b0 None admin] PATH_INFO: `/v3/users/6e48447e02b346eea64eb71c1e6414e1` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:03.787286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf30b93-19e8-449f-8538-e6def5f521b0 None admin] RBAC: Authorizing `identity:get_user(user_id=6e48447e02b346eea64eb71c1e6414e1)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:03.789696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf30b93-19e8-449f-8538-e6def5f521b0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:03.792339 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 86/169] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:03 2022] GET /identity/v3/users/6e48447e02b346eea64eb71c1e6414e1 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:03.801160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff00dd-a4f0-490b-aacd-a1bcc7ae17bb None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:03.801844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff00dd-a4f0-490b-aacd-a1bcc7ae17bb None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:03.802443 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff00dd-a4f0-490b-aacd-a1bcc7ae17bb None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:03.805755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 87/170] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:03.805755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff00dd-a4f0-490b-aacd-a1bcc7ae17bb None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:03.869391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:03.889484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a7afd-773f-491d-823c-5da872ecbec2 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:03.891231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:03.926108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cc648-fa11-4c19-b621-447ae167ade7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:03.926862 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cc648-fa11-4c19-b621-447ae167ade7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:03.927235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cc648-fa11-4c19-b621-447ae167ade7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:03.927604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cc648-fa11-4c19-b621-447ae167ade7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:03.939375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cc648-fa11-4c19-b621-447ae167ade7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:03.943331 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff00dd-a4f0-490b-aacd-a1bcc7ae17bb None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-614cc648-fa11-4c19-b621-447ae167ade7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:03.944906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:03.945807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:03.946598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:03.946598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:03.946598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:03.946598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:03.946598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:03.946598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:03.946598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:03.946598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:03.946598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:03.946598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:03.946598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:03.946598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:03.946598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 84/171] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:03.947244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cc648-fa11-4c19-b621-447ae167ade7 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:03.988088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2e427-ef7e-4d8d-8881-1462044d2c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:03.988744 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2e427-ef7e-4d8d-8881-1462044d2c8d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:03.989033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2e427-ef7e-4d8d-8881-1462044d2c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:03.989311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2e427-ef7e-4d8d-8881-1462044d2c8d None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:03.990649 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2e427-ef7e-4d8d-8881-1462044d2c8d None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:03.993144 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2e427-ef7e-4d8d-8881-1462044d2c8d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:03.995035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 88/172] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:03 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:03.996554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b6d1-75c4-4abf-a350-545c99349661 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:03.996847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b6d1-75c4-4abf-a350-545c99349661 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:03.997145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b6d1-75c4-4abf-a350-545c99349661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:04.017846 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7585b6d1-75c4-4abf-a350-545c99349661 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:04.019173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7585b6d1-75c4-4abf-a350-545c99349661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:04.059097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cc648-fa11-4c19-b621-447ae167ade7 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:04.094600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7ea38-b914-452a-a15d-9c0b6217041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:04.095215 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ea38-b914-452a-a15d-9c0b6217041c None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:04.095493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ea38-b914-452a-a15d-9c0b6217041c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:04.095785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ea38-b914-452a-a15d-9c0b6217041c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:04.101958 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 89/173] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:04.102909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585b6d1-75c4-4abf-a350-545c99349661 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:04.117694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:04.170118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:04.191206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7ea38-b914-452a-a15d-9c0b6217041c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:04.192688 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7ea38-b914-452a-a15d-9c0b6217041c None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:04.218680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585b6d1-75c4-4abf-a350-545c99349661 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:04.256963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7bd04-4c8c-4569-b60f-f68990bf4c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:04.258056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7bd04-4c8c-4569-b60f-f68990bf4c91 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:04.258341 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7bd04-4c8c-4569-b60f-f68990bf4c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:04.258620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7bd04-4c8c-4569-b60f-f68990bf4c91 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:04.259297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7bd04-4c8c-4569-b60f-f68990bf4c91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:04.259600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7bd04-4c8c-4569-b60f-f68990bf4c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:04.261151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7bd04-4c8c-4569-b60f-f68990bf4c91 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:04.270651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 90/174] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:04.273487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7bd04-4c8c-4569-b60f-f68990bf4c91 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:04.297035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 85/175] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:04.301731 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7ea38-b914-452a-a15d-9c0b6217041c None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:04.349580 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:04.391297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7bd04-4c8c-4569-b60f-f68990bf4c91 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:04.413363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:04.415669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7ea38-b914-452a-a15d-9c0b6217041c None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:04.430265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c2f4a-4ed3-42db-8d19-94072d5ce5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:04.430932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c2f4a-4ed3-42db-8d19-94072d5ce5a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:04.431216 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c2f4a-4ed3-42db-8d19-94072d5ce5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:04.431494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c2f4a-4ed3-42db-8d19-94072d5ce5a4 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6/users/bd21fa5bd78c4eab954e855b9a4a1663/roles/199c92884fb24ba2ac1498b774df4a0b` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:04.433462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c2f4a-4ed3-42db-8d19-94072d5ce5a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9c0cc72f061412b9d0108f4fefb40a6, user_id=bd21fa5bd78c4eab954e855b9a4a1663, role_id=199c92884fb24ba2ac1498b774df4a0b)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:04.434933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c2f4a-4ed3-42db-8d19-94072d5ce5a4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:04.448775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 91/176] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:50:04 2022] PUT /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6/users/bd21fa5bd78c4eab954e855b9a4a1663/roles/199c92884fb24ba2ac1498b774df4a0b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:50:04.453438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb6a67-c4b4-41db-92d2-daea7e3d68d6 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:04.453842 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb6a67-c4b4-41db-92d2-daea7e3d68d6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:04.454191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb6a67-c4b4-41db-92d2-daea7e3d68d6 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:04.455507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cafcd3-f680-4eb9-bd13-456ba49b4c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:04.456404 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cafcd3-f680-4eb9-bd13-456ba49b4c16 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:04.456900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cafcd3-f680-4eb9-bd13-456ba49b4c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:04.457457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cafcd3-f680-4eb9-bd13-456ba49b4c16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:04.461286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 92/177] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:04 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:04.462469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb6a67-c4b4-41db-92d2-daea7e3d68d6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:04.475643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cafcd3-f680-4eb9-bd13-456ba49b4c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-b4cafcd3-f680-4eb9-bd13-456ba49b4c16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:04.481271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:04.482286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:04.483124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:04.483124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:04.483124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:04.483124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:04.483124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:04.483124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:04.483124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:04.483124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:04.483124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:04.483124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:04.483124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:04.483124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:04.486093 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 86/178] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:50:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:04.487411 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cafcd3-f680-4eb9-bd13-456ba49b4c16 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:04.597129 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb6a67-c4b4-41db-92d2-daea7e3d68d6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:04.636157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cafcd3-f680-4eb9-bd13-456ba49b4c16 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:04.637708 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:04.645595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8381c6-b15f-443b-bdbc-0b1adb4b0c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:04.646242 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8381c6-b15f-443b-bdbc-0b1adb4b0c28 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:04.646521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8381c6-b15f-443b-bdbc-0b1adb4b0c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:04.646797 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8381c6-b15f-443b-bdbc-0b1adb4b0c28 None admin] PATH_INFO: `/v3/users/6e48447e02b346eea64eb71c1e6414e1` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:04.648683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8381c6-b15f-443b-bdbc-0b1adb4b0c28 None admin] RBAC: Authorizing `identity:get_user(user_id=6e48447e02b346eea64eb71c1e6414e1)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:04.650136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8381c6-b15f-443b-bdbc-0b1adb4b0c28 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:04.651756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 93/179] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:04 2022] GET /identity/v3/users/6e48447e02b346eea64eb71c1e6414e1 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:04.652876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253ac7a-2b41-4ccc-b299-f7ab1701ab2f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:04.653150 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253ac7a-2b41-4ccc-b299-f7ab1701ab2f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:04.653417 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253ac7a-2b41-4ccc-b299-f7ab1701ab2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:04.676656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f253ac7a-2b41-4ccc-b299-f7ab1701ab2f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:04.678648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f253ac7a-2b41-4ccc-b299-f7ab1701ab2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:04.679520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2bea7-0bbc-4d41-ae1b-6bbc7669df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:04.680199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2bea7-0bbc-4d41-ae1b-6bbc7669df76 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:04.680475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2bea7-0bbc-4d41-ae1b-6bbc7669df76 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:04.680750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2bea7-0bbc-4d41-ae1b-6bbc7669df76 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:04.681914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2bea7-0bbc-4d41-ae1b-6bbc7669df76 None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:04.683362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2bea7-0bbc-4d41-ae1b-6bbc7669df76 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:04.685051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 87/180] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:04 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:04.688861 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2bea7-0bbc-4d41-ae1b-6bbc7669df76 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:04.733369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:04.761952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 94/181] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:04.763380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6d517-2191-4ac4-b010-adc2abf0a1b8 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:04.763755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6d517-2191-4ac4-b010-adc2abf0a1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:04.764106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6d517-2191-4ac4-b010-adc2abf0a1b8 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:04.765645 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 95/182] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:04.766223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6d517-2191-4ac4-b010-adc2abf0a1b8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:04.841485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2bea7-0bbc-4d41-ae1b-6bbc7669df76 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:04.884084 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485752a-5b0c-47cf-8aa4-c3d7609881c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:04.884613 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485752a-5b0c-47cf-8aa4-c3d7609881c9 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:04.884899 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485752a-5b0c-47cf-8aa4-c3d7609881c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:04.885161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485752a-5b0c-47cf-8aa4-c3d7609881c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:04.885822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485752a-5b0c-47cf-8aa4-c3d7609881c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:04.886127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485752a-5b0c-47cf-8aa4-c3d7609881c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:04.887570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485752a-5b0c-47cf-8aa4-c3d7609881c9 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:04.898487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6d517-2191-4ac4-b010-adc2abf0a1b8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:04.899790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 88/183] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:04.900515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485752a-5b0c-47cf-8aa4-c3d7609881c9 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:04.938667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:04.946164 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66406410-c436-4aa6-9f31-e5143fd177da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:04.946776 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66406410-c436-4aa6-9f31-e5143fd177da None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:04.947053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66406410-c436-4aa6-9f31-e5143fd177da None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:04.947317 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66406410-c436-4aa6-9f31-e5143fd177da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:04.998435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:05.016933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485752a-5b0c-47cf-8aa4-c3d7609881c9 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:05.022220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66406410-c436-4aa6-9f31-e5143fd177da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:05.023694 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66406410-c436-4aa6-9f31-e5143fd177da None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:05.054647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f72a2-9747-479b-899c-89bf471d74f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:05.055265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f72a2-9747-479b-899c-89bf471d74f0 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:05.055546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f72a2-9747-479b-899c-89bf471d74f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:05.055847 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f72a2-9747-479b-899c-89bf471d74f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:05.056580 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f72a2-9747-479b-899c-89bf471d74f0 None admin] RBAC: Adding query filter params (role.id=a5a6c597145c4b23983d1b04377af7ed, scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6, user.id=6e48447e02b346eea64eb71c1e6414e1) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:05.056888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f72a2-9747-479b-899c-89bf471d74f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:05.058314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f72a2-9747-479b-899c-89bf471d74f0 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:05.071756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 89/184] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:04 2022] GET /identity/v3/role_assignments?user.id=6e48447e02b346eea64eb71c1e6414e1&scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6&role.id=a5a6c597145c4b23983d1b04377af7ed => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:05.071756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de898383-226c-41b6-ba35-dedc5a95569b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:05.071756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de898383-226c-41b6-ba35-dedc5a95569b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:05.071756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de898383-226c-41b6-ba35-dedc5a95569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:05.098576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-de898383-226c-41b6-ba35-dedc5a95569b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:05.100152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-de898383-226c-41b6-ba35-dedc5a95569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:05.158990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 96/185] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:05.159849 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66406410-c436-4aa6-9f31-e5143fd177da None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:05.200086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 90/186] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:05.204925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de898383-226c-41b6-ba35-dedc5a95569b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:05.255611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:05.261084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:05.292911 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66406410-c436-4aa6-9f31-e5143fd177da None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:05.333627 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f9391-622c-4a17-a61e-c61de395447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:05.334306 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f9391-622c-4a17-a61e-c61de395447f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:05.334588 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f9391-622c-4a17-a61e-c61de395447f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:05.334858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f9391-622c-4a17-a61e-c61de395447f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:05.336113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f9391-622c-4a17-a61e-c61de395447f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:05.337615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f9391-622c-4a17-a61e-c61de395447f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:05.339364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 97/187] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:05.339979 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f9391-622c-4a17-a61e-c61de395447f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:05.359855 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de898383-226c-41b6-ba35-dedc5a95569b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:05.402322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536dfe-d376-460f-b1d5-9b0cd1cee7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:05.402965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536dfe-d376-460f-b1d5-9b0cd1cee7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:05.403247 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536dfe-d376-460f-b1d5-9b0cd1cee7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:05.403521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536dfe-d376-460f-b1d5-9b0cd1cee7a3 None admin] PATH_INFO: `/v3/users/1ca9654c8faa401dac9fae1bef60cca6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:05.418970 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5536dfe-d376-460f-b1d5-9b0cd1cee7a3 None admin] RBAC: Authorizing `identity:get_user(user_id=1ca9654c8faa401dac9fae1bef60cca6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:05.420410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5536dfe-d376-460f-b1d5-9b0cd1cee7a3 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:05.422080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 91/188] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:05 2022] GET /identity/v3/users/1ca9654c8faa401dac9fae1bef60cca6 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:05.427315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536dfe-d376-460f-b1d5-9b0cd1cee7a3 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:05.455539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f9391-622c-4a17-a61e-c61de395447f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:05.493204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71583461-430a-41b1-bbdd-b314aa97d962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:05.493868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71583461-430a-41b1-bbdd-b314aa97d962 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:05.494264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71583461-430a-41b1-bbdd-b314aa97d962 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:05.494536 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71583461-430a-41b1-bbdd-b314aa97d962 None admin] PATH_INFO: `/v3/projects/4e6e0e6aefcf412fae7f705c0c9d082e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:05.495691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71583461-430a-41b1-bbdd-b314aa97d962 None admin] RBAC: Authorizing `identity:get_project(project_id=4e6e0e6aefcf412fae7f705c0c9d082e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:05.497167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71583461-430a-41b1-bbdd-b314aa97d962 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:05.498998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 98/189] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:05 2022] GET /identity/v3/projects/4e6e0e6aefcf412fae7f705c0c9d082e => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:05.499577 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71583461-430a-41b1-bbdd-b314aa97d962 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:05.517142 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:05.520428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:05.539323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536dfe-d376-460f-b1d5-9b0cd1cee7a3 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:05.578967 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0fe08-1d86-4fa8-9277-1b2ac2cbb390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:05.579983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0fe08-1d86-4fa8-9277-1b2ac2cbb390 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:05.580464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0fe08-1d86-4fa8-9277-1b2ac2cbb390 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:05.580914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0fe08-1d86-4fa8-9277-1b2ac2cbb390 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:05.597164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0fe08-1d86-4fa8-9277-1b2ac2cbb390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-43b0fe08-1d86-4fa8-9277-1b2ac2cbb390 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:05.604928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:05.605897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:05.606693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:05.606693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:05.606693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:05.606693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:05.606693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:05.606693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:05.606693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:05.606693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:05.606693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:05.606693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:05.606693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:05.606693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:05.607689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 92/190] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:50:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:05.608671 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0fe08-1d86-4fa8-9277-1b2ac2cbb390 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:05.614667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71583461-430a-41b1-bbdd-b314aa97d962 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:05.653653 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3f5c4-7987-4234-a4f8-c682da719e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:05.654265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3f5c4-7987-4234-a4f8-c682da719e0b None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:05.654543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3f5c4-7987-4234-a4f8-c682da719e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:05.655253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3f5c4-7987-4234-a4f8-c682da719e0b None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:05.655940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3f5c4-7987-4234-a4f8-c682da719e0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:05.657775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3f5c4-7987-4234-a4f8-c682da719e0b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:05.686156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 99/191] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:50:05 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:50:05.686804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3f5c4-7987-4234-a4f8-c682da719e0b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:05.729530 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0fe08-1d86-4fa8-9277-1b2ac2cbb390 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:05.778584 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281a801-3766-4ea8-8d59-81a1d63c3df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:05.779181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281a801-3766-4ea8-8d59-81a1d63c3df9 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:05.779472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281a801-3766-4ea8-8d59-81a1d63c3df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:05.779770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281a801-3766-4ea8-8d59-81a1d63c3df9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:05.797555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:05.807365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:05.856582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3f5c4-7987-4234-a4f8-c682da719e0b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:05.871847 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281a801-3766-4ea8-8d59-81a1d63c3df9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:05.873692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281a801-3766-4ea8-8d59-81a1d63c3df9 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:05.907146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b489c5-bbe1-4425-a987-c4cdc88d5bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:05.910123 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b489c5-bbe1-4425-a987-c4cdc88d5bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:05.910613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b489c5-bbe1-4425-a987-c4cdc88d5bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:05.911220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b489c5-bbe1-4425-a987-c4cdc88d5bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:05.912672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b489c5-bbe1-4425-a987-c4cdc88d5bd3 None admin] RBAC: Adding query filter params (role.id=9d10ee7e27e242ba801222cf0264ea8d, scope.project.id=4e6e0e6aefcf412fae7f705c0c9d082e, user.id=6e48447e02b346eea64eb71c1e6414e1) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:05.914181 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b489c5-bbe1-4425-a987-c4cdc88d5bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:05.916718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b489c5-bbe1-4425-a987-c4cdc88d5bd3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:05.924933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 100/192] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:05 2022] GET /identity/v3/role_assignments?user.id=6e48447e02b346eea64eb71c1e6414e1&scope.project.id=4e6e0e6aefcf412fae7f705c0c9d082e&role.id=9d10ee7e27e242ba801222cf0264ea8d => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:05.926817 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b489c5-bbe1-4425-a987-c4cdc88d5bd3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:06.014015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 93/193] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:06.019931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281a801-3766-4ea8-8d59-81a1d63c3df9 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:06.091947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b489c5-bbe1-4425-a987-c4cdc88d5bd3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:06.099630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:06.151585 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d802fc-b3ef-42f0-b6c0-a825c74bb26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:06.152619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d802fc-b3ef-42f0-b6c0-a825c74bb26f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:06.153110 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d802fc-b3ef-42f0-b6c0-a825c74bb26f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:06.153986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d802fc-b3ef-42f0-b6c0-a825c74bb26f None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:06.154887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d802fc-b3ef-42f0-b6c0-a825c74bb26f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:06.155395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d802fc-b3ef-42f0-b6c0-a825c74bb26f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:06.158461 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d802fc-b3ef-42f0-b6c0-a825c74bb26f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:06.160929 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:06.172194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 101/194] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:06.182441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d802fc-b3ef-42f0-b6c0-a825c74bb26f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:06.192713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281a801-3766-4ea8-8d59-81a1d63c3df9 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:06.244433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8582fb0-1c9a-4508-b7c5-356955c5d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:06.245447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8582fb0-1c9a-4508-b7c5-356955c5d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:06.245959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8582fb0-1c9a-4508-b7c5-356955c5d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:06.246436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8582fb0-1c9a-4508-b7c5-356955c5d9e8 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:06.248783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8582fb0-1c9a-4508-b7c5-356955c5d9e8 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:06.250658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8582fb0-1c9a-4508-b7c5-356955c5d9e8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:06.253028 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 94/195] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:06 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:06.260431 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8582fb0-1c9a-4508-b7c5-356955c5d9e8 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:06.315174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d802fc-b3ef-42f0-b6c0-a825c74bb26f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:06.350939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee87a7-d97a-4209-a3f0-0062bf31209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:06.351868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee87a7-d97a-4209-a3f0-0062bf31209d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:06.352360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee87a7-d97a-4209-a3f0-0062bf31209d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:06.352800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee87a7-d97a-4209-a3f0-0062bf31209d None admin] PATH_INFO: `/v3/users/1ca9654c8faa401dac9fae1bef60cca6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:06.354165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee87a7-d97a-4209-a3f0-0062bf31209d None admin] RBAC: Authorizing `identity:get_user(user_id=1ca9654c8faa401dac9fae1bef60cca6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:06.355945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee87a7-d97a-4209-a3f0-0062bf31209d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:06.357798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 102/196] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:06 2022] GET /identity/v3/users/1ca9654c8faa401dac9fae1bef60cca6 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:06.365971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee87a7-d97a-4209-a3f0-0062bf31209d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:06.387164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8582fb0-1c9a-4508-b7c5-356955c5d9e8 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:06.411440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:06.425850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfa414-bcab-46af-92e9-5012618e8781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:06.426472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfa414-bcab-46af-92e9-5012618e8781 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:06.426764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfa414-bcab-46af-92e9-5012618e8781 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:06.427047 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfa414-bcab-46af-92e9-5012618e8781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:06.427820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfa414-bcab-46af-92e9-5012618e8781 None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=a7c2c4a65c044df4afad820df6582f3e, user.id=1ca9654c8faa401dac9fae1bef60cca6) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:06.428394 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfa414-bcab-46af-92e9-5012618e8781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:06.430958 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfa414-bcab-46af-92e9-5012618e8781 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:06.436731 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 95/197] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:06 2022] GET /identity/v3/role_assignments?user.id=1ca9654c8faa401dac9fae1bef60cca6&scope.project.id=a7c2c4a65c044df4afad820df6582f3e&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:06.511419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:06.572576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee87a7-d97a-4209-a3f0-0062bf31209d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:06.628465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc046f-1acc-4357-8ff5-3ca22a28e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:06.629084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc046f-1acc-4357-8ff5-3ca22a28e1fe None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:06.629365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc046f-1acc-4357-8ff5-3ca22a28e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:06.629637 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc046f-1acc-4357-8ff5-3ca22a28e1fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:06.661213 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff3b33-ae80-40c5-98c2-a630fd4153eb None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:06.661509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff3b33-ae80-40c5-98c2-a630fd4153eb None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:06.661770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff3b33-ae80-40c5-98c2-a630fd4153eb None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:06.663285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 96/198] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:50:06.669257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a928b3-96d9-4507-8e60-d197d0091ed3 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:06.669547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a928b3-96d9-4507-8e60-d197d0091ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:06.669827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a928b3-96d9-4507-8e60-d197d0091ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:06.705205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-f4a928b3-96d9-4507-8e60-d197d0091ed3 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:06.707745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f4a928b3-96d9-4507-8e60-d197d0091ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:06.721450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc046f-1acc-4357-8ff5-3ca22a28e1fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:06.722921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc046f-1acc-4357-8ff5-3ca22a28e1fe None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:06.798029 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:06.861905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 97/199] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:06.879788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 103/200] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:06.881151 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a928b3-96d9-4507-8e60-d197d0091ed3 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:06.894818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc046f-1acc-4357-8ff5-3ca22a28e1fe None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:07.074311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc046f-1acc-4357-8ff5-3ca22a28e1fe None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:07.081608 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a928b3-96d9-4507-8e60-d197d0091ed3 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:07.090118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:07.120548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdad334-10ae-4e8e-bf0d-92e306a6289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:07.121112 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdad334-10ae-4e8e-bf0d-92e306a6289b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:07.121396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdad334-10ae-4e8e-bf0d-92e306a6289b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:07.121672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdad334-10ae-4e8e-bf0d-92e306a6289b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:07.141686 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdad334-10ae-4e8e-bf0d-92e306a6289b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-4cdad334-10ae-4e8e-bf0d-92e306a6289b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:07.146508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:07.147363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:07.148565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:07.148565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:07.148565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:07.148565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:07.148565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:07.148565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:07.148565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:07.148565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:07.148565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:07.148565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:07.148565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:07.148565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:07.153601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 104/201] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:07.156199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be63b40-c188-4942-b111-1929936387e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:07.156917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be63b40-c188-4942-b111-1929936387e4 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:07.157201 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be63b40-c188-4942-b111-1929936387e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:07.157477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be63b40-c188-4942-b111-1929936387e4 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:07.158762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be63b40-c188-4942-b111-1929936387e4 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:07.160302 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be63b40-c188-4942-b111-1929936387e4 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:07.161922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 98/202] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:06 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:07.162550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdad334-10ae-4e8e-bf0d-92e306a6289b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:07.172008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be63b40-c188-4942-b111-1929936387e4 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:07.198236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:07.346808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be63b40-c188-4942-b111-1929936387e4 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:07.366151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdad334-10ae-4e8e-bf0d-92e306a6289b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:07.389947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20ee18-6fbd-4345-8b9d-9c4087ce0452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:07.390914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ee18-6fbd-4345-8b9d-9c4087ce0452 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:07.391388 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ee18-6fbd-4345-8b9d-9c4087ce0452 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:07.391900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ee18-6fbd-4345-8b9d-9c4087ce0452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:07.392879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20ee18-6fbd-4345-8b9d-9c4087ce0452 None admin] RBAC: Adding query filter params (role.id=a5a6c597145c4b23983d1b04377af7ed, scope.project.id=a7c2c4a65c044df4afad820df6582f3e, user.id=1ca9654c8faa401dac9fae1bef60cca6) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:07.393383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20ee18-6fbd-4345-8b9d-9c4087ce0452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:07.395070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20ee18-6fbd-4345-8b9d-9c4087ce0452 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:07.402198 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 99/203] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:07 2022] GET /identity/v3/role_assignments?user.id=1ca9654c8faa401dac9fae1bef60cca6&scope.project.id=a7c2c4a65c044df4afad820df6582f3e&role.id=a5a6c597145c4b23983d1b04377af7ed => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:07.432349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfc6a5-8e0b-4bb2-bee2-f9497722ae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:07.433374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfc6a5-8e0b-4bb2-bee2-f9497722ae47 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:07.433868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfc6a5-8e0b-4bb2-bee2-f9497722ae47 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:07.434392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfc6a5-8e0b-4bb2-bee2-f9497722ae47 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:07.435316 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfc6a5-8e0b-4bb2-bee2-f9497722ae47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:07.435871 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfc6a5-8e0b-4bb2-bee2-f9497722ae47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:07.437644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfc6a5-8e0b-4bb2-bee2-f9497722ae47 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:07.448892 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 105/204] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:07.456923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20ee18-6fbd-4345-8b9d-9c4087ce0452 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:07.524998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:07.604070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20ee18-6fbd-4345-8b9d-9c4087ce0452 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:07.647403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd40afc-6f41-4d5a-928c-2450b5cf7fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:07.648413 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd40afc-6f41-4d5a-928c-2450b5cf7fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:07.648935 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd40afc-6f41-4d5a-928c-2450b5cf7fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:07.649410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd40afc-6f41-4d5a-928c-2450b5cf7fe3 None admin] PATH_INFO: `/v3/users/bd21fa5bd78c4eab954e855b9a4a1663` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:07.650753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd40afc-6f41-4d5a-928c-2450b5cf7fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=bd21fa5bd78c4eab954e855b9a4a1663)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:07.652668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd40afc-6f41-4d5a-928c-2450b5cf7fe3 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:07.654518 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 100/205] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:07 2022] GET /identity/v3/users/bd21fa5bd78c4eab954e855b9a4a1663 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:07.660006 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfc6a5-8e0b-4bb2-bee2-f9497722ae47 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:07.775609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:07.797904 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfc6a5-8e0b-4bb2-bee2-f9497722ae47 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:07.841296 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336abe5-bdf1-4b4e-9906-39c54bbc25c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:07.842301 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336abe5-bdf1-4b4e-9906-39c54bbc25c6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:07.842789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336abe5-bdf1-4b4e-9906-39c54bbc25c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:07.843338 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336abe5-bdf1-4b4e-9906-39c54bbc25c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:07.940027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336abe5-bdf1-4b4e-9906-39c54bbc25c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:07.941764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336abe5-bdf1-4b4e-9906-39c54bbc25c6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:08.030058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:08.051376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 106/206] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:08.052711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd40afc-6f41-4d5a-928c-2450b5cf7fe3 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:08.216255 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd40afc-6f41-4d5a-928c-2450b5cf7fe3 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:08.224782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:08.264454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773c119-2c59-4f01-87cc-d7eee3f14ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:08.265099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773c119-2c59-4f01-87cc-d7eee3f14ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:08.265385 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773c119-2c59-4f01-87cc-d7eee3f14ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:08.265660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773c119-2c59-4f01-87cc-d7eee3f14ca9 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:08.266801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773c119-2c59-4f01-87cc-d7eee3f14ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:08.268288 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773c119-2c59-4f01-87cc-d7eee3f14ca9 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:08.269932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 101/207] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:08 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:08.276879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336abe5-bdf1-4b4e-9906-39c54bbc25c6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:08.384990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336abe5-bdf1-4b4e-9906-39c54bbc25c6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:08.421427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f61c8b-25d3-4786-941f-652d23abf3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:08.422055 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f61c8b-25d3-4786-941f-652d23abf3ed None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:08.422339 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f61c8b-25d3-4786-941f-652d23abf3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:08.422614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f61c8b-25d3-4786-941f-652d23abf3ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:08.423351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f61c8b-25d3-4786-941f-652d23abf3ed None admin] RBAC: Adding query filter params (role.id=199c92884fb24ba2ac1498b774df4a0b, scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6, user.id=bd21fa5bd78c4eab954e855b9a4a1663) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:08.423660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f61c8b-25d3-4786-941f-652d23abf3ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:08.425150 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f61c8b-25d3-4786-941f-652d23abf3ed None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:08.432517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 107/208] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:08 2022] GET /identity/v3/role_assignments?user.id=bd21fa5bd78c4eab954e855b9a4a1663&scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6&role.id=199c92884fb24ba2ac1498b774df4a0b => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:08.554323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0534193-fed9-486f-a828-e4ed020f6d55 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:08.554668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0534193-fed9-486f-a828-e4ed020f6d55 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:08.554784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0534193-fed9-486f-a828-e4ed020f6d55 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:08.556256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 102/209] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:08.562264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d614ed-5fa1-4b92-94c0-27cf554cdd77 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:08.562574 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d614ed-5fa1-4b92-94c0-27cf554cdd77 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:08.562821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d614ed-5fa1-4b92-94c0-27cf554cdd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:08.582033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-93d614ed-5fa1-4b92-94c0-27cf554cdd77 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:08.588211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-93d614ed-5fa1-4b92-94c0-27cf554cdd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:08.650660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:08.667003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 108/210] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:08.699447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0534193-fed9-486f-a828-e4ed020f6d55 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:08.769038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6f18-d803-433f-a407-fca49a21f671 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:08.769038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6f18-d803-433f-a407-fca49a21f671 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:08.769284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6f18-d803-433f-a407-fca49a21f671 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:08.770555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 109/211] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:08.778468 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8b4e9-5dc9-4abf-aea2-855c3515f5aa None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:08.778790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8b4e9-5dc9-4abf-aea2-855c3515f5aa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:08.779028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8b4e9-5dc9-4abf-aea2-855c3515f5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:08.807640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6bb8b4e9-5dc9-4abf-aea2-855c3515f5aa None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:08.808901 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6bb8b4e9-5dc9-4abf-aea2-855c3515f5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:08.833138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0534193-fed9-486f-a828-e4ed020f6d55 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:08.878633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9786574-3d99-4771-872b-a53b47df95c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:08.879280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9786574-3d99-4771-872b-a53b47df95c2 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:08.879570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9786574-3d99-4771-872b-a53b47df95c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:08.879895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9786574-3d99-4771-872b-a53b47df95c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:08.893617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9786574-3d99-4771-872b-a53b47df95c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-e9786574-3d99-4771-872b-a53b47df95c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:08.898917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:08.899866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:08.900652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:08.900652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:08.900652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:08.900652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:08.900652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:08.900652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:08.900652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:08.900652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:08.900652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:08.900652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:08.900652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:08.900652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:08.900652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 103/212] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:08.906185 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9786574-3d99-4771-872b-a53b47df95c2 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:08.907357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 110/213] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:08.933570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8b4e9-5dc9-4abf-aea2-855c3515f5aa None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:08.943517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:09.026739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9786574-3d99-4771-872b-a53b47df95c2 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:09.067635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b22c11-ab19-4e22-a054-3f647821c0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:09.068294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8b4e9-5dc9-4abf-aea2-855c3515f5aa None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:09.069117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b22c11-ab19-4e22-a054-3f647821c0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:09.070158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b22c11-ab19-4e22-a054-3f647821c0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:09.070639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b22c11-ab19-4e22-a054-3f647821c0e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:09.071566 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b22c11-ab19-4e22-a054-3f647821c0e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:09.072079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b22c11-ab19-4e22-a054-3f647821c0e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:09.073637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b22c11-ab19-4e22-a054-3f647821c0e6 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:09.081115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:09.090138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 104/214] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:09.092078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b22c11-ab19-4e22-a054-3f647821c0e6 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:09.110954 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61688aae-bbf1-4efe-95be-f0992bb242ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:09.111473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61688aae-bbf1-4efe-95be-f0992bb242ec None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:09.111776 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61688aae-bbf1-4efe-95be-f0992bb242ec None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:09.112058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61688aae-bbf1-4efe-95be-f0992bb242ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:09.113193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61688aae-bbf1-4efe-95be-f0992bb242ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:09.114654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61688aae-bbf1-4efe-95be-f0992bb242ec None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:09.116301 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 111/215] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:09.122005 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61688aae-bbf1-4efe-95be-f0992bb242ec None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:09.202977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:09.211399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b22c11-ab19-4e22-a054-3f647821c0e6 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:09.239342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61688aae-bbf1-4efe-95be-f0992bb242ec None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:09.248118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468912d-4d7a-4482-aa15-9f85f1dcf36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:09.249066 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468912d-4d7a-4482-aa15-9f85f1dcf36a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:09.249642 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468912d-4d7a-4482-aa15-9f85f1dcf36a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:09.250106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468912d-4d7a-4482-aa15-9f85f1dcf36a None admin] PATH_INFO: `/v3/users/e79c4f2a4b164708948e5b0b9b139415` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:09.265794 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468912d-4d7a-4482-aa15-9f85f1dcf36a None admin] RBAC: Authorizing `identity:get_user(user_id=e79c4f2a4b164708948e5b0b9b139415)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:09.267752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468912d-4d7a-4482-aa15-9f85f1dcf36a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:09.275047 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 105/216] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:09 2022] GET /identity/v3/users/e79c4f2a4b164708948e5b0b9b139415 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:09.276586 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468912d-4d7a-4482-aa15-9f85f1dcf36a None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:09.278949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b634d-93a4-429a-ba01-ab0dbf576766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:09.279630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b634d-93a4-429a-ba01-ab0dbf576766 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:09.280019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b634d-93a4-429a-ba01-ab0dbf576766 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:09.280378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b634d-93a4-429a-ba01-ab0dbf576766 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:09.281275 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b634d-93a4-429a-ba01-ab0dbf576766 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:09.282991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b634d-93a4-429a-ba01-ab0dbf576766 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:09.309900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 112/217] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:50:09 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:50:09.311312 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724123c-04bd-4375-a1e4-81434fda0f0b None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:09.311611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724123c-04bd-4375-a1e4-81434fda0f0b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:09.311984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724123c-04bd-4375-a1e4-81434fda0f0b None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:09.318706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 113/218] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:09.321683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d455c79-ed3c-4e2a-8a69-08da3abe26f7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:09.321962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d455c79-ed3c-4e2a-8a69-08da3abe26f7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:09.322230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d455c79-ed3c-4e2a-8a69-08da3abe26f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:09.352483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2d455c79-ed3c-4e2a-8a69-08da3abe26f7 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:09.354847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2d455c79-ed3c-4e2a-8a69-08da3abe26f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:09.396805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:09.414008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468912d-4d7a-4482-aa15-9f85f1dcf36a None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:09.448423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 114/219] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:09.457579 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7273ead-31ff-42d6-bfce-6b24f3310070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:09.458298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7273ead-31ff-42d6-bfce-6b24f3310070 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:09.458686 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7273ead-31ff-42d6-bfce-6b24f3310070 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:09.459124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7273ead-31ff-42d6-bfce-6b24f3310070 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:09.472376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d455c79-ed3c-4e2a-8a69-08da3abe26f7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:09.488691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:09.540979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7273ead-31ff-42d6-bfce-6b24f3310070 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:09.542511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7273ead-31ff-42d6-bfce-6b24f3310070 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:09.609242 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d455c79-ed3c-4e2a-8a69-08da3abe26f7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:09.658383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c40fdf-4f46-431a-b1c6-50d2a8d8fb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:09.659272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c40fdf-4f46-431a-b1c6-50d2a8d8fb3f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:09.660127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c40fdf-4f46-431a-b1c6-50d2a8d8fb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:09.660418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c40fdf-4f46-431a-b1c6-50d2a8d8fb3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:09.681989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c40fdf-4f46-431a-b1c6-50d2a8d8fb3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-12c40fdf-4f46-431a-b1c6-50d2a8d8fb3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:09.686916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:09.687819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:09.688595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:09.688595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:09.688595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:09.688595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:09.688595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:09.688595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:09.688595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:09.688595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:09.688595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:09.688595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:09.688595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:09.688595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:09.689296 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 115/220] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:50:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:09.691099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33232c8c-be81-4a72-bfad-902434bdd836 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:09.691383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33232c8c-be81-4a72-bfad-902434bdd836 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:09.691654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33232c8c-be81-4a72-bfad-902434bdd836 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:09.692511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 106/221] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:09.693157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 116/222] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:09.698419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33232c8c-be81-4a72-bfad-902434bdd836 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:09.698577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7273ead-31ff-42d6-bfce-6b24f3310070 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:09.729718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:09.764088 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:09.810491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7273ead-31ff-42d6-bfce-6b24f3310070 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:09.822477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33232c8c-be81-4a72-bfad-902434bdd836 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:09.846170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84092998-9361-4934-bdd2-9c24a09cce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:09.846908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84092998-9361-4934-bdd2-9c24a09cce71 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:09.847266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84092998-9361-4934-bdd2-9c24a09cce71 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:09.847614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84092998-9361-4934-bdd2-9c24a09cce71 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:09.848474 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84092998-9361-4934-bdd2-9c24a09cce71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:09.848846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84092998-9361-4934-bdd2-9c24a09cce71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:09.850308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84092998-9361-4934-bdd2-9c24a09cce71 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:09.859843 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 107/223] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:09.861246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5733cc-2388-4e1e-90aa-beb9b3859665 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:09.861616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5733cc-2388-4e1e-90aa-beb9b3859665 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:09.861970 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5733cc-2388-4e1e-90aa-beb9b3859665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:09.863500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7fe44-aac0-433b-b8b0-fc752af471d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:09.864360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7fe44-aac0-433b-b8b0-fc752af471d4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:09.864868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7fe44-aac0-433b-b8b0-fc752af471d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:09.865383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7fe44-aac0-433b-b8b0-fc752af471d4 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:09.867427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7fe44-aac0-433b-b8b0-fc752af471d4 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:09.869243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7fe44-aac0-433b-b8b0-fc752af471d4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:09.871175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 117/224] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:09 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:09.876894 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7fe44-aac0-433b-b8b0-fc752af471d4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:09.882503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-ae5733cc-2388-4e1e-90aa-beb9b3859665 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:09.883890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ae5733cc-2388-4e1e-90aa-beb9b3859665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:09.954938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 108/225] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:09.968941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5733cc-2388-4e1e-90aa-beb9b3859665 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:09.985071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:09.996777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7fe44-aac0-433b-b8b0-fc752af471d4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:10.033459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9f446-193a-4355-959f-a4256b6a771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:10.034385 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9f446-193a-4355-959f-a4256b6a771c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:10.034666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9f446-193a-4355-959f-a4256b6a771c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:10.034940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9f446-193a-4355-959f-a4256b6a771c None admin] PATH_INFO: `/v3/users/1ca9654c8faa401dac9fae1bef60cca6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:10.037823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9f446-193a-4355-959f-a4256b6a771c None admin] RBAC: Authorizing `identity:get_user(user_id=1ca9654c8faa401dac9fae1bef60cca6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:10.038936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:10.039767 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9f446-193a-4355-959f-a4256b6a771c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:10.041676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 118/226] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:09 2022] GET /identity/v3/users/1ca9654c8faa401dac9fae1bef60cca6 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:10.042518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9f446-193a-4355-959f-a4256b6a771c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:10.096797 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5733cc-2388-4e1e-90aa-beb9b3859665 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:10.134607 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783268b-2a64-47c6-8ceb-85b4d48f2ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:10.135191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783268b-2a64-47c6-8ceb-85b4d48f2ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:10.135479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783268b-2a64-47c6-8ceb-85b4d48f2ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:10.135772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783268b-2a64-47c6-8ceb-85b4d48f2ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:10.136516 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783268b-2a64-47c6-8ceb-85b4d48f2ab6 None admin] RBAC: Adding query filter params (role.id=9d10ee7e27e242ba801222cf0264ea8d, scope.project.id=a7c2c4a65c044df4afad820df6582f3e, user.id=e79c4f2a4b164708948e5b0b9b139415) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:10.136825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783268b-2a64-47c6-8ceb-85b4d48f2ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:10.138309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783268b-2a64-47c6-8ceb-85b4d48f2ab6 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:10.144125 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 109/227] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:09 2022] GET /identity/v3/role_assignments?user.id=e79c4f2a4b164708948e5b0b9b139415&scope.project.id=a7c2c4a65c044df4afad820df6582f3e&role.id=9d10ee7e27e242ba801222cf0264ea8d => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:10.144748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783268b-2a64-47c6-8ceb-85b4d48f2ab6 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:10.160731 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9f446-193a-4355-959f-a4256b6a771c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:10.207464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10bdd5-0422-4c19-95f0-97d3db28dc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:10.209989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10bdd5-0422-4c19-95f0-97d3db28dc19 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:10.211680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10bdd5-0422-4c19-95f0-97d3db28dc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:10.211987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10bdd5-0422-4c19-95f0-97d3db28dc19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:10.236519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10bdd5-0422-4c19-95f0-97d3db28dc19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-aa10bdd5-0422-4c19-95f0-97d3db28dc19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:10.241612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:10.242539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:10.243308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:10.243308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:10.243308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:10.243308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:10.243308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:10.243308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:10.243308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:10.243308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:10.243308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:10.243308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:10.243308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:10.243308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:10.248441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 119/228] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:50:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:10.249893 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10bdd5-0422-4c19-95f0-97d3db28dc19 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:10.327662 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:10.329986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783268b-2a64-47c6-8ceb-85b4d48f2ab6 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:10.345236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:10.378350 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030adf26-73f6-4b04-b3b3-ee2b1c3a1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:10.378995 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030adf26-73f6-4b04-b3b3-ee2b1c3a1c66 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:10.379277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030adf26-73f6-4b04-b3b3-ee2b1c3a1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:10.379551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030adf26-73f6-4b04-b3b3-ee2b1c3a1c66 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:10.380751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030adf26-73f6-4b04-b3b3-ee2b1c3a1c66 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:10.383462 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030adf26-73f6-4b04-b3b3-ee2b1c3a1c66 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:10.385783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 110/229] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:10 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:10.391909 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030adf26-73f6-4b04-b3b3-ee2b1c3a1c66 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:10.505663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10bdd5-0422-4c19-95f0-97d3db28dc19 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:10.508607 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030adf26-73f6-4b04-b3b3-ee2b1c3a1c66 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:10.552871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9998e0-078f-4cb5-8d8e-a67c0bd1ef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:10.553802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9998e0-078f-4cb5-8d8e-a67c0bd1ef13 None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:10.554119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9998e0-078f-4cb5-8d8e-a67c0bd1ef13 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:10.554402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9998e0-078f-4cb5-8d8e-a67c0bd1ef13 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e/users/1ca9654c8faa401dac9fae1bef60cca6/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:10.557473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9998e0-078f-4cb5-8d8e-a67c0bd1ef13 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7c2c4a65c044df4afad820df6582f3e, user_id=1ca9654c8faa401dac9fae1bef60cca6, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:10.559036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9998e0-078f-4cb5-8d8e-a67c0bd1ef13 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:10.562820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e8f6d-4f95-4c4e-b049-34fcab713508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:10.563450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e8f6d-4f95-4c4e-b049-34fcab713508 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:10.563761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e8f6d-4f95-4c4e-b049-34fcab713508 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:10.564141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e8f6d-4f95-4c4e-b049-34fcab713508 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:10.564694 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e8f6d-4f95-4c4e-b049-34fcab713508 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:10.564996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e8f6d-4f95-4c4e-b049-34fcab713508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:10.566367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e8f6d-4f95-4c4e-b049-34fcab713508 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:10.586103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 111/230] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:50:10 2022] PUT /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e/users/1ca9654c8faa401dac9fae1bef60cca6/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:50:10.587148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 120/231] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:10.593507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9998e0-078f-4cb5-8d8e-a67c0bd1ef13 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:10.652241 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:10.753666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9998e0-078f-4cb5-8d8e-a67c0bd1ef13 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:10.797669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd7aff-1fc7-4df0-8a62-db168f680d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:10.798322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd7aff-1fc7-4df0-8a62-db168f680d24 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:10.798606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd7aff-1fc7-4df0-8a62-db168f680d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:10.798882 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd7aff-1fc7-4df0-8a62-db168f680d24 None admin] PATH_INFO: `/v3/users/1ca9654c8faa401dac9fae1bef60cca6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:10.800059 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd7aff-1fc7-4df0-8a62-db168f680d24 None admin] RBAC: Authorizing `identity:get_user(user_id=1ca9654c8faa401dac9fae1bef60cca6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:10.801501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd7aff-1fc7-4df0-8a62-db168f680d24 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:10.803103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 112/232] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:10 2022] GET /identity/v3/users/1ca9654c8faa401dac9fae1bef60cca6 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:10.810054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e8f6d-4f95-4c4e-b049-34fcab713508 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:10.907780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:10.936443 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e8f6d-4f95-4c4e-b049-34fcab713508 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:10.983252 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9768a2-12bd-4f04-8a62-1edb9c3b1366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:10.983924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9768a2-12bd-4f04-8a62-1edb9c3b1366 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:10.984212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9768a2-12bd-4f04-8a62-1edb9c3b1366 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:10.984582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9768a2-12bd-4f04-8a62-1edb9c3b1366 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:10.988409 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9768a2-12bd-4f04-8a62-1edb9c3b1366 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:10.990025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9768a2-12bd-4f04-8a62-1edb9c3b1366 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:10.992062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 121/233] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:10 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:10.997981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd7aff-1fc7-4df0-8a62-db168f680d24 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:11.143884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd7aff-1fc7-4df0-8a62-db168f680d24 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:11.151422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:11.185585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43126e-1335-460b-a222-b5aeaab9b96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:11.186261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43126e-1335-460b-a222-b5aeaab9b96f None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:11.186550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43126e-1335-460b-a222-b5aeaab9b96f None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:11.186829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43126e-1335-460b-a222-b5aeaab9b96f None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e/users/1ca9654c8faa401dac9fae1bef60cca6/roles/a5a6c597145c4b23983d1b04377af7ed` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:11.193525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43126e-1335-460b-a222-b5aeaab9b96f None admin] RBAC: Authorizing `identity:create_grant(project_id=a7c2c4a65c044df4afad820df6582f3e, user_id=1ca9654c8faa401dac9fae1bef60cca6, role_id=a5a6c597145c4b23983d1b04377af7ed)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:11.195039 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43126e-1335-460b-a222-b5aeaab9b96f None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:11.221295 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 113/234] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:50:10 2022] PUT /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e/users/1ca9654c8faa401dac9fae1bef60cca6/roles/a5a6c597145c4b23983d1b04377af7ed => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:50:11.774683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1697-7a4c-4b83-9393-1cd498ebe71f None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:11.775687 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1697-7a4c-4b83-9393-1cd498ebe71f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:11.776203 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1697-7a4c-4b83-9393-1cd498ebe71f None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:11.777821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 122/235] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:11.782751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2a42-b505-4a20-af11-6ae34369b859 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:11.783386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2a42-b505-4a20-af11-6ae34369b859 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:11.783894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2a42-b505-4a20-af11-6ae34369b859 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:11.785685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 114/236] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:11.788169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9cce2-e52e-40ba-857b-23983fa16218 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:11.789295 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9cce2-e52e-40ba-857b-23983fa16218 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:11.789771 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9cce2-e52e-40ba-857b-23983fa16218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:11.797876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66b1b1-6525-4114-bcca-0eb1fc3e0fcc None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:11.799282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66b1b1-6525-4114-bcca-0eb1fc3e0fcc None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:11.799869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66b1b1-6525-4114-bcca-0eb1fc3e0fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:11.817477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1be9cce2-e52e-40ba-857b-23983fa16218 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:11.824088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1be9cce2-e52e-40ba-857b-23983fa16218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:11.837308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-3e66b1b1-6525-4114-bcca-0eb1fc3e0fcc None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:11.838828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-3e66b1b1-6525-4114-bcca-0eb1fc3e0fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:11.939687 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 123/237] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:11.971679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9cce2-e52e-40ba-857b-23983fa16218 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:11.985961 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 115/238] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:12.052525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66b1b1-6525-4114-bcca-0eb1fc3e0fcc None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:12.115081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:12.170157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9cce2-e52e-40ba-857b-23983fa16218 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:12.260092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:12.268509 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4017f-bb9e-41c9-9c7f-fdbffd118877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:12.269982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4017f-bb9e-41c9-9c7f-fdbffd118877 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:12.270729 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4017f-bb9e-41c9-9c7f-fdbffd118877 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:12.271605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4017f-bb9e-41c9-9c7f-fdbffd118877 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:12.279115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66b1b1-6525-4114-bcca-0eb1fc3e0fcc None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:12.297643 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4017f-bb9e-41c9-9c7f-fdbffd118877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-1bf4017f-bb9e-41c9-9c7f-fdbffd118877 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:12.309255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:12.310162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:12.310942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:12.310942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:12.310942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:12.310942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:12.310942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:12.310942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:12.310942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:12.310942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:12.310942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:12.310942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:12.310942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:12.310942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:12.313324 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 124/239] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:12.320299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea69fe7-ad1f-4006-8cbe-05c326d68d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:12.320946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea69fe7-ad1f-4006-8cbe-05c326d68d28 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:12.321233 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea69fe7-ad1f-4006-8cbe-05c326d68d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:12.321512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea69fe7-ad1f-4006-8cbe-05c326d68d28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:12.322211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4017f-bb9e-41c9-9c7f-fdbffd118877 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:12.322656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea69fe7-ad1f-4006-8cbe-05c326d68d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:12.324266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea69fe7-ad1f-4006-8cbe-05c326d68d28 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:12.326169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 116/240] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:12.331714 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea69fe7-ad1f-4006-8cbe-05c326d68d28 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:12.462053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4017f-bb9e-41c9-9c7f-fdbffd118877 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:12.508495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea69fe7-ad1f-4006-8cbe-05c326d68d28 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:12.547336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badd778-bf5e-4abb-a822-eb296406d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:12.548381 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badd778-bf5e-4abb-a822-eb296406d00c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:12.548877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badd778-bf5e-4abb-a822-eb296406d00c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:12.549369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badd778-bf5e-4abb-a822-eb296406d00c None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:12.550508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badd778-bf5e-4abb-a822-eb296406d00c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:12.551039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badd778-bf5e-4abb-a822-eb296406d00c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:12.554615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badd778-bf5e-4abb-a822-eb296406d00c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:12.570700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 125/241] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:12.572876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598be498-f7f9-46ab-813a-1d4e7b5c807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:12.574083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598be498-f7f9-46ab-813a-1d4e7b5c807a None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:12.574668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598be498-f7f9-46ab-813a-1d4e7b5c807a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:12.575240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598be498-f7f9-46ab-813a-1d4e7b5c807a None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:12.577801 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badd778-bf5e-4abb-a822-eb296406d00c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:12.579412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598be498-f7f9-46ab-813a-1d4e7b5c807a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:12.585844 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598be498-f7f9-46ab-813a-1d4e7b5c807a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:12.586413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:12.625759 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 117/242] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:50:12 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:50:12.791102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badd778-bf5e-4abb-a822-eb296406d00c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:12.856314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edae5df-96cb-487c-a46c-96eda03b258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:12.857465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edae5df-96cb-487c-a46c-96eda03b258a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:12.858026 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edae5df-96cb-487c-a46c-96eda03b258a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:12.858565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edae5df-96cb-487c-a46c-96eda03b258a None admin] PATH_INFO: `/v3/users/4bc99383f0994fc6a334772a8a487acd` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:12.885856 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edae5df-96cb-487c-a46c-96eda03b258a None admin] RBAC: Authorizing `identity:get_user(user_id=4bc99383f0994fc6a334772a8a487acd)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:12.888586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edae5df-96cb-487c-a46c-96eda03b258a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:12.895766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 126/243] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:12 2022] GET /identity/v3/users/4bc99383f0994fc6a334772a8a487acd => generated 297 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:12.902569 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598be498-f7f9-46ab-813a-1d4e7b5c807a None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:12.917100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af48754-9358-44c6-894e-90b484a21f7e None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:12.918184 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af48754-9358-44c6-894e-90b484a21f7e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:12.918184 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af48754-9358-44c6-894e-90b484a21f7e None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:12.919024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 127/244] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:50:12.929789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6a8e3-2f68-46e3-951b-3960884afe9f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:12.930222 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6a8e3-2f68-46e3-951b-3960884afe9f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:12.930591 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6a8e3-2f68-46e3-951b-3960884afe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:12.967960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-33f6a8e3-2f68-46e3-951b-3960884afe9f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:12.969188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-33f6a8e3-2f68-46e3-951b-3960884afe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:12.980184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:13.076253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:13.092435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 128/245] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:13.109669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598be498-f7f9-46ab-813a-1d4e7b5c807a None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:13.117223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6a8e3-2f68-46e3-951b-3960884afe9f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:13.162004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff11f9-7702-47fb-a00c-f43e1e5ee2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:13.162624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff11f9-7702-47fb-a00c-f43e1e5ee2be None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:13.162898 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff11f9-7702-47fb-a00c-f43e1e5ee2be None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:13.163171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff11f9-7702-47fb-a00c-f43e1e5ee2be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:13.272469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6a8e3-2f68-46e3-951b-3960884afe9f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:13.284753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff11f9-7702-47fb-a00c-f43e1e5ee2be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:13.287514 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff11f9-7702-47fb-a00c-f43e1e5ee2be None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:13.317002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:13.328364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb38d7-134c-4b9b-a5a5-67370158f2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:13.329023 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb38d7-134c-4b9b-a5a5-67370158f2ae None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:13.329304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb38d7-134c-4b9b-a5a5-67370158f2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:13.329575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb38d7-134c-4b9b-a5a5-67370158f2ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:13.347432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb38d7-134c-4b9b-a5a5-67370158f2ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-76eb38d7-134c-4b9b-a5a5-67370158f2ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:13.354320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:13.355300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:13.356093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:13.356093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:13.356093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:13.356093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:13.356093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:13.356093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:13.356093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:13.356093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:13.356093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:13.356093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:13.356093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:13.356093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:13.356093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 129/246] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:13.357222 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3654016-a5d3-4c2a-8901-e9313991c154 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:13.357316 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3654016-a5d3-4c2a-8901-e9313991c154 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:13.357524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3654016-a5d3-4c2a-8901-e9313991c154 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:13.363990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 130/247] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:13.364881 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3654016-a5d3-4c2a-8901-e9313991c154 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:13.441189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 118/248] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:13.447710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9bfc0-71a1-4e42-9f08-d0b75645201d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:13.448352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9bfc0-71a1-4e42-9f08-d0b75645201d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:13.449132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9bfc0-71a1-4e42-9f08-d0b75645201d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:13.450533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:13.473073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-56d9bfc0-71a1-4e42-9f08-d0b75645201d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:13.474830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-56d9bfc0-71a1-4e42-9f08-d0b75645201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:13.591421 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 119/249] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:13.592153 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9bfc0-71a1-4e42-9f08-d0b75645201d None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:13.604527 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3654016-a5d3-4c2a-8901-e9313991c154 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:13.672511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044df64-625b-4dde-b5b8-553c1339ee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:13.673157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044df64-625b-4dde-b5b8-553c1339ee03 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:13.673442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044df64-625b-4dde-b5b8-553c1339ee03 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:13.673718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044df64-625b-4dde-b5b8-553c1339ee03 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:13.674405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044df64-625b-4dde-b5b8-553c1339ee03 None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:13.674680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:13.674786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044df64-625b-4dde-b5b8-553c1339ee03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:13.676241 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044df64-625b-4dde-b5b8-553c1339ee03 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:13.691805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 131/250] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:13.692526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044df64-625b-4dde-b5b8-553c1339ee03 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:13.733729 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9bfc0-71a1-4e42-9f08-d0b75645201d None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:13.771713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7d41e-22da-424e-b72e-d7375a48b829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:13.772386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7d41e-22da-424e-b72e-d7375a48b829 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:13.773734 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7d41e-22da-424e-b72e-d7375a48b829 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:13.774011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7d41e-22da-424e-b72e-d7375a48b829 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:13.775191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7d41e-22da-424e-b72e-d7375a48b829 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:13.776823 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7d41e-22da-424e-b72e-d7375a48b829 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:13.778499 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 120/251] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:13 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:13.779314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7d41e-22da-424e-b72e-d7375a48b829 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:13.903331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7d41e-22da-424e-b72e-d7375a48b829 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:13.928450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:13.942425 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f6bb2-31a4-4aac-9f5e-27704890ff81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:13.943063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f6bb2-31a4-4aac-9f5e-27704890ff81 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:13.943347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f6bb2-31a4-4aac-9f5e-27704890ff81 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:13.943620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f6bb2-31a4-4aac-9f5e-27704890ff81 None admin] PATH_INFO: `/v3/users/e79c4f2a4b164708948e5b0b9b139415` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:13.945362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f6bb2-31a4-4aac-9f5e-27704890ff81 None admin] RBAC: Authorizing `identity:get_user(user_id=e79c4f2a4b164708948e5b0b9b139415)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:13.947410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f6bb2-31a4-4aac-9f5e-27704890ff81 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:13.949244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 121/252] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:13 2022] GET /identity/v3/users/e79c4f2a4b164708948e5b0b9b139415 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:13.950085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f6bb2-31a4-4aac-9f5e-27704890ff81 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:14.003464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044df64-625b-4dde-b5b8-553c1339ee03 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:14.041721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:14.077807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f6bb2-31a4-4aac-9f5e-27704890ff81 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:14.078047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05009fd9-a102-4002-a09b-e620674af6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:14.078598 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05009fd9-a102-4002-a09b-e620674af6ba None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:14.078888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05009fd9-a102-4002-a09b-e620674af6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:14.079435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05009fd9-a102-4002-a09b-e620674af6ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:14.093639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05009fd9-a102-4002-a09b-e620674af6ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-05009fd9-a102-4002-a09b-e620674af6ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:14.100503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:14.101416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:14.102942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:14.102942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:14.102942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:14.102942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:14.102942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:14.102942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:14.102942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:14.102942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:14.102942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:14.102942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:14.102942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:14.102942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:14.102942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 132/253] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:50:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:14.104886 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05009fd9-a102-4002-a09b-e620674af6ba None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:14.124707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9ce58-c2ae-4dec-ab51-d6a05554efbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:14.125606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9ce58-c2ae-4dec-ab51-d6a05554efbd None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:14.126410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9ce58-c2ae-4dec-ab51-d6a05554efbd None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:14.126688 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9ce58-c2ae-4dec-ab51-d6a05554efbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:14.127780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9ce58-c2ae-4dec-ab51-d6a05554efbd None admin] RBAC: Adding query filter params (role.id=199c92884fb24ba2ac1498b774df4a0b, scope.project.id=a7c2c4a65c044df4afad820df6582f3e, user.id=4bc99383f0994fc6a334772a8a487acd) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:14.128096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9ce58-c2ae-4dec-ab51-d6a05554efbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:14.130167 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9ce58-c2ae-4dec-ab51-d6a05554efbd None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:14.138182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 122/254] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:13 2022] GET /identity/v3/role_assignments?user.id=4bc99383f0994fc6a334772a8a487acd&scope.project.id=a7c2c4a65c044df4afad820df6582f3e&role.id=199c92884fb24ba2ac1498b774df4a0b => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:14.139424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeefc05-80b7-4822-8293-f1f388ba4215 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:14.139880 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeefc05-80b7-4822-8293-f1f388ba4215 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:14.140162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeefc05-80b7-4822-8293-f1f388ba4215 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:14.141758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 123/255] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:14.142543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeefc05-80b7-4822-8293-f1f388ba4215 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:14.208207 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:14.263878 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeefc05-80b7-4822-8293-f1f388ba4215 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:14.304943 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c19c5-3886-4fd3-99ec-b818c0c3b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:14.305697 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c19c5-3886-4fd3-99ec-b818c0c3b5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:14.305895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c19c5-3886-4fd3-99ec-b818c0c3b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:14.306178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c19c5-3886-4fd3-99ec-b818c0c3b5d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:14.306862 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c19c5-3886-4fd3-99ec-b818c0c3b5d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:14.307282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c19c5-3886-4fd3-99ec-b818c0c3b5d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:14.308910 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c19c5-3886-4fd3-99ec-b818c0c3b5d2 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:14.318854 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 124/256] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:14.320595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da93b1f-0f81-47fc-9997-01c935e34875 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:14.320838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da93b1f-0f81-47fc-9997-01c935e34875 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:14.321111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da93b1f-0f81-47fc-9997-01c935e34875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:14.341418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-6da93b1f-0f81-47fc-9997-01c935e34875 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:14.342642 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6da93b1f-0f81-47fc-9997-01c935e34875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:14.358750 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05009fd9-a102-4002-a09b-e620674af6ba None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:14.410691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb4d4e-5235-4c09-a165-60eacdc9cb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:14.411334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb4d4e-5235-4c09-a165-60eacdc9cb1e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:14.411616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb4d4e-5235-4c09-a165-60eacdc9cb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:14.411919 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb4d4e-5235-4c09-a165-60eacdc9cb1e None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:14.413702 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb4d4e-5235-4c09-a165-60eacdc9cb1e None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:14.415173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb4d4e-5235-4c09-a165-60eacdc9cb1e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:14.417018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 133/257] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:14 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:14.417636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb4d4e-5235-4c09-a165-60eacdc9cb1e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:14.436521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 125/258] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:14.437878 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da93b1f-0f81-47fc-9997-01c935e34875 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:14.467780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:14.500109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:14.570110 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da93b1f-0f81-47fc-9997-01c935e34875 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:14.597709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb4d4e-5235-4c09-a165-60eacdc9cb1e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:14.612741 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2099b5-68c9-442c-be83-6466c099c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:14.613687 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2099b5-68c9-442c-be83-6466c099c330 None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:14.614109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2099b5-68c9-442c-be83-6466c099c330 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:14.614546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2099b5-68c9-442c-be83-6466c099c330 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e/users/e79c4f2a4b164708948e5b0b9b139415/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:14.616692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2099b5-68c9-442c-be83-6466c099c330 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7c2c4a65c044df4afad820df6582f3e, user_id=e79c4f2a4b164708948e5b0b9b139415, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:14.618973 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2099b5-68c9-442c-be83-6466c099c330 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:14.634868 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 126/259] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:50:14 2022] PUT /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e/users/e79c4f2a4b164708948e5b0b9b139415/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:50:14.636562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2099b5-68c9-442c-be83-6466c099c330 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:14.676457 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524dce1-e8d9-4664-8bf7-69cddaba86ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:14.677224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524dce1-e8d9-4664-8bf7-69cddaba86ca None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:14.677510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524dce1-e8d9-4664-8bf7-69cddaba86ca None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:14.677846 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524dce1-e8d9-4664-8bf7-69cddaba86ca None admin] PATH_INFO: `/v3/users/1ca9654c8faa401dac9fae1bef60cca6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:14.680432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524dce1-e8d9-4664-8bf7-69cddaba86ca None admin] RBAC: Authorizing `identity:get_user(user_id=1ca9654c8faa401dac9fae1bef60cca6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:14.682028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524dce1-e8d9-4664-8bf7-69cddaba86ca None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:14.684205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 134/260] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:14 2022] GET /identity/v3/users/1ca9654c8faa401dac9fae1bef60cca6 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:14.706361 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524dce1-e8d9-4664-8bf7-69cddaba86ca None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:14.775228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2099b5-68c9-442c-be83-6466c099c330 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:14.777403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:14.857441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b91ed2-5a98-49ce-807b-b751d6e907f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:14.858134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b91ed2-5a98-49ce-807b-b751d6e907f7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:14.858391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b91ed2-5a98-49ce-807b-b751d6e907f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:14.858669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b91ed2-5a98-49ce-807b-b751d6e907f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:14.884487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524dce1-e8d9-4664-8bf7-69cddaba86ca None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:14.896125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:14.900524 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b91ed2-5a98-49ce-807b-b751d6e907f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-d5b91ed2-5a98-49ce-807b-b751d6e907f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:14.906132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:14.907075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:14.907892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:14.907892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:14.907892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:14.907892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:14.907892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:14.907892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:14.907892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:14.907892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:14.907892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:14.907892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:14.907892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:14.907892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:14.907892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 127/261] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:50:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:14.918875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b91ed2-5a98-49ce-807b-b751d6e907f7 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:14.955473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869cdb2-7fb8-4aeb-9dd2-4a33cffbfe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:14.956138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869cdb2-7fb8-4aeb-9dd2-4a33cffbfe65 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:14.956427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869cdb2-7fb8-4aeb-9dd2-4a33cffbfe65 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:14.956703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869cdb2-7fb8-4aeb-9dd2-4a33cffbfe65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:15.070672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869cdb2-7fb8-4aeb-9dd2-4a33cffbfe65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:15.072146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869cdb2-7fb8-4aeb-9dd2-4a33cffbfe65 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:15.110606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b91ed2-5a98-49ce-807b-b751d6e907f7 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:15.172547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dea76d-a740-4191-99b3-516039bf7a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:15.173186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dea76d-a740-4191-99b3-516039bf7a36 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:15.173470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dea76d-a740-4191-99b3-516039bf7a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:15.173744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dea76d-a740-4191-99b3-516039bf7a36 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:15.174437 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dea76d-a740-4191-99b3-516039bf7a36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:15.174738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dea76d-a740-4191-99b3-516039bf7a36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:15.176148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dea76d-a740-4191-99b3-516039bf7a36 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:15.185862 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 128/262] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:15.193889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dea76d-a740-4191-99b3-516039bf7a36 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:15.203177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 135/263] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 07:50:15.209055 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869cdb2-7fb8-4aeb-9dd2-4a33cffbfe65 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:15.224122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:15.231795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:15.305673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dea76d-a740-4191-99b3-516039bf7a36 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:15.341949 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466ba38-8a2a-4ca5-bff0-df552eb3b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:15.342475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ba38-8a2a-4ca5-bff0-df552eb3b738 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:15.342754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ba38-8a2a-4ca5-bff0-df552eb3b738 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:15.343025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ba38-8a2a-4ca5-bff0-df552eb3b738 None admin] PATH_INFO: `/v3/users/1ca9654c8faa401dac9fae1bef60cca6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:15.344259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466ba38-8a2a-4ca5-bff0-df552eb3b738 None admin] RBAC: Authorizing `identity:get_user(user_id=1ca9654c8faa401dac9fae1bef60cca6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:15.345831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466ba38-8a2a-4ca5-bff0-df552eb3b738 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:15.351752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 129/264] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:15 2022] GET /identity/v3/users/1ca9654c8faa401dac9fae1bef60cca6 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:15.353370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466ba38-8a2a-4ca5-bff0-df552eb3b738 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:15.396802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869cdb2-7fb8-4aeb-9dd2-4a33cffbfe65 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:15.437224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8977a5-e9e9-473c-95ab-510c1805391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:15.438310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8977a5-e9e9-473c-95ab-510c1805391b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:15.438802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8977a5-e9e9-473c-95ab-510c1805391b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:15.439328 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8977a5-e9e9-473c-95ab-510c1805391b None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:15.440810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8977a5-e9e9-473c-95ab-510c1805391b None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:15.442659 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8977a5-e9e9-473c-95ab-510c1805391b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:15.445670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 136/265] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:15 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:15.452744 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8977a5-e9e9-473c-95ab-510c1805391b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:15.456627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:15.475266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466ba38-8a2a-4ca5-bff0-df552eb3b738 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:15.537941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96098808-c4a9-4ae2-888e-a3488d96f4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:15.538605 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96098808-c4a9-4ae2-888e-a3488d96f4ec None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:15.538890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96098808-c4a9-4ae2-888e-a3488d96f4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:15.539164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96098808-c4a9-4ae2-888e-a3488d96f4ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:15.581870 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:15.628657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8977a5-e9e9-473c-95ab-510c1805391b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:15.676558 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96098808-c4a9-4ae2-888e-a3488d96f4ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:15.678044 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96098808-c4a9-4ae2-888e-a3488d96f4ec None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:15.712597 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea198a01-7826-4f34-8b90-0e7d6dfe2847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:15.713630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea198a01-7826-4f34-8b90-0e7d6dfe2847 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:15.714112 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea198a01-7826-4f34-8b90-0e7d6dfe2847 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:15.714581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea198a01-7826-4f34-8b90-0e7d6dfe2847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:15.715522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea198a01-7826-4f34-8b90-0e7d6dfe2847 None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=a7c2c4a65c044df4afad820df6582f3e, user.id=1ca9654c8faa401dac9fae1bef60cca6) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:15.716076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea198a01-7826-4f34-8b90-0e7d6dfe2847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:15.717787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea198a01-7826-4f34-8b90-0e7d6dfe2847 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:15.734046 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 137/266] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:15 2022] GET /identity/v3/role_assignments?user.id=1ca9654c8faa401dac9fae1bef60cca6&scope.project.id=a7c2c4a65c044df4afad820df6582f3e&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:15.828215 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:15.845582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 130/267] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:15.851503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea198a01-7826-4f34-8b90-0e7d6dfe2847 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:15.925052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fa2e1-8d0f-45c3-8e5a-23781f05bc8a None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:15.925739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fa2e1-8d0f-45c3-8e5a-23781f05bc8a None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:15.926029 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fa2e1-8d0f-45c3-8e5a-23781f05bc8a None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:15.928503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 131/268] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:15.934135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae96f70-daea-4f5d-9085-ea52e20e5792 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:15.934427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae96f70-daea-4f5d-9085-ea52e20e5792 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:15.934699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae96f70-daea-4f5d-9085-ea52e20e5792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:15.957293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-fae96f70-daea-4f5d-9085-ea52e20e5792 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:15.958542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-fae96f70-daea-4f5d-9085-ea52e20e5792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:16.046850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 132/269] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:16.074045 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae96f70-daea-4f5d-9085-ea52e20e5792 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:16.098828 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea198a01-7826-4f34-8b90-0e7d6dfe2847 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:16.163024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bd81a-fa90-419a-9927-ec40699e516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:16.163863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bd81a-fa90-419a-9927-ec40699e516c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:16.164150 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bd81a-fa90-419a-9927-ec40699e516c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:16.164431 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bd81a-fa90-419a-9927-ec40699e516c None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:16.165699 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bd81a-fa90-419a-9927-ec40699e516c None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:16.167361 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bd81a-fa90-419a-9927-ec40699e516c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:16.170020 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 138/270] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:15 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:16.171407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06e1d4-c1a9-4a60-b1c5-4e6ea8477325 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:16.171696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06e1d4-c1a9-4a60-b1c5-4e6ea8477325 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:16.172000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06e1d4-c1a9-4a60-b1c5-4e6ea8477325 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:16.173707 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 139/271] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:16.179326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06e1d4-c1a9-4a60-b1c5-4e6ea8477325 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:16.192911 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:16.209808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae96f70-daea-4f5d-9085-ea52e20e5792 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:16.234378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:16.250751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9a120-f44c-4a76-b52a-382de9dc9cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:16.251385 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9a120-f44c-4a76-b52a-382de9dc9cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:16.251669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9a120-f44c-4a76-b52a-382de9dc9cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:16.251986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9a120-f44c-4a76-b52a-382de9dc9cd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:16.263599 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9a120-f44c-4a76-b52a-382de9dc9cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-7ea9a120-f44c-4a76-b52a-382de9dc9cd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:16.268666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:16.270835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 133/272] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:16.273537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d244f-20c4-46b3-a0eb-6ce3f04a37be None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:16.275508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d244f-20c4-46b3-a0eb-6ce3f04a37be None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:16.275508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d244f-20c4-46b3-a0eb-6ce3f04a37be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:16.291277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d22d244f-20c4-46b3-a0eb-6ce3f04a37be None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:16.292654 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d22d244f-20c4-46b3-a0eb-6ce3f04a37be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:16.309595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06e1d4-c1a9-4a60-b1c5-4e6ea8477325 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:16.353384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ae085-abbe-43c4-b99c-d8524901c860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:16.354008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ae085-abbe-43c4-b99c-d8524901c860 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:16.354356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ae085-abbe-43c4-b99c-d8524901c860 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:16.354636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ae085-abbe-43c4-b99c-d8524901c860 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:16.356029 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ae085-abbe-43c4-b99c-d8524901c860 None admin] RBAC: Adding query filter params (role.id=a5a6c597145c4b23983d1b04377af7ed, scope.project.id=a7c2c4a65c044df4afad820df6582f3e, user.id=1ca9654c8faa401dac9fae1bef60cca6) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:16.356845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ae085-abbe-43c4-b99c-d8524901c860 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:16.358594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ae085-abbe-43c4-b99c-d8524901c860 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:16.365798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 140/273] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:16 2022] GET /identity/v3/role_assignments?user.id=1ca9654c8faa401dac9fae1bef60cca6&scope.project.id=a7c2c4a65c044df4afad820df6582f3e&role.id=a5a6c597145c4b23983d1b04377af7ed => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:16.367348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ae085-abbe-43c4-b99c-d8524901c860 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:16.368443 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 134/274] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:16.396996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d244f-20c4-46b3-a0eb-6ce3f04a37be None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:16.451412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:16.491823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ae085-abbe-43c4-b99c-d8524901c860 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:16.513961 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d244f-20c4-46b3-a0eb-6ce3f04a37be None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:16.530218 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:16.533542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290cc81-59f4-429a-abe8-2cb57af253e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:16.534280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290cc81-59f4-429a-abe8-2cb57af253e5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:16.534681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290cc81-59f4-429a-abe8-2cb57af253e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:16.535460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290cc81-59f4-429a-abe8-2cb57af253e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:16.536399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290cc81-59f4-429a-abe8-2cb57af253e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:16.536712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290cc81-59f4-429a-abe8-2cb57af253e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:16.538995 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290cc81-59f4-429a-abe8-2cb57af253e5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:16.549138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 141/275] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:16.556220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290cc81-59f4-429a-abe8-2cb57af253e5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:16.556799 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439d830-c675-4abe-94f9-0d645561d9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:16.557456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d830-c675-4abe-94f9-0d645561d9bb None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:16.557740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d830-c675-4abe-94f9-0d645561d9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:16.558017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d830-c675-4abe-94f9-0d645561d9bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:16.559316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439d830-c675-4abe-94f9-0d645561d9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:16.560961 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439d830-c675-4abe-94f9-0d645561d9bb None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:16.562868 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 135/276] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:16.569368 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439d830-c675-4abe-94f9-0d645561d9bb None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:16.699930 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439d830-c675-4abe-94f9-0d645561d9bb None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:16.716487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290cc81-59f4-429a-abe8-2cb57af253e5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:16.739810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5109ad-e8a7-4c33-91f3-480250deeb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:16.740925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5109ad-e8a7-4c33-91f3-480250deeb40 None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:16.741214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5109ad-e8a7-4c33-91f3-480250deeb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:16.742101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5109ad-e8a7-4c33-91f3-480250deeb40 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:16.742958 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5109ad-e8a7-4c33-91f3-480250deeb40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:16.744491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5109ad-e8a7-4c33-91f3-480250deeb40 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:16.771975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefef52-bdc8-4f38-adf3-1a7cc7ba6a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:16.773447 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefef52-bdc8-4f38-adf3-1a7cc7ba6a0d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:16.773909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefef52-bdc8-4f38-adf3-1a7cc7ba6a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:16.774352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefef52-bdc8-4f38-adf3-1a7cc7ba6a0d None admin] PATH_INFO: `/v3/users/0cac7de8ae8a4c79ac514cb2771f1730` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:16.774983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 136/277] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:50:16 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:50:16.779351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:16.806658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefef52-bdc8-4f38-adf3-1a7cc7ba6a0d None admin] RBAC: Authorizing `identity:get_user(user_id=0cac7de8ae8a4c79ac514cb2771f1730)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:16.809328 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefef52-bdc8-4f38-adf3-1a7cc7ba6a0d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:16.812750 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 142/278] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:16 2022] GET /identity/v3/users/0cac7de8ae8a4c79ac514cb2771f1730 => generated 293 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:16.821588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5109ad-e8a7-4c33-91f3-480250deeb40 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:16.866968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:16.948748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5109ad-e8a7-4c33-91f3-480250deeb40 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:16.999377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712956f5-ba37-4743-b2c6-09c4023691b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:17.000388 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712956f5-ba37-4743-b2c6-09c4023691b0 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:17.000893 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712956f5-ba37-4743-b2c6-09c4023691b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:17.001404 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712956f5-ba37-4743-b2c6-09c4023691b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:17.002798 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712956f5-ba37-4743-b2c6-09c4023691b0 None admin] RBAC: Adding query filter params (role.id=9d10ee7e27e242ba801222cf0264ea8d, user.id=0cac7de8ae8a4c79ac514cb2771f1730, scope.system=all) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:17.003422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712956f5-ba37-4743-b2c6-09c4023691b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:17.005991 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712956f5-ba37-4743-b2c6-09c4023691b0 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:17.016373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 137/279] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Aug 10 07:50:16 2022] GET /identity/v3/role_assignments?user.id=0cac7de8ae8a4c79ac514cb2771f1730&scope.system=all&role.id=9d10ee7e27e242ba801222cf0264ea8d => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:17.361092 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe61a0-1451-4cd0-aa11-2a108867bbe3 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:17.361940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe61a0-1451-4cd0-aa11-2a108867bbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:17.362378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe61a0-1451-4cd0-aa11-2a108867bbe3 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:17.364309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 143/280] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:17.369831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f53e6-0174-4d00-8d72-40686e2f3e73 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:17.370709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f53e6-0174-4d00-8d72-40686e2f3e73 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:17.371217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f53e6-0174-4d00-8d72-40686e2f3e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:17.397300 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-858f53e6-0174-4d00-8d72-40686e2f3e73 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:17.398576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-858f53e6-0174-4d00-8d72-40686e2f3e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:17.515832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 138/281] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:17.548172 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe61a0-1451-4cd0-aa11-2a108867bbe3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:17.675289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe61a0-1451-4cd0-aa11-2a108867bbe3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:17.727191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d74d1-e480-46ba-a1ef-a51682de504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:17.727870 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d74d1-e480-46ba-a1ef-a51682de504f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:17.728152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d74d1-e480-46ba-a1ef-a51682de504f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:17.728421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d74d1-e480-46ba-a1ef-a51682de504f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:17.747218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d74d1-e480-46ba-a1ef-a51682de504f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-236d74d1-e480-46ba-a1ef-a51682de504f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:17.752036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:17.753710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:17.755243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:17.755243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:17.755243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:17.755243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:17.755243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:17.755243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:17.755243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:17.755243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:17.755243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:17.755243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:17.755243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:17.755243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:17.755243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 144/282] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:17.761912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f53e6-0174-4d00-8d72-40686e2f3e73 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:17.814786 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:17.905103 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe83f4-f0ef-48bc-af7e-144bad242873 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:17.905734 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe83f4-f0ef-48bc-af7e-144bad242873 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:17.906213 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe83f4-f0ef-48bc-af7e-144bad242873 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:17.908752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 145/283] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:50:17.915806 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5a428-d72e-4d9a-b4ab-2e10400f8781 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:17.917057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5a428-d72e-4d9a-b4ab-2e10400f8781 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:17.917541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5a428-d72e-4d9a-b4ab-2e10400f8781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:17.938744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f53e6-0174-4d00-8d72-40686e2f3e73 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:17.960145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1cb5a428-d72e-4d9a-b4ab-2e10400f8781 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:17.961363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1cb5a428-d72e-4d9a-b4ab-2e10400f8781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:17.987354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadba47-9c0b-4ff7-9003-e2f3bfebf42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:17.988007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadba47-9c0b-4ff7-9003-e2f3bfebf42d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:17.988495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadba47-9c0b-4ff7-9003-e2f3bfebf42d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:17.988782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadba47-9c0b-4ff7-9003-e2f3bfebf42d None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:17.989470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadba47-9c0b-4ff7-9003-e2f3bfebf42d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:17.990064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadba47-9c0b-4ff7-9003-e2f3bfebf42d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:17.991943 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadba47-9c0b-4ff7-9003-e2f3bfebf42d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:18.002574 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 139/284] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:18.011768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadba47-9c0b-4ff7-9003-e2f3bfebf42d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:18.067290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:18.106506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 146/285] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:18.145124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:18.145786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5a428-d72e-4d9a-b4ab-2e10400f8781 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:18.161237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadba47-9c0b-4ff7-9003-e2f3bfebf42d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:18.217768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cc3f1-a518-48e0-b93f-080e79c51c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:18.218328 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cc3f1-a518-48e0-b93f-080e79c51c57 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:18.218614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cc3f1-a518-48e0-b93f-080e79c51c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:18.218894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cc3f1-a518-48e0-b93f-080e79c51c57 None admin] PATH_INFO: `/v3/users/4bc99383f0994fc6a334772a8a487acd` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:18.224137 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cc3f1-a518-48e0-b93f-080e79c51c57 None admin] RBAC: Authorizing `identity:get_user(user_id=4bc99383f0994fc6a334772a8a487acd)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:18.225620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cc3f1-a518-48e0-b93f-080e79c51c57 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:18.227650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 140/286] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:18 2022] GET /identity/v3/users/4bc99383f0994fc6a334772a8a487acd => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:18.237600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cc3f1-a518-48e0-b93f-080e79c51c57 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:18.263304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5a428-d72e-4d9a-b4ab-2e10400f8781 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:18.306542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04df84-1223-4025-8e3d-6c18eab1de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:18.307432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04df84-1223-4025-8e3d-6c18eab1de84 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:18.307913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04df84-1223-4025-8e3d-6c18eab1de84 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:18.308322 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04df84-1223-4025-8e3d-6c18eab1de84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:18.322298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04df84-1223-4025-8e3d-6c18eab1de84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-7a04df84-1223-4025-8e3d-6c18eab1de84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:18.328143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:18.329205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:18.330053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:18.330053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:18.330053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:18.330053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:18.330053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:18.330053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:18.330053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:18.330053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:18.330053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:18.330053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:18.330053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:18.330053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:18.340379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 147/287] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:18.345759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04df84-1223-4025-8e3d-6c18eab1de84 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:18.370087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cc3f1-a518-48e0-b93f-080e79c51c57 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:18.440094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a6010-41b4-4529-8bfe-0522bf6a2d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:18.440750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a6010-41b4-4529-8bfe-0522bf6a2d5b None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:18.441036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a6010-41b4-4529-8bfe-0522bf6a2d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:18.441312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a6010-41b4-4529-8bfe-0522bf6a2d5b None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:18.442597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a6010-41b4-4529-8bfe-0522bf6a2d5b None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:18.444077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a6010-41b4-4529-8bfe-0522bf6a2d5b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:18.447682 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:18.448419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 141/288] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:18 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:18.452135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a6010-41b4-4529-8bfe-0522bf6a2d5b None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:18.507094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:18.584412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a6010-41b4-4529-8bfe-0522bf6a2d5b None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:18.616023 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04df84-1223-4025-8e3d-6c18eab1de84 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:18.625481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8718e-987d-48e7-ad8d-a82ef3e86885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:18.626166 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8718e-987d-48e7-ad8d-a82ef3e86885 None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:18.626456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8718e-987d-48e7-ad8d-a82ef3e86885 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:18.626737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8718e-987d-48e7-ad8d-a82ef3e86885 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e/users/4bc99383f0994fc6a334772a8a487acd/roles/199c92884fb24ba2ac1498b774df4a0b` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:18.628807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8718e-987d-48e7-ad8d-a82ef3e86885 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7c2c4a65c044df4afad820df6582f3e, user_id=4bc99383f0994fc6a334772a8a487acd, role_id=199c92884fb24ba2ac1498b774df4a0b)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:18.630284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8718e-987d-48e7-ad8d-a82ef3e86885 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:18.646484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 142/289] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:50:18 2022] PUT /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e/users/4bc99383f0994fc6a334772a8a487acd/roles/199c92884fb24ba2ac1498b774df4a0b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:50:18.713701 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421afd-c05e-49b2-ac30-5ca4dacbdef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:18.714549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421afd-c05e-49b2-ac30-5ca4dacbdef3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:18.714836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421afd-c05e-49b2-ac30-5ca4dacbdef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:18.715115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421afd-c05e-49b2-ac30-5ca4dacbdef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:18.715849 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd421afd-c05e-49b2-ac30-5ca4dacbdef3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:18.716160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd421afd-c05e-49b2-ac30-5ca4dacbdef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:18.717656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd421afd-c05e-49b2-ac30-5ca4dacbdef3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:18.732252 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 148/290] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:18.740896 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8718e-987d-48e7-ad8d-a82ef3e86885 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:18.888140 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:18.908744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8718e-987d-48e7-ad8d-a82ef3e86885 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:18.957164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7627da-1450-4890-9be2-a9111401e0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:18.957825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7627da-1450-4890-9be2-a9111401e0af None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:18.958108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7627da-1450-4890-9be2-a9111401e0af None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:18.958378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7627da-1450-4890-9be2-a9111401e0af None admin] PATH_INFO: `/v3/users/e79c4f2a4b164708948e5b0b9b139415` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:18.959623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7627da-1450-4890-9be2-a9111401e0af None admin] RBAC: Authorizing `identity:get_user(user_id=e79c4f2a4b164708948e5b0b9b139415)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:18.961296 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7627da-1450-4890-9be2-a9111401e0af None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:18.962965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 143/291] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:18 2022] GET /identity/v3/users/e79c4f2a4b164708948e5b0b9b139415 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:18.970625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421afd-c05e-49b2-ac30-5ca4dacbdef3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:19.153463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421afd-c05e-49b2-ac30-5ca4dacbdef3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:19.161136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:19.233192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13240bc-2e84-4663-bdf4-15641227b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:19.233822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13240bc-2e84-4663-bdf4-15641227b732 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:19.234100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13240bc-2e84-4663-bdf4-15641227b732 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:19.234363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13240bc-2e84-4663-bdf4-15641227b732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:19.340700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13240bc-2e84-4663-bdf4-15641227b732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:19.342195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13240bc-2e84-4663-bdf4-15641227b732 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:19.472995 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 149/292] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:19.479902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7627da-1450-4890-9be2-a9111401e0af None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:19.682911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7627da-1450-4890-9be2-a9111401e0af None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:19.757379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbad94f-39e4-44e7-b41e-75de7465b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:19.758243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbad94f-39e4-44e7-b41e-75de7465b0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:19.758651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbad94f-39e4-44e7-b41e-75de7465b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:19.759034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbad94f-39e4-44e7-b41e-75de7465b0d7 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:19.760767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbad94f-39e4-44e7-b41e-75de7465b0d7 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:19.762846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbad94f-39e4-44e7-b41e-75de7465b0d7 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:19.765307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 144/293] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:19 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:19.774268 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13240bc-2e84-4663-bdf4-15641227b732 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:19.779173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:19.782581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd140-c811-425c-9341-06d9359bfa49 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:19.783019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd140-c811-425c-9341-06d9359bfa49 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:19.783568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd140-c811-425c-9341-06d9359bfa49 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:19.786587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 145/294] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:19.798045 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c088fb-793e-405d-b078-464b320b938d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:19.798480 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c088fb-793e-405d-b078-464b320b938d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:19.798903 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c088fb-793e-405d-b078-464b320b938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:19.827204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-96c088fb-793e-405d-b078-464b320b938d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:19.828437 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-96c088fb-793e-405d-b078-464b320b938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:19.872213 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:19.990609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13240bc-2e84-4663-bdf4-15641227b732 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:19.998634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 146/295] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:20.009422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a710-2920-4dff-a080-294a5899ae4a None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:20.009598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a710-2920-4dff-a080-294a5899ae4a None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:20.009999 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a710-2920-4dff-a080-294a5899ae4a None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:20.011793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 147/296] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:20.013155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07c369-091d-4502-8ddb-efdf2aecd7e0 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:20.013515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07c369-091d-4502-8ddb-efdf2aecd7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:20.013859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07c369-091d-4502-8ddb-efdf2aecd7e0 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:20.015534 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 148/297] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:20.021601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb837a2-9c1a-4a90-a491-756876e452f0 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:20.021908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb837a2-9c1a-4a90-a491-756876e452f0 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:20.022158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb837a2-9c1a-4a90-a491-756876e452f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:20.041245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-fbb837a2-9c1a-4a90-a491-756876e452f0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:20.042480 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-fbb837a2-9c1a-4a90-a491-756876e452f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:20.057068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41953fc5-ed0b-4e3b-8501-ca5d2d1558c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:20.057813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41953fc5-ed0b-4e3b-8501-ca5d2d1558c2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:20.058098 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41953fc5-ed0b-4e3b-8501-ca5d2d1558c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:20.058528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41953fc5-ed0b-4e3b-8501-ca5d2d1558c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:20.059136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41953fc5-ed0b-4e3b-8501-ca5d2d1558c2 None admin] RBAC: Adding query filter params (role.id=9d10ee7e27e242ba801222cf0264ea8d, scope.project.id=a7c2c4a65c044df4afad820df6582f3e, user.id=e79c4f2a4b164708948e5b0b9b139415) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:20.059453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41953fc5-ed0b-4e3b-8501-ca5d2d1558c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:20.061118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41953fc5-ed0b-4e3b-8501-ca5d2d1558c2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:20.079773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 150/298] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:19 2022] GET /identity/v3/role_assignments?user.id=e79c4f2a4b164708948e5b0b9b139415&scope.project.id=a7c2c4a65c044df4afad820df6582f3e&role.id=9d10ee7e27e242ba801222cf0264ea8d => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:20.079773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41953fc5-ed0b-4e3b-8501-ca5d2d1558c2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:20.163917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 149/299] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:20.174769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3a971-5f86-439e-bdbd-c5170b82ce1e None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:20.175271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3a971-5f86-439e-bdbd-c5170b82ce1e None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:20.175787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3a971-5f86-439e-bdbd-c5170b82ce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:20.200287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:20.230883 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-63a3a971-5f86-439e-bdbd-c5170b82ce1e None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:20.232293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-63a3a971-5f86-439e-bdbd-c5170b82ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:20.264844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41953fc5-ed0b-4e3b-8501-ca5d2d1558c2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:20.313958 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3feed8-70b5-482b-b08c-03ee238c520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:20.314614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3feed8-70b5-482b-b08c-03ee238c520b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:20.315046 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3feed8-70b5-482b-b08c-03ee238c520b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:20.315466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3feed8-70b5-482b-b08c-03ee238c520b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:20.318936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3feed8-70b5-482b-b08c-03ee238c520b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:20.322326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3feed8-70b5-482b-b08c-03ee238c520b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:20.326033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 151/300] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:20.327397 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3feed8-70b5-482b-b08c-03ee238c520b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:20.329261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 150/301] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:20.332244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3a971-5f86-439e-bdbd-c5170b82ce1e None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:20.355228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:20.456625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3feed8-70b5-482b-b08c-03ee238c520b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:20.481269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3a971-5f86-439e-bdbd-c5170b82ce1e None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:20.493202 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22aabb-a28d-408d-878d-a7caecd699dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:20.493861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22aabb-a28d-408d-878d-a7caecd699dd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:20.494363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22aabb-a28d-408d-878d-a7caecd699dd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:20.494363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22aabb-a28d-408d-878d-a7caecd699dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:20.497934 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:20.507775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22aabb-a28d-408d-878d-a7caecd699dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-9f22aabb-a28d-408d-878d-a7caecd699dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:20.513741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:20.514619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:20.515435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:20.515435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:20.515435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:20.515435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:20.515435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:20.515435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:20.515435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:20.515435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:20.515435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:20.515435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:20.515435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:20.515435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:20.515435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 152/302] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:20.516818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22aabb-a28d-408d-878d-a7caecd699dd None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:20.523960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d67e8-853a-4a16-85e9-04553e29a409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:20.524603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d67e8-853a-4a16-85e9-04553e29a409 None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:20.524882 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d67e8-853a-4a16-85e9-04553e29a409 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:20.525152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d67e8-853a-4a16-85e9-04553e29a409 None admin] PATH_INFO: `/v3/groups` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:20.525778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d67e8-853a-4a16-85e9-04553e29a409 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:20.527634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d67e8-853a-4a16-85e9-04553e29a409 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:20.549478 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 151/303] 10.222.0.30 () {60 vars in 1134 bytes} [Wed Aug 10 07:50:20 2022] POST /identity/v3/groups => generated 229 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:50:20.550731 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d67e8-853a-4a16-85e9-04553e29a409 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:20.677223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22aabb-a28d-408d-878d-a7caecd699dd None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:20.700090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:20.735401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf015ed5-9f31-4bb4-abdb-3b69897b3a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:20.736110 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf015ed5-9f31-4bb4-abdb-3b69897b3a80 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:20.736396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf015ed5-9f31-4bb4-abdb-3b69897b3a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:20.736736 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf015ed5-9f31-4bb4-abdb-3b69897b3a80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:20.748270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d67e8-853a-4a16-85e9-04553e29a409 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:20.751950 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf015ed5-9f31-4bb4-abdb-3b69897b3a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-cf015ed5-9f31-4bb4-abdb-3b69897b3a80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:20.761825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:20.762964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:20.764256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:20.764256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:20.764256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:20.764256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:20.764256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:20.764256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:20.764256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:20.764256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:20.764256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:20.764256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:20.764256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:20.764256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:20.764256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 153/304] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:20.769529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf015ed5-9f31-4bb4-abdb-3b69897b3a80 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:20.800393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be682c8-9476-4d5e-bcc3-9e9fb891499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:20.801024 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be682c8-9476-4d5e-bcc3-9e9fb891499d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:20.801312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be682c8-9476-4d5e-bcc3-9e9fb891499d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:20.801592 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be682c8-9476-4d5e-bcc3-9e9fb891499d None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:20.802283 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be682c8-9476-4d5e-bcc3-9e9fb891499d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:20.802600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be682c8-9476-4d5e-bcc3-9e9fb891499d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:20.804816 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be682c8-9476-4d5e-bcc3-9e9fb891499d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:20.817626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 152/305] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:20.824555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be682c8-9476-4d5e-bcc3-9e9fb891499d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:20.841180 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:20.934528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf015ed5-9f31-4bb4-abdb-3b69897b3a80 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:20.986213 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2253dda-d47b-4f2e-84a2-25bf1764ad71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:20.987448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2253dda-d47b-4f2e-84a2-25bf1764ad71 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:20.988504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2253dda-d47b-4f2e-84a2-25bf1764ad71 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:20.989037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2253dda-d47b-4f2e-84a2-25bf1764ad71 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:20.990235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2253dda-d47b-4f2e-84a2-25bf1764ad71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:20.990785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2253dda-d47b-4f2e-84a2-25bf1764ad71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:20.993391 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2253dda-d47b-4f2e-84a2-25bf1764ad71 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:21.000021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be682c8-9476-4d5e-bcc3-9e9fb891499d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:21.005258 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 154/306] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:21.015438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2253dda-d47b-4f2e-84a2-25bf1764ad71 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:21.061377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7b8a3-f7b3-41a0-a417-9fca68516d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:21.061941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b8a3-f7b3-41a0-a417-9fca68516d65 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:21.062221 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b8a3-f7b3-41a0-a417-9fca68516d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:21.062676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b8a3-f7b3-41a0-a417-9fca68516d65 None admin] PATH_INFO: `/v3/users/f6915c73e9a94bd9817bdfcc39b08a0d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:21.067048 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:21.081327 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7b8a3-f7b3-41a0-a417-9fca68516d65 None admin] RBAC: Authorizing `identity:get_user(user_id=f6915c73e9a94bd9817bdfcc39b08a0d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:21.084254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7b8a3-f7b3-41a0-a417-9fca68516d65 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:21.087771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 153/307] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:20 2022] GET /identity/v3/users/f6915c73e9a94bd9817bdfcc39b08a0d => generated 293 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:21.097606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7b8a3-f7b3-41a0-a417-9fca68516d65 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:21.158789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2253dda-d47b-4f2e-84a2-25bf1764ad71 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:21.179112 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:21.201349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a676895-8cee-4a70-84ae-eb75293bbcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:21.202414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a676895-8cee-4a70-84ae-eb75293bbcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:21.202913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a676895-8cee-4a70-84ae-eb75293bbcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:21.203392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a676895-8cee-4a70-84ae-eb75293bbcb1 None admin] PATH_INFO: `/v3/users/0cac7de8ae8a4c79ac514cb2771f1730` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:21.204972 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a676895-8cee-4a70-84ae-eb75293bbcb1 None admin] RBAC: Authorizing `identity:get_user(user_id=0cac7de8ae8a4c79ac514cb2771f1730)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:21.206729 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a676895-8cee-4a70-84ae-eb75293bbcb1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:21.208681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 155/308] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:21 2022] GET /identity/v3/users/0cac7de8ae8a4c79ac514cb2771f1730 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:21.217854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a676895-8cee-4a70-84ae-eb75293bbcb1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:21.227358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7b8a3-f7b3-41a0-a417-9fca68516d65 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:21.265654 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950136e-a6b4-4e09-a879-ed44a226cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:21.266329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950136e-a6b4-4e09-a879-ed44a226cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:21.266622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950136e-a6b4-4e09-a879-ed44a226cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:21.266905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950136e-a6b4-4e09-a879-ed44a226cdf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:21.267657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950136e-a6b4-4e09-a879-ed44a226cdf4 None admin] RBAC: Adding query filter params (role.id=199c92884fb24ba2ac1498b774df4a0b, user.id=f6915c73e9a94bd9817bdfcc39b08a0d, scope.system=all) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:21.268002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950136e-a6b4-4e09-a879-ed44a226cdf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:21.269474 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950136e-a6b4-4e09-a879-ed44a226cdf4 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:21.276025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 154/309] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Aug 10 07:50:21 2022] GET /identity/v3/role_assignments?user.id=f6915c73e9a94bd9817bdfcc39b08a0d&scope.system=all&role.id=199c92884fb24ba2ac1498b774df4a0b => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:21.341300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a676895-8cee-4a70-84ae-eb75293bbcb1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:21.341481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24987055-c525-4164-aef8-4e39b84a2b35 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:21.341584 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24987055-c525-4164-aef8-4e39b84a2b35 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:21.341849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24987055-c525-4164-aef8-4e39b84a2b35 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:21.345038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 155/310] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:21.351672 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cecdd-aee1-496c-a557-bd46fdc0ea55 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:21.352011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cecdd-aee1-496c-a557-bd46fdc0ea55 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:21.352278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cecdd-aee1-496c-a557-bd46fdc0ea55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:21.381428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-528cecdd-aee1-496c-a557-bd46fdc0ea55 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:21.383599 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-528cecdd-aee1-496c-a557-bd46fdc0ea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:21.386504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcfe29-ebaa-49e8-9e62-ab0bbfe4e8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:21.387335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcfe29-ebaa-49e8-9e62-ab0bbfe4e8c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:21.387604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcfe29-ebaa-49e8-9e62-ab0bbfe4e8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:21.388352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcfe29-ebaa-49e8-9e62-ab0bbfe4e8c9 None admin] PATH_INFO: `/v3/system/users/0cac7de8ae8a4c79ac514cb2771f1730/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:21.389682 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcfe29-ebaa-49e8-9e62-ab0bbfe4e8c9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0cac7de8ae8a4c79ac514cb2771f1730, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:21.391192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcfe29-ebaa-49e8-9e62-ab0bbfe4e8c9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:21.404397 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 156/311] 10.222.0.30 () {58 vars in 1334 bytes} [Wed Aug 10 07:50:21 2022] PUT /identity/v3/system/users/0cac7de8ae8a4c79ac514cb2771f1730/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:50:21.466921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:21.488185 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 156/312] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:21.512890 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcfe29-ebaa-49e8-9e62-ab0bbfe4e8c9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:21.577620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:21.646836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcfe29-ebaa-49e8-9e62-ab0bbfe4e8c9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:21.686952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa4a4b-4bb2-4b24-a00c-f407fde4a6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:21.687607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa4a4b-4bb2-4b24-a00c-f407fde4a6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:21.687919 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa4a4b-4bb2-4b24-a00c-f407fde4a6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:21.688192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa4a4b-4bb2-4b24-a00c-f407fde4a6e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:21.700881 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa4a4b-4bb2-4b24-a00c-f407fde4a6e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-23aa4a4b-4bb2-4b24-a00c-f407fde4a6e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:21.709450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:21.710449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:21.711225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:21.711225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:21.711225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:21.711225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:21.711225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:21.711225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:21.711225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:21.711225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:21.711225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:21.711225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:21.711225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:21.711225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:21.711225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 157/313] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:21.719762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cecdd-aee1-496c-a557-bd46fdc0ea55 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:21.924533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cecdd-aee1-496c-a557-bd46fdc0ea55 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:21.966875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55805a8-0bdb-4af0-b368-4622acc968a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:21.967941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55805a8-0bdb-4af0-b368-4622acc968a3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:21.968446 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55805a8-0bdb-4af0-b368-4622acc968a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:21.968928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55805a8-0bdb-4af0-b368-4622acc968a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:21.970134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55805a8-0bdb-4af0-b368-4622acc968a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:21.970795 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55805a8-0bdb-4af0-b368-4622acc968a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:21.973631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55805a8-0bdb-4af0-b368-4622acc968a3 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:21.988581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 157/314] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:21.994608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa4a4b-4bb2-4b24-a00c-f407fde4a6e4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:22.111873 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa4a4b-4bb2-4b24-a00c-f407fde4a6e4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:22.125337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:22.165549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2295b99-dccc-4ac9-95e5-142bc48d8e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:22.166648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2295b99-dccc-4ac9-95e5-142bc48d8e33 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:22.167187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2295b99-dccc-4ac9-95e5-142bc48d8e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:22.167672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2295b99-dccc-4ac9-95e5-142bc48d8e33 None admin] PATH_INFO: `/v3/users/4bc99383f0994fc6a334772a8a487acd` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:22.169747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2295b99-dccc-4ac9-95e5-142bc48d8e33 None admin] RBAC: Authorizing `identity:get_user(user_id=4bc99383f0994fc6a334772a8a487acd)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:22.172550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2295b99-dccc-4ac9-95e5-142bc48d8e33 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:22.176045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 158/315] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:21 2022] GET /identity/v3/users/4bc99383f0994fc6a334772a8a487acd => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:22.182031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55805a8-0bdb-4af0-b368-4622acc968a3 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:22.238396 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:22.293902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55805a8-0bdb-4af0-b368-4622acc968a3 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:22.356143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47455aa-d99b-4d09-92b5-7d56c48fed83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:22.357123 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47455aa-d99b-4d09-92b5-7d56c48fed83 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:22.357606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47455aa-d99b-4d09-92b5-7d56c48fed83 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:22.358079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47455aa-d99b-4d09-92b5-7d56c48fed83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:22.487745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47455aa-d99b-4d09-92b5-7d56c48fed83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:22.490407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47455aa-d99b-4d09-92b5-7d56c48fed83 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:22.581596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:22.672142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 158/316] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:22.678164 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2295b99-dccc-4ac9-95e5-142bc48d8e33 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:22.794980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2295b99-dccc-4ac9-95e5-142bc48d8e33 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:22.832161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd372fad-2e7c-48db-b8dc-58bca4f6c281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:22.832814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd372fad-2e7c-48db-b8dc-58bca4f6c281 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:22.833093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd372fad-2e7c-48db-b8dc-58bca4f6c281 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:22.833367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd372fad-2e7c-48db-b8dc-58bca4f6c281 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:22.834612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd372fad-2e7c-48db-b8dc-58bca4f6c281 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:22.836682 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd372fad-2e7c-48db-b8dc-58bca4f6c281 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:22.838701 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 159/317] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:22 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:22.844952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47455aa-d99b-4d09-92b5-7d56c48fed83 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:22.949875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47455aa-d99b-4d09-92b5-7d56c48fed83 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:22.952398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc95d9-535f-4118-aa68-fb8778029709 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:22.952690 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc95d9-535f-4118-aa68-fb8778029709 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:22.953713 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc95d9-535f-4118-aa68-fb8778029709 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:22.954558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 160/318] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:22.959693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5b637-c700-4ba5-a1d1-dc9767fcc1f3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:22.960045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5b637-c700-4ba5-a1d1-dc9767fcc1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:22.960318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5b637-c700-4ba5-a1d1-dc9767fcc1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:22.983249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-70e5b637-c700-4ba5-a1d1-dc9767fcc1f3 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:22.984642 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-70e5b637-c700-4ba5-a1d1-dc9767fcc1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:22.987334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5360f-6eae-48c7-a71f-9c91acd0d192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:22.988274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5360f-6eae-48c7-a71f-9c91acd0d192 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:22.988558 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5360f-6eae-48c7-a71f-9c91acd0d192 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:22.988831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5360f-6eae-48c7-a71f-9c91acd0d192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:22.989568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5360f-6eae-48c7-a71f-9c91acd0d192 None admin] RBAC: Adding query filter params (role.id=199c92884fb24ba2ac1498b774df4a0b, scope.project.id=a7c2c4a65c044df4afad820df6582f3e, user.id=4bc99383f0994fc6a334772a8a487acd) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:22.989878 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5360f-6eae-48c7-a71f-9c91acd0d192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:22.991849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5360f-6eae-48c7-a71f-9c91acd0d192 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:23.004672 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 159/319] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:22 2022] GET /identity/v3/role_assignments?user.id=4bc99383f0994fc6a334772a8a487acd&scope.project.id=a7c2c4a65c044df4afad820df6582f3e&role.id=199c92884fb24ba2ac1498b774df4a0b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:23.036049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:23.072365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 161/320] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:23.096559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5360f-6eae-48c7-a71f-9c91acd0d192 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:23.116125 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:23.212612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5360f-6eae-48c7-a71f-9c91acd0d192 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:23.251359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad15187-1fdc-4517-8a09-8923b58e3708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:23.252141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad15187-1fdc-4517-8a09-8923b58e3708 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:23.252424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad15187-1fdc-4517-8a09-8923b58e3708 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:23.252694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad15187-1fdc-4517-8a09-8923b58e3708 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:23.253890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad15187-1fdc-4517-8a09-8923b58e3708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:23.255345 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad15187-1fdc-4517-8a09-8923b58e3708 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:23.257966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 160/321] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:23.263892 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5b637-c700-4ba5-a1d1-dc9767fcc1f3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:23.375714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5b637-c700-4ba5-a1d1-dc9767fcc1f3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:23.423243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c25c4-fef8-4caa-bb7b-0ee440c600c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:23.423903 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c25c4-fef8-4caa-bb7b-0ee440c600c0 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:23.424183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c25c4-fef8-4caa-bb7b-0ee440c600c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:23.424451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c25c4-fef8-4caa-bb7b-0ee440c600c0 None admin] PATH_INFO: `/v3/groups` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:23.425093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c25c4-fef8-4caa-bb7b-0ee440c600c0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:23.426535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c25c4-fef8-4caa-bb7b-0ee440c600c0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:23.450853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 162/322] 10.222.0.30 () {60 vars in 1134 bytes} [Wed Aug 10 07:50:23 2022] POST /identity/v3/groups => generated 226 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:50:23.667743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1fe4-88a3-4e2f-93ee-e15c62db7e6b None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:23.668239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1fe4-88a3-4e2f-93ee-e15c62db7e6b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:23.668239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1fe4-88a3-4e2f-93ee-e15c62db7e6b None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:23.669574 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 161/323] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:23.674993 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedfa6e-56e0-4b5b-b02e-519e2f5af30e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:23.675396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedfa6e-56e0-4b5b-b02e-519e2f5af30e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:23.675584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedfa6e-56e0-4b5b-b02e-519e2f5af30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:23.695122 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4bedfa6e-56e0-4b5b-b02e-519e2f5af30e None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:23.696365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4bedfa6e-56e0-4b5b-b02e-519e2f5af30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:23.728864 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:23.777330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 163/324] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:23.780231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399c62a-8ee2-4726-ac9a-5972c0a137c3 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:23.780666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399c62a-8ee2-4726-ac9a-5972c0a137c3 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:23.781024 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399c62a-8ee2-4726-ac9a-5972c0a137c3 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:23.782582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 162/325] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:50:23.788370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ac12-ec12-43fb-a685-13567430c6e5 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:23.788923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ac12-ec12-43fb-a685-13567430c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:23.789198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ac12-ec12-43fb-a685-13567430c6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:23.807925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399c62a-8ee2-4726-ac9a-5972c0a137c3 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:23.811948 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1d09ac12-ec12-43fb-a685-13567430c6e5 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:23.813160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1d09ac12-ec12-43fb-a685-13567430c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:23.908560 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 164/326] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:23.931553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ac12-ec12-43fb-a685-13567430c6e5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:23.937940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:23.969473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399c62a-8ee2-4726-ac9a-5972c0a137c3 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:24.012720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12412181-e199-465c-8d53-7ac26d0ac6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:24.013459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12412181-e199-465c-8d53-7ac26d0ac6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:24.013745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12412181-e199-465c-8d53-7ac26d0ac6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:24.014022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12412181-e199-465c-8d53-7ac26d0ac6b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:24.026665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12412181-e199-465c-8d53-7ac26d0ac6b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-12412181-e199-465c-8d53-7ac26d0ac6b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:24.032972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:24.034551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:24.036395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:24.036395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:24.036395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:24.036395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:24.036395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:24.036395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:24.036395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:24.036395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:24.036395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:24.036395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:24.036395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:24.036395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:24.036395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 163/327] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:24.043775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12412181-e199-465c-8d53-7ac26d0ac6b6 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:24.074082 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:24.081568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ac12-ec12-43fb-a685-13567430c6e5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:24.140858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196f12b-f8bd-41ef-ad60-0b7f4f454ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:24.142128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196f12b-f8bd-41ef-ad60-0b7f4f454ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:24.142692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196f12b-f8bd-41ef-ad60-0b7f4f454ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:24.142975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196f12b-f8bd-41ef-ad60-0b7f4f454ab0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:24.158058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196f12b-f8bd-41ef-ad60-0b7f4f454ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-b196f12b-f8bd-41ef-ad60-0b7f4f454ab0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:24.165106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:24.167970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:24.171192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:24.171192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:24.171192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:24.171192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:24.171192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:24.171192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:24.171192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:24.171192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:24.171192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:24.171192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:24.171192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:24.171192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:24.171192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 165/328] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:24.175067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196f12b-f8bd-41ef-ad60-0b7f4f454ab0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:24.223025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12412181-e199-465c-8d53-7ac26d0ac6b6 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:24.293319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137549a-4c7c-4f31-826f-ca949a488f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:24.295353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137549a-4c7c-4f31-826f-ca949a488f7c None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:24.296119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137549a-4c7c-4f31-826f-ca949a488f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:24.297173 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137549a-4c7c-4f31-826f-ca949a488f7c None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:24.298638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137549a-4c7c-4f31-826f-ca949a488f7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:24.299622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137549a-4c7c-4f31-826f-ca949a488f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:24.303132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137549a-4c7c-4f31-826f-ca949a488f7c None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:24.322667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 164/329] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:24.331111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137549a-4c7c-4f31-826f-ca949a488f7c None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:24.336865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:24.371885 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196f12b-f8bd-41ef-ad60-0b7f4f454ab0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:24.431283 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3082ff-61c9-4d8a-acc1-34adce0ce084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:24.432507 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3082ff-61c9-4d8a-acc1-34adce0ce084 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:24.433714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3082ff-61c9-4d8a-acc1-34adce0ce084 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:24.434159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3082ff-61c9-4d8a-acc1-34adce0ce084 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:24.434980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3082ff-61c9-4d8a-acc1-34adce0ce084 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:24.435416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3082ff-61c9-4d8a-acc1-34adce0ce084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:24.438025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3082ff-61c9-4d8a-acc1-34adce0ce084 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:24.455514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 166/330] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:24.461894 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3082ff-61c9-4d8a-acc1-34adce0ce084 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:24.486956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:24.490534 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137549a-4c7c-4f31-826f-ca949a488f7c None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:24.551520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36168c48-3f65-4af5-af0b-08ce01715b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:24.553118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168c48-3f65-4af5-af0b-08ce01715b3d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:24.554244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168c48-3f65-4af5-af0b-08ce01715b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:24.554582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168c48-3f65-4af5-af0b-08ce01715b3d None admin] PATH_INFO: `/v3/users/0cac7de8ae8a4c79ac514cb2771f1730` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:24.557093 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36168c48-3f65-4af5-af0b-08ce01715b3d None admin] RBAC: Authorizing `identity:get_user(user_id=0cac7de8ae8a4c79ac514cb2771f1730)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:24.559612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36168c48-3f65-4af5-af0b-08ce01715b3d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:24.563061 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 165/331] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:24 2022] GET /identity/v3/users/0cac7de8ae8a4c79ac514cb2771f1730 => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:24.568722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36168c48-3f65-4af5-af0b-08ce01715b3d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:24.607447 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3082ff-61c9-4d8a-acc1-34adce0ce084 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:24.665074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d16f87-62dc-4450-bc9c-44078fa13390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:24.665726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d16f87-62dc-4450-bc9c-44078fa13390 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:24.666005 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d16f87-62dc-4450-bc9c-44078fa13390 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:24.666278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d16f87-62dc-4450-bc9c-44078fa13390 None admin] PATH_INFO: `/v3/users/f6915c73e9a94bd9817bdfcc39b08a0d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:24.669495 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d16f87-62dc-4450-bc9c-44078fa13390 None admin] RBAC: Authorizing `identity:get_user(user_id=f6915c73e9a94bd9817bdfcc39b08a0d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:24.672113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d16f87-62dc-4450-bc9c-44078fa13390 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:24.680207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 167/332] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:24 2022] GET /identity/v3/users/f6915c73e9a94bd9817bdfcc39b08a0d => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:24.684299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d16f87-62dc-4450-bc9c-44078fa13390 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:24.684447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:24.722377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36168c48-3f65-4af5-af0b-08ce01715b3d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:24.763307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acd94c-fac4-4be4-8fac-773aa3dd0da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:24.764148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acd94c-fac4-4be4-8fac-773aa3dd0da0 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:24.764449 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acd94c-fac4-4be4-8fac-773aa3dd0da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:24.764765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acd94c-fac4-4be4-8fac-773aa3dd0da0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:24.765633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acd94c-fac4-4be4-8fac-773aa3dd0da0 None admin] RBAC: Adding query filter params (role.id=9d10ee7e27e242ba801222cf0264ea8d, user.id=0cac7de8ae8a4c79ac514cb2771f1730, scope.system=all) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:24.765952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acd94c-fac4-4be4-8fac-773aa3dd0da0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:24.767682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acd94c-fac4-4be4-8fac-773aa3dd0da0 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:24.782236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 166/333] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Aug 10 07:50:24 2022] GET /identity/v3/role_assignments?user.id=0cac7de8ae8a4c79ac514cb2771f1730&scope.system=all&role.id=9d10ee7e27e242ba801222cf0264ea8d => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:24.860743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:24.880091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d16f87-62dc-4450-bc9c-44078fa13390 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:24.924297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f0fe0-c21f-48d9-bd74-8dbbdeb2f3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:24.925035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f0fe0-c21f-48d9-bd74-8dbbdeb2f3bf None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:24.925318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f0fe0-c21f-48d9-bd74-8dbbdeb2f3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:24.925646 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f0fe0-c21f-48d9-bd74-8dbbdeb2f3bf None admin] PATH_INFO: `/v3/system/users/f6915c73e9a94bd9817bdfcc39b08a0d/roles/199c92884fb24ba2ac1498b774df4a0b` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:24.927128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f0fe0-c21f-48d9-bd74-8dbbdeb2f3bf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f6915c73e9a94bd9817bdfcc39b08a0d, role_id=199c92884fb24ba2ac1498b774df4a0b)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:24.929391 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f0fe0-c21f-48d9-bd74-8dbbdeb2f3bf None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:24.945439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 168/334] 10.222.0.30 () {58 vars in 1334 bytes} [Wed Aug 10 07:50:24 2022] PUT /identity/v3/system/users/f6915c73e9a94bd9817bdfcc39b08a0d/roles/199c92884fb24ba2ac1498b774df4a0b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:50:26.193493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898779a-1c94-4c90-92e5-25b5336d3443 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:26.194010 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898779a-1c94-4c90-92e5-25b5336d3443 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:26.194086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898779a-1c94-4c90-92e5-25b5336d3443 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:26.195683 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 167/335] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:26.201937 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b6e0e-253d-4cb2-b343-1446274265d9 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:26.202874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b6e0e-253d-4cb2-b343-1446274265d9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:26.203351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b6e0e-253d-4cb2-b343-1446274265d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:26.223370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-671b6e0e-253d-4cb2-b343-1446274265d9 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:26.225043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-671b6e0e-253d-4cb2-b343-1446274265d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:26.301684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 169/336] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:26.326448 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898779a-1c94-4c90-92e5-25b5336d3443 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:26.451129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898779a-1c94-4c90-92e5-25b5336d3443 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:26.488946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:26.496520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dabee5-9d1f-4fea-85c9-00f196a16882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:26.497476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabee5-9d1f-4fea-85c9-00f196a16882 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:26.497959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabee5-9d1f-4fea-85c9-00f196a16882 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:26.498529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabee5-9d1f-4fea-85c9-00f196a16882 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:26.513813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dabee5-9d1f-4fea-85c9-00f196a16882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-f1dabee5-9d1f-4fea-85c9-00f196a16882 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:26.519032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:26.519945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:26.520711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:26.520711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:26.520711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:26.520711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:26.520711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:26.520711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:26.520711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:26.520711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:26.520711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:26.520711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:26.520711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:26.520711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:26.523898 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 168/337] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:26.530176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b6e0e-253d-4cb2-b343-1446274265d9 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:26.629949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:26.653287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b6e0e-253d-4cb2-b343-1446274265d9 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:26.693710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78785af-3baa-42c8-be73-962625b9647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:26.695324 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78785af-3baa-42c8-be73-962625b9647c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:26.697606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78785af-3baa-42c8-be73-962625b9647c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:26.698129 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78785af-3baa-42c8-be73-962625b9647c None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:26.699098 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78785af-3baa-42c8-be73-962625b9647c None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:26.699606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78785af-3baa-42c8-be73-962625b9647c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:26.701295 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78785af-3baa-42c8-be73-962625b9647c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:26.710654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 170/338] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:26.716733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dabee5-9d1f-4fea-85c9-00f196a16882 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:26.850907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dabee5-9d1f-4fea-85c9-00f196a16882 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:26.890653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044299b-e48a-4c6d-9c95-1cb3072e4f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:26.891624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044299b-e48a-4c6d-9c95-1cb3072e4f87 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:26.892177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044299b-e48a-4c6d-9c95-1cb3072e4f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:26.892652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044299b-e48a-4c6d-9c95-1cb3072e4f87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:26.970320 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:26.981720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044299b-e48a-4c6d-9c95-1cb3072e4f87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:26.983293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044299b-e48a-4c6d-9c95-1cb3072e4f87 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:27.055609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa935c8b-3e9e-4935-8be8-2931d42cb4b1 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:27.055980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa935c8b-3e9e-4935-8be8-2931d42cb4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:27.056199 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa935c8b-3e9e-4935-8be8-2931d42cb4b1 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:27.057688 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 171/339] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:50:27.063157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c6c65-305e-4f36-a847-b98c502fbfba None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:27.063760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c6c65-305e-4f36-a847-b98c502fbfba None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:27.064230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c6c65-305e-4f36-a847-b98c502fbfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:27.097214 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-db3c6c65-305e-4f36-a847-b98c502fbfba None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:27.098794 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-db3c6c65-305e-4f36-a847-b98c502fbfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:27.138196 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 169/340] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:27.145623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044299b-e48a-4c6d-9c95-1cb3072e4f87 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:27.229029 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 172/341] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:27.324469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:27.342344 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044299b-e48a-4c6d-9c95-1cb3072e4f87 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:27.346633 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c6c65-305e-4f36-a847-b98c502fbfba None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:27.446946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdf92e-1c13-42e8-99d8-31d75149a4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:27.448002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdf92e-1c13-42e8-99d8-31d75149a4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:27.448555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdf92e-1c13-42e8-99d8-31d75149a4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:27.449378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdf92e-1c13-42e8-99d8-31d75149a4f5 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:27.451986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdf92e-1c13-42e8-99d8-31d75149a4f5 None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:27.453889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdf92e-1c13-42e8-99d8-31d75149a4f5 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:27.456256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 170/342] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:27 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:27.463926 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdf92e-1c13-42e8-99d8-31d75149a4f5 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:27.513346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:27.603072 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c6c65-305e-4f36-a847-b98c502fbfba None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:27.715826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06241d-b3f3-4d5a-ac8c-03b6303d31e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:27.716450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdf92e-1c13-42e8-99d8-31d75149a4f5 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:27.716593 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06241d-b3f3-4d5a-ac8c-03b6303d31e5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:27.716745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06241d-b3f3-4d5a-ac8c-03b6303d31e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:27.717173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06241d-b3f3-4d5a-ac8c-03b6303d31e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:27.731774 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06241d-b3f3-4d5a-ac8c-03b6303d31e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-fb06241d-b3f3-4d5a-ac8c-03b6303d31e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:27.736883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:27.737945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:27.738922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:27.738922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:27.738922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:27.738922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:27.738922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:27.738922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:27.738922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:27.738922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:27.738922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:27.738922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:27.738922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:27.738922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:27.742445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 173/343] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:50:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:27.748684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06241d-b3f3-4d5a-ac8c-03b6303d31e5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:27.794139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe9d14-d82a-4626-8b76-7eff50fd854d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:27.795182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe9d14-d82a-4626-8b76-7eff50fd854d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:27.795885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe9d14-d82a-4626-8b76-7eff50fd854d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:27.796337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe9d14-d82a-4626-8b76-7eff50fd854d None admin] PATH_INFO: `/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:27.812470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe9d14-d82a-4626-8b76-7eff50fd854d None admin] RBAC: Authorizing `identity:get_group(group_id=828a7cf31bdb41f4bb44b989b7749fb4)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:27.813955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe9d14-d82a-4626-8b76-7eff50fd854d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:27.815864 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 171/344] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:27 2022] GET /identity/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4 => generated 226 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:27.825257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bae52-b22d-4831-a7f6-50615c56637a None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:27.825570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bae52-b22d-4831-a7f6-50615c56637a None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:27.825820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bae52-b22d-4831-a7f6-50615c56637a None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:27.827340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 172/345] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:27.841360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5aaab1-8b4a-4158-9766-22c93da5b854 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:27.841640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5aaab1-8b4a-4158-9766-22c93da5b854 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:27.841916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5aaab1-8b4a-4158-9766-22c93da5b854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:27.880885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-1d5aaab1-8b4a-4158-9766-22c93da5b854 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:27.882289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1d5aaab1-8b4a-4158-9766-22c93da5b854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:27.899106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06241d-b3f3-4d5a-ac8c-03b6303d31e5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:27.921900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:27.937103 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:27.947266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f367e4f-4f25-4a5b-bb6a-ec0157fc0378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:27.947923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f367e4f-4f25-4a5b-bb6a-ec0157fc0378 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:27.948208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f367e4f-4f25-4a5b-bb6a-ec0157fc0378 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:27.948481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f367e4f-4f25-4a5b-bb6a-ec0157fc0378 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:27.949283 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f367e4f-4f25-4a5b-bb6a-ec0157fc0378 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:27.949588 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f367e4f-4f25-4a5b-bb6a-ec0157fc0378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:27.950989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f367e4f-4f25-4a5b-bb6a-ec0157fc0378 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:27.965862 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 174/346] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:27.966781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f367e4f-4f25-4a5b-bb6a-ec0157fc0378 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:27.992018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 173/347] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:27.993077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5aaab1-8b4a-4158-9766-22c93da5b854 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:28.151320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f367e4f-4f25-4a5b-bb6a-ec0157fc0378 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:28.202340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5aaab1-8b4a-4158-9766-22c93da5b854 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:28.251074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaff78-83cf-4b22-a5a0-a00c7604b5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:28.252058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaff78-83cf-4b22-a5a0-a00c7604b5bb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:28.252511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaff78-83cf-4b22-a5a0-a00c7604b5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:28.252955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaff78-83cf-4b22-a5a0-a00c7604b5bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:28.254175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaff78-83cf-4b22-a5a0-a00c7604b5bb None admin] RBAC: Adding query filter params (group.id=828a7cf31bdb41f4bb44b989b7749fb4, role.id=9d10ee7e27e242ba801222cf0264ea8d, scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:28.254692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaff78-83cf-4b22-a5a0-a00c7604b5bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:28.257211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaff78-83cf-4b22-a5a0-a00c7604b5bb None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:28.280581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 175/348] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 10 07:50:27 2022] GET /identity/v3/role_assignments?group.id=828a7cf31bdb41f4bb44b989b7749fb4&scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6&role.id=9d10ee7e27e242ba801222cf0264ea8d => generated 260 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:28.281996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaff78-83cf-4b22-a5a0-a00c7604b5bb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:28.314827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c86117-8bef-4c0b-b1af-8374d09b1815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:28.315809 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c86117-8bef-4c0b-b1af-8374d09b1815 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:28.316272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c86117-8bef-4c0b-b1af-8374d09b1815 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:28.316696 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c86117-8bef-4c0b-b1af-8374d09b1815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:28.398856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:28.438630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:28.509078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c86117-8bef-4c0b-b1af-8374d09b1815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:28.510713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c86117-8bef-4c0b-b1af-8374d09b1815 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:28.543429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaff78-83cf-4b22-a5a0-a00c7604b5bb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:28.618605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d55089-9b6c-4966-a6d6-201e79938218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:28.619949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d55089-9b6c-4966-a6d6-201e79938218 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:28.620520 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d55089-9b6c-4966-a6d6-201e79938218 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:28.621002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d55089-9b6c-4966-a6d6-201e79938218 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:28.635605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d55089-9b6c-4966-a6d6-201e79938218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-f1d55089-9b6c-4966-a6d6-201e79938218 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:28.642357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:28.643310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:28.646818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:28.646818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:28.646818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:28.646818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:28.646818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:28.646818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:28.646818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:28.646818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:28.646818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:28.646818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:28.646818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:28.646818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:28.646818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 176/349] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:28.648382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eacaf0-b76e-46a1-8c87-000d1de8d93e None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:28.648497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eacaf0-b76e-46a1-8c87-000d1de8d93e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:28.648955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eacaf0-b76e-46a1-8c87-000d1de8d93e None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:28.656426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 177/350] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:28.656426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eacaf0-b76e-46a1-8c87-000d1de8d93e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:28.751515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 174/351] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:28.754347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c1d8b-2d34-4bf5-bff9-0b74a6ad709f None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:28.754701 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c1d8b-2d34-4bf5-bff9-0b74a6ad709f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:28.754980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c1d8b-2d34-4bf5-bff9-0b74a6ad709f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:28.784326 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-ab3c1d8b-2d34-4bf5-bff9-0b74a6ad709f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:28.786421 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ab3c1d8b-2d34-4bf5-bff9-0b74a6ad709f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:28.813118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eacaf0-b76e-46a1-8c87-000d1de8d93e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:28.832349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:28.853211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744e5ae-7a26-460b-bb8e-63ad17ceec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:28.854342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744e5ae-7a26-460b-bb8e-63ad17ceec86 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:28.854939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744e5ae-7a26-460b-bb8e-63ad17ceec86 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:28.855406 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744e5ae-7a26-460b-bb8e-63ad17ceec86 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:28.856460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744e5ae-7a26-460b-bb8e-63ad17ceec86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:28.857070 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744e5ae-7a26-460b-bb8e-63ad17ceec86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:28.859041 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744e5ae-7a26-460b-bb8e-63ad17ceec86 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:28.870456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 178/352] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:28.872354 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2eb6a7-1ea2-448c-854b-e65a95008cf0 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:28.872866 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2eb6a7-1ea2-448c-854b-e65a95008cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:28.873330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2eb6a7-1ea2-448c-854b-e65a95008cf0 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:28.875346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 179/353] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:28.876415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2eb6a7-1ea2-448c-854b-e65a95008cf0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:28.883150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:28.915150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 175/354] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:28.916504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c1d8b-2d34-4bf5-bff9-0b74a6ad709f None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:29.054808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2eb6a7-1ea2-448c-854b-e65a95008cf0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:29.060174 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c1d8b-2d34-4bf5-bff9-0b74a6ad709f None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:29.096367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd29059-d361-4f5c-b056-118976e22b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:29.097375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd29059-d361-4f5c-b056-118976e22b45 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:29.097850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd29059-d361-4f5c-b056-118976e22b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:29.098310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd29059-d361-4f5c-b056-118976e22b45 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:29.099479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd29059-d361-4f5c-b056-118976e22b45 None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:29.100543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c6ba4-21cb-4fd2-b44b-166f12913928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:29.101531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd29059-d361-4f5c-b056-118976e22b45 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:29.101650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c6ba4-21cb-4fd2-b44b-166f12913928 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:29.101912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c6ba4-21cb-4fd2-b44b-166f12913928 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:29.102336 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c6ba4-21cb-4fd2-b44b-166f12913928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:29.103423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 180/355] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:28 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:29.104849 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90ebbe-d46c-4fd5-bcaf-1160f570ed5e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:29.105165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90ebbe-d46c-4fd5-bcaf-1160f570ed5e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:29.105497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90ebbe-d46c-4fd5-bcaf-1160f570ed5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:29.129526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4a90ebbe-d46c-4fd5-bcaf-1160f570ed5e None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:29.131014 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4a90ebbe-d46c-4fd5-bcaf-1160f570ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:29.171436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:29.187581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:29.205945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c6ba4-21cb-4fd2-b44b-166f12913928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:29.207923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c6ba4-21cb-4fd2-b44b-166f12913928 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:29.228578 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 181/356] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:29.230822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0410f-17d0-4874-89f2-508eab1de534 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:29.232067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0410f-17d0-4874-89f2-508eab1de534 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:29.232349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0410f-17d0-4874-89f2-508eab1de534 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:29.234003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 182/357] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:29.234546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0410f-17d0-4874-89f2-508eab1de534 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:29.372912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 176/358] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:29.374871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c6ba4-21cb-4fd2-b44b-166f12913928 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:29.385523 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0410f-17d0-4874-89f2-508eab1de534 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:29.429145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98787d0d-4894-4e3a-af7a-8db932468c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:29.429790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98787d0d-4894-4e3a-af7a-8db932468c01 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:29.430067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98787d0d-4894-4e3a-af7a-8db932468c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:29.430327 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98787d0d-4894-4e3a-af7a-8db932468c01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:29.444828 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98787d0d-4894-4e3a-af7a-8db932468c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-98787d0d-4894-4e3a-af7a-8db932468c01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:29.453151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:29.455009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:29.456917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:29.456917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:29.456917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:29.456917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:29.456917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:29.456917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:29.456917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:29.456917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:29.456917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:29.456917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:29.456917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:29.456917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:29.459297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 183/359] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:50:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:29.461786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651ca8c-1baa-41b0-9d8f-b62a61be7a38 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:29.462073 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651ca8c-1baa-41b0-9d8f-b62a61be7a38 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:29.462349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651ca8c-1baa-41b0-9d8f-b62a61be7a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:29.481881 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7651ca8c-1baa-41b0-9d8f-b62a61be7a38 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:29.483237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7651ca8c-1baa-41b0-9d8f-b62a61be7a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:29.521335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:29.526867 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:29.553298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c6ba4-21cb-4fd2-b44b-166f12913928 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:29.573742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 184/360] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:29.575051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651ca8c-1baa-41b0-9d8f-b62a61be7a38 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:29.618339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738094c8-5181-41cc-9b4e-fa7e5b5b480e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:29.619046 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738094c8-5181-41cc-9b4e-fa7e5b5b480e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:29.619330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738094c8-5181-41cc-9b4e-fa7e5b5b480e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:29.619608 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738094c8-5181-41cc-9b4e-fa7e5b5b480e None admin] PATH_INFO: `/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:29.622702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738094c8-5181-41cc-9b4e-fa7e5b5b480e None admin] RBAC: Authorizing `identity:get_group(group_id=828a7cf31bdb41f4bb44b989b7749fb4)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:29.624331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738094c8-5181-41cc-9b4e-fa7e5b5b480e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:29.625895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 177/361] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:29 2022] GET /identity/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:29.626682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738094c8-5181-41cc-9b4e-fa7e5b5b480e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:29.712431 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651ca8c-1baa-41b0-9d8f-b62a61be7a38 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:29.756381 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c13b24-a418-4185-99ec-155340212227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:29.757575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13b24-a418-4185-99ec-155340212227 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:29.757867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13b24-a418-4185-99ec-155340212227 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:29.758192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13b24-a418-4185-99ec-155340212227 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:29.772445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c13b24-a418-4185-99ec-155340212227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c7c13b24-a418-4185-99ec-155340212227 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:29.778635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:29.779855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 185/362] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:29.780700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c13b24-a418-4185-99ec-155340212227 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:29.781412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738094c8-5181-41cc-9b4e-fa7e5b5b480e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:29.815284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:29.835788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1a79e-cbbe-4d85-bbf3-439dfe637206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:29.836813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1a79e-cbbe-4d85-bbf3-439dfe637206 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:29.837098 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1a79e-cbbe-4d85-bbf3-439dfe637206 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:29.837371 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1a79e-cbbe-4d85-bbf3-439dfe637206 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:29.840753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1a79e-cbbe-4d85-bbf3-439dfe637206 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:29.841986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1a79e-cbbe-4d85-bbf3-439dfe637206 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:29.843920 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 178/363] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:29 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:29.844971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1a79e-cbbe-4d85-bbf3-439dfe637206 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:29.875408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:29.906374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c13b24-a418-4185-99ec-155340212227 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:29.974253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd1b2d-1776-4973-9aca-8a28f4ddcf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:29.974253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd1b2d-1776-4973-9aca-8a28f4ddcf21 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:29.974253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd1b2d-1776-4973-9aca-8a28f4ddcf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:29.974253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd1b2d-1776-4973-9aca-8a28f4ddcf21 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:29.974877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd1b2d-1776-4973-9aca-8a28f4ddcf21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:29.974877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd1b2d-1776-4973-9aca-8a28f4ddcf21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:29.978358 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd1b2d-1776-4973-9aca-8a28f4ddcf21 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:29.988683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 186/364] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:29.989543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd1b2d-1776-4973-9aca-8a28f4ddcf21 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:30.024149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1a79e-cbbe-4d85-bbf3-439dfe637206 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:30.069489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a53d0e-379d-4671-910c-c85ea1e14175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:30.070139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a53d0e-379d-4671-910c-c85ea1e14175 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:30.070423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a53d0e-379d-4671-910c-c85ea1e14175 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:30.070735 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a53d0e-379d-4671-910c-c85ea1e14175 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:30.086175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a53d0e-379d-4671-910c-c85ea1e14175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-69a53d0e-379d-4671-910c-c85ea1e14175 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:30.091445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:30.093043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 179/365] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:50:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:30.095954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a53d0e-379d-4671-910c-c85ea1e14175 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:30.150479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:30.162752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd1b2d-1776-4973-9aca-8a28f4ddcf21 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:30.210434 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:30.219314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e533e-7d87-4ac5-b001-1a2c43794b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:30.219965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e533e-7d87-4ac5-b001-1a2c43794b02 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:30.220254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e533e-7d87-4ac5-b001-1a2c43794b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:30.220528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e533e-7d87-4ac5-b001-1a2c43794b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:30.221266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e533e-7d87-4ac5-b001-1a2c43794b02 None admin] RBAC: Adding query filter params (group.id=828a7cf31bdb41f4bb44b989b7749fb4, role.id=a5a6c597145c4b23983d1b04377af7ed, scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:30.221576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e533e-7d87-4ac5-b001-1a2c43794b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:30.224101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e533e-7d87-4ac5-b001-1a2c43794b02 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:30.232113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 187/366] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 10 07:50:29 2022] GET /identity/v3/role_assignments?group.id=828a7cf31bdb41f4bb44b989b7749fb4&scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6&role.id=a5a6c597145c4b23983d1b04377af7ed => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:30.233258 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e533e-7d87-4ac5-b001-1a2c43794b02 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:30.259209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a53d0e-379d-4671-910c-c85ea1e14175 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:30.331475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170893f7-5fad-4df8-b11d-58dbb5325db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:30.332453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170893f7-5fad-4df8-b11d-58dbb5325db6 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:30.332889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170893f7-5fad-4df8-b11d-58dbb5325db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:30.333323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170893f7-5fad-4df8-b11d-58dbb5325db6 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:30.334643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170893f7-5fad-4df8-b11d-58dbb5325db6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:30.337979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170893f7-5fad-4df8-b11d-58dbb5325db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:30.340412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170893f7-5fad-4df8-b11d-58dbb5325db6 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:30.357186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 180/367] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:30.358183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170893f7-5fad-4df8-b11d-58dbb5325db6 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:30.406618 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e533e-7d87-4ac5-b001-1a2c43794b02 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:30.459039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46544ac3-f35c-4046-a3ac-ebc57ed951d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:30.460487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46544ac3-f35c-4046-a3ac-ebc57ed951d8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:30.460824 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46544ac3-f35c-4046-a3ac-ebc57ed951d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:30.461188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46544ac3-f35c-4046-a3ac-ebc57ed951d8 None admin] PATH_INFO: `/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:30.463146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46544ac3-f35c-4046-a3ac-ebc57ed951d8 None admin] RBAC: Authorizing `identity:get_group(group_id=828a7cf31bdb41f4bb44b989b7749fb4)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:30.465682 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46544ac3-f35c-4046-a3ac-ebc57ed951d8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:30.467845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 188/368] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:30 2022] GET /identity/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:30.468789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46544ac3-f35c-4046-a3ac-ebc57ed951d8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:30.498210 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:30.517137 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170893f7-5fad-4df8-b11d-58dbb5325db6 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:30.560645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cfc21-68f5-46b9-ad45-935da02d03ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:30.562164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cfc21-68f5-46b9-ad45-935da02d03ef None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:30.562707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cfc21-68f5-46b9-ad45-935da02d03ef None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:30.563307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cfc21-68f5-46b9-ad45-935da02d03ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:30.579036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:30.622409 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46544ac3-f35c-4046-a3ac-ebc57ed951d8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:30.694697 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cfc21-68f5-46b9-ad45-935da02d03ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:30.696736 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec1e5d-8dd2-4332-b2a5-b6d464df6378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:30.697545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cfc21-68f5-46b9-ad45-935da02d03ef None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:30.697855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec1e5d-8dd2-4332-b2a5-b6d464df6378 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:30.698382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec1e5d-8dd2-4332-b2a5-b6d464df6378 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:30.698845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec1e5d-8dd2-4332-b2a5-b6d464df6378 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:30.699712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec1e5d-8dd2-4332-b2a5-b6d464df6378 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:30.700246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec1e5d-8dd2-4332-b2a5-b6d464df6378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:30.702643 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec1e5d-8dd2-4332-b2a5-b6d464df6378 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:30.722907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 189/369] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:30.724992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec1e5d-8dd2-4332-b2a5-b6d464df6378 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:30.852358 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:30.872507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 181/370] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:30.873853 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cfc21-68f5-46b9-ad45-935da02d03ef None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:30.875879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec1e5d-8dd2-4332-b2a5-b6d464df6378 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:30.928985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a41143-b515-41c3-95f4-9d8ec6a83ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:30.929641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a41143-b515-41c3-95f4-9d8ec6a83ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:30.930011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a41143-b515-41c3-95f4-9d8ec6a83ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:30.930278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a41143-b515-41c3-95f4-9d8ec6a83ae8 None admin] PATH_INFO: `/v3/users/f6915c73e9a94bd9817bdfcc39b08a0d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:30.931582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a41143-b515-41c3-95f4-9d8ec6a83ae8 None admin] RBAC: Authorizing `identity:get_user(user_id=f6915c73e9a94bd9817bdfcc39b08a0d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:30.933880 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a41143-b515-41c3-95f4-9d8ec6a83ae8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:30.935917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 190/371] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:50:30 2022] GET /identity/v3/users/f6915c73e9a94bd9817bdfcc39b08a0d => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:30.936637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:30.938075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a41143-b515-41c3-95f4-9d8ec6a83ae8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:31.018783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cfc21-68f5-46b9-ad45-935da02d03ef None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:31.058577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b582a-d53b-4acf-b79c-ae808e537db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:31.058577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b582a-d53b-4acf-b79c-ae808e537db5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:31.058881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b582a-d53b-4acf-b79c-ae808e537db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:31.058881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b582a-d53b-4acf-b79c-ae808e537db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:31.059618 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b582a-d53b-4acf-b79c-ae808e537db5 None admin] RBAC: Adding query filter params (group.id=828a7cf31bdb41f4bb44b989b7749fb4, role.id=9d10ee7e27e242ba801222cf0264ea8d, scope.project.id=a7c2c4a65c044df4afad820df6582f3e) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:31.059973 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b582a-d53b-4acf-b79c-ae808e537db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:31.061409 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b582a-d53b-4acf-b79c-ae808e537db5 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:31.067317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 182/372] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 10 07:50:30 2022] GET /identity/v3/role_assignments?group.id=828a7cf31bdb41f4bb44b989b7749fb4&scope.project.id=a7c2c4a65c044df4afad820df6582f3e&role.id=9d10ee7e27e242ba801222cf0264ea8d => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:31.067540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a41143-b515-41c3-95f4-9d8ec6a83ae8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:31.068432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28957b-1100-4052-b44b-21938bf35e94 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:31.068717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28957b-1100-4052-b44b-21938bf35e94 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:31.068989 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28957b-1100-4052-b44b-21938bf35e94 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:31.071536 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 183/373] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:31.071681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28957b-1100-4052-b44b-21938bf35e94 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:31.127178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fe7fb-7f4c-4260-9983-f2654f058ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:31.127895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fe7fb-7f4c-4260-9983-f2654f058ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:31.128183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fe7fb-7f4c-4260-9983-f2654f058ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:31.128794 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fe7fb-7f4c-4260-9983-f2654f058ea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:31.157566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:31.203892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28957b-1100-4052-b44b-21938bf35e94 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:31.206824 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:31.218557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fe7fb-7f4c-4260-9983-f2654f058ea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:31.220199 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fe7fb-7f4c-4260-9983-f2654f058ea4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:31.244030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59964714-2d26-4004-a928-cedb18e04606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:31.244672 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59964714-2d26-4004-a928-cedb18e04606 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:31.244954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59964714-2d26-4004-a928-cedb18e04606 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:31.245313 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59964714-2d26-4004-a928-cedb18e04606 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:31.246668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59964714-2d26-4004-a928-cedb18e04606 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:31.248216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59964714-2d26-4004-a928-cedb18e04606 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:31.250104 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 184/374] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:31 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:31.250886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59964714-2d26-4004-a928-cedb18e04606 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:31.353488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 191/375] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:31.354699 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a93dd-187a-4d30-8f62-db39566561b3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:31.354985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a93dd-187a-4d30-8f62-db39566561b3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:31.355260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a93dd-187a-4d30-8f62-db39566561b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:31.377270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8d2a93dd-187a-4d30-8f62-db39566561b3 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:31.378814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8d2a93dd-187a-4d30-8f62-db39566561b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:31.410887 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59964714-2d26-4004-a928-cedb18e04606 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:31.449660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:31.466652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbf9e-444a-4486-88e2-a281ed6ccc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:31.467856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbf9e-444a-4486-88e2-a281ed6ccc06 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:31.468243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbf9e-444a-4486-88e2-a281ed6ccc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:31.468952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbf9e-444a-4486-88e2-a281ed6ccc06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:31.470080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fbf9e-444a-4486-88e2-a281ed6ccc06 None admin] RBAC: Adding query filter params (role.id=199c92884fb24ba2ac1498b774df4a0b, user.id=f6915c73e9a94bd9817bdfcc39b08a0d, scope.system=all) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:31.470484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fbf9e-444a-4486-88e2-a281ed6ccc06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:31.472257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fbf9e-444a-4486-88e2-a281ed6ccc06 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:31.481391 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 192/376] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:31.483075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a93dd-187a-4d30-8f62-db39566561b3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:31.497721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 185/377] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Aug 10 07:50:31 2022] GET /identity/v3/role_assignments?user.id=f6915c73e9a94bd9817bdfcc39b08a0d&scope.system=all&role.id=199c92884fb24ba2ac1498b774df4a0b => generated 510 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:31.498724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbf9e-444a-4486-88e2-a281ed6ccc06 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:31.556137 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:31.679284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbf9e-444a-4486-88e2-a281ed6ccc06 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:31.732909 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2358e-526b-4c65-9260-3085a906aee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:31.733736 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2358e-526b-4c65-9260-3085a906aee0 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:31.734140 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2358e-526b-4c65-9260-3085a906aee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:31.734519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2358e-526b-4c65-9260-3085a906aee0 None admin] PATH_INFO: `/v3/projects/5422809609a44bf7a3e055f250264a66` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:31.736732 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2358e-526b-4c65-9260-3085a906aee0 None admin] RBAC: Authorizing `identity:get_project(project_id=5422809609a44bf7a3e055f250264a66)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:31.738590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2358e-526b-4c65-9260-3085a906aee0 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:31.740916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 186/378] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:31 2022] GET /identity/v3/projects/5422809609a44bf7a3e055f250264a66 => generated 344 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:31.742139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2358e-526b-4c65-9260-3085a906aee0 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:31.787978 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a93dd-187a-4d30-8f62-db39566561b3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:31.866888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2358e-526b-4c65-9260-3085a906aee0 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:31.868300 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:31.878637 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59fc70-9764-4cd6-b271-d9a4981c5157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:31.881364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59fc70-9764-4cd6-b271-d9a4981c5157 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:31.882416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59fc70-9764-4cd6-b271-d9a4981c5157 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:31.882888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59fc70-9764-4cd6-b271-d9a4981c5157 None admin] PATH_INFO: `/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:31.884440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59fc70-9764-4cd6-b271-d9a4981c5157 None admin] RBAC: Authorizing `identity:get_group(group_id=828a7cf31bdb41f4bb44b989b7749fb4)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:31.886286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59fc70-9764-4cd6-b271-d9a4981c5157 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:31.888525 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 193/379] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:31 2022] GET /identity/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4 => generated 226 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:31.889602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59fc70-9764-4cd6-b271-d9a4981c5157 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:31.921576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4faddbf-0e62-48c2-b677-5d82e3dbff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:31.923457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4faddbf-0e62-48c2-b677-5d82e3dbff3e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:31.923457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4faddbf-0e62-48c2-b677-5d82e3dbff3e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:31.923457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4faddbf-0e62-48c2-b677-5d82e3dbff3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:31.937827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4faddbf-0e62-48c2-b677-5d82e3dbff3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-f4faddbf-0e62-48c2-b677-5d82e3dbff3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:31.945548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:31.947429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 187/380] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:31.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4faddbf-0e62-48c2-b677-5d82e3dbff3e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:31.998058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:32.087758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59fc70-9764-4cd6-b271-d9a4981c5157 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:32.102265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4faddbf-0e62-48c2-b677-5d82e3dbff3e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:32.136450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e08ba5-70d4-410f-bc7f-b6484f9ce1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:32.137100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e08ba5-70d4-410f-bc7f-b6484f9ce1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:32.137378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e08ba5-70d4-410f-bc7f-b6484f9ce1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:32.137651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e08ba5-70d4-410f-bc7f-b6484f9ce1a3 None admin] PATH_INFO: `/v3/groups/fb66595b2d6a4beab0ab526332f1d556` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:32.150921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e08ba5-70d4-410f-bc7f-b6484f9ce1a3 None admin] RBAC: Authorizing `identity:get_group(group_id=fb66595b2d6a4beab0ab526332f1d556)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:32.151279 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b159d-2e8e-4f7f-b795-e390317796e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:32.151577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b159d-2e8e-4f7f-b795-e390317796e7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:32.151868 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b159d-2e8e-4f7f-b795-e390317796e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:32.152147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b159d-2e8e-4f7f-b795-e390317796e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:32.155620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e08ba5-70d4-410f-bc7f-b6484f9ce1a3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:32.155907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b159d-2e8e-4f7f-b795-e390317796e7 None admin] RBAC: Adding query filter params (group.id=828a7cf31bdb41f4bb44b989b7749fb4, role.id=a5a6c597145c4b23983d1b04377af7ed, scope.project.id=a7c2c4a65c044df4afad820df6582f3e) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:32.155907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b159d-2e8e-4f7f-b795-e390317796e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:32.156348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 194/381] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:31 2022] GET /identity/v3/groups/fb66595b2d6a4beab0ab526332f1d556 => generated 229 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:32.156567 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b159d-2e8e-4f7f-b795-e390317796e7 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:32.156767 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e08ba5-70d4-410f-bc7f-b6484f9ce1a3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:32.165982 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 188/382] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 10 07:50:31 2022] GET /identity/v3/role_assignments?group.id=828a7cf31bdb41f4bb44b989b7749fb4&scope.project.id=a7c2c4a65c044df4afad820df6582f3e&role.id=a5a6c597145c4b23983d1b04377af7ed => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:32.167771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b159d-2e8e-4f7f-b795-e390317796e7 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:32.266984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:32.294414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e08ba5-70d4-410f-bc7f-b6484f9ce1a3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:32.311749 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:32.335783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311534c-eb99-4b65-8ab5-6328610b3b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:32.336425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311534c-eb99-4b65-8ab5-6328610b3b7f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:32.336707 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311534c-eb99-4b65-8ab5-6328610b3b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:32.336980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311534c-eb99-4b65-8ab5-6328610b3b7f None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:32.337767 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311534c-eb99-4b65-8ab5-6328610b3b7f None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:32.338064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311534c-eb99-4b65-8ab5-6328610b3b7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:32.339494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311534c-eb99-4b65-8ab5-6328610b3b7f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:32.354418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 195/383] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:32.355868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311534c-eb99-4b65-8ab5-6328610b3b7f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:32.446060 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b159d-2e8e-4f7f-b795-e390317796e7 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:32.511660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffea3d-743b-412b-be99-bd3edb6d08aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:32.512299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffea3d-743b-412b-be99-bd3edb6d08aa None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:32.512578 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffea3d-743b-412b-be99-bd3edb6d08aa None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:32.512849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffea3d-743b-412b-be99-bd3edb6d08aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:32.513588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffea3d-743b-412b-be99-bd3edb6d08aa None admin] RBAC: Adding query filter params (group.id=fb66595b2d6a4beab0ab526332f1d556, role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=5422809609a44bf7a3e055f250264a66) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:32.513888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffea3d-743b-412b-be99-bd3edb6d08aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:32.515328 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffea3d-743b-412b-be99-bd3edb6d08aa None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:32.530195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 189/384] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 10 07:50:32 2022] GET /identity/v3/role_assignments?group.id=fb66595b2d6a4beab0ab526332f1d556&scope.project.id=5422809609a44bf7a3e055f250264a66&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 260 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:32.540499 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311534c-eb99-4b65-8ab5-6328610b3b7f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:32.580099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc975aba-ed5b-4dba-a8cb-21d4478cbd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:32.580763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc975aba-ed5b-4dba-a8cb-21d4478cbd39 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:32.581045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc975aba-ed5b-4dba-a8cb-21d4478cbd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:32.581324 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc975aba-ed5b-4dba-a8cb-21d4478cbd39 None admin] PATH_INFO: `/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:32.582578 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc975aba-ed5b-4dba-a8cb-21d4478cbd39 None admin] RBAC: Authorizing `identity:get_group(group_id=828a7cf31bdb41f4bb44b989b7749fb4)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:32.584083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc975aba-ed5b-4dba-a8cb-21d4478cbd39 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:32.590858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 196/385] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:32 2022] GET /identity/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:32.592353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffea3d-743b-412b-be99-bd3edb6d08aa None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:32.689213 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219c311-8cb1-469c-9d2b-0be43e2e1dd4 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:32.689684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219c311-8cb1-469c-9d2b-0be43e2e1dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:32.690125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219c311-8cb1-469c-9d2b-0be43e2e1dd4 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:32.693017 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 197/386] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:50:32.700112 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9a83f-010e-4ce6-b5ff-2cd0af78f300 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:32.700582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9a83f-010e-4ce6-b5ff-2cd0af78f300 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:32.701037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9a83f-010e-4ce6-b5ff-2cd0af78f300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:32.707612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:32.727707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffea3d-743b-412b-be99-bd3edb6d08aa None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:32.741987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9ab9a83f-010e-4ce6-b5ff-2cd0af78f300 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:32.743276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9ab9a83f-010e-4ce6-b5ff-2cd0af78f300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:32.806852 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4ad83-92a3-429d-a539-4bdc1dfa3a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:32.807868 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4ad83-92a3-429d-a539-4bdc1dfa3a74 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:32.808353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4ad83-92a3-429d-a539-4bdc1dfa3a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:32.808806 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4ad83-92a3-429d-a539-4bdc1dfa3a74 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:32.812292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4ad83-92a3-429d-a539-4bdc1dfa3a74 None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:32.813977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4ad83-92a3-429d-a539-4bdc1dfa3a74 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:32.816417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 190/387] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:32 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:32.829408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4ad83-92a3-429d-a539-4bdc1dfa3a74 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:32.840162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:32.884023 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 198/388] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:32.900707 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9a83f-010e-4ce6-b5ff-2cd0af78f300 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:33.014600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4ad83-92a3-429d-a539-4bdc1dfa3a74 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:33.077519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119070d-8d73-4af5-aa03-7b64d6c9db29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:33.078656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119070d-8d73-4af5-aa03-7b64d6c9db29 None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:33.078940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119070d-8d73-4af5-aa03-7b64d6c9db29 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:33.079216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119070d-8d73-4af5-aa03-7b64d6c9db29 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6/groups/828a7cf31bdb41f4bb44b989b7749fb4/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:33.081550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119070d-8d73-4af5-aa03-7b64d6c9db29 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9c0cc72f061412b9d0108f4fefb40a6, group_id=828a7cf31bdb41f4bb44b989b7749fb4, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:33.083281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119070d-8d73-4af5-aa03-7b64d6c9db29 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:33.115122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 191/389] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Aug 10 07:50:32 2022] PUT /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6/groups/828a7cf31bdb41f4bb44b989b7749fb4/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:50:33.122979 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9a83f-010e-4ce6-b5ff-2cd0af78f300 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:33.168456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ab387-1802-4303-a74d-0d1ec10547f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:33.169104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ab387-1802-4303-a74d-0d1ec10547f5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:33.169387 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ab387-1802-4303-a74d-0d1ec10547f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:33.169661 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ab387-1802-4303-a74d-0d1ec10547f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:33.182588 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ab387-1802-4303-a74d-0d1ec10547f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e72ab387-1802-4303-a74d-0d1ec10547f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:33.189145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:33.190076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:33.190847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:33.190847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:33.190847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:33.190847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:33.190847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:33.190847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:33.190847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:33.190847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:33.190847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:33.190847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:33.190847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:33.190847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:33.190847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 199/390] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:50:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:33.197415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119070d-8d73-4af5-aa03-7b64d6c9db29 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:33.219159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:33.367769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119070d-8d73-4af5-aa03-7b64d6c9db29 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:33.406288 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886add96-3a41-4b80-acf8-e15f3f132f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:33.407284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886add96-3a41-4b80-acf8-e15f3f132f1d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:33.407858 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886add96-3a41-4b80-acf8-e15f3f132f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:33.408337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886add96-3a41-4b80-acf8-e15f3f132f1d None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:33.409239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886add96-3a41-4b80-acf8-e15f3f132f1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:33.409870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886add96-3a41-4b80-acf8-e15f3f132f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:33.411467 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886add96-3a41-4b80-acf8-e15f3f132f1d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:33.421119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 192/391] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:33.426648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ab387-1802-4303-a74d-0d1ec10547f5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:33.477237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:33.565140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ab387-1802-4303-a74d-0d1ec10547f5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:33.614395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599795a7-1982-4209-a205-1887ac8d551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:33.615044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599795a7-1982-4209-a205-1887ac8d551f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:33.615326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599795a7-1982-4209-a205-1887ac8d551f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:33.615599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599795a7-1982-4209-a205-1887ac8d551f None admin] PATH_INFO: `/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:33.617330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599795a7-1982-4209-a205-1887ac8d551f None admin] RBAC: Authorizing `identity:get_group(group_id=828a7cf31bdb41f4bb44b989b7749fb4)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:33.618873 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599795a7-1982-4209-a205-1887ac8d551f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:33.620796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 200/392] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:33 2022] GET /identity/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:33.627056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886add96-3a41-4b80-acf8-e15f3f132f1d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:33.761895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:33.793106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886add96-3a41-4b80-acf8-e15f3f132f1d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:33.872656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb3734-5b11-4283-97bf-d15b5efde3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:33.873656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb3734-5b11-4283-97bf-d15b5efde3fb None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:33.874154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb3734-5b11-4283-97bf-d15b5efde3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:33.874621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb3734-5b11-4283-97bf-d15b5efde3fb None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:33.877174 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb3734-5b11-4283-97bf-d15b5efde3fb None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:33.879816 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb3734-5b11-4283-97bf-d15b5efde3fb None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:33.883560 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 193/393] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:33 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:33.888910 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599795a7-1982-4209-a205-1887ac8d551f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:34.007286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a813f4e-a5b8-4a56-94e7-0d12a9316aa7 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:34.007975 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a813f4e-a5b8-4a56-94e7-0d12a9316aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:34.008489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a813f4e-a5b8-4a56-94e7-0d12a9316aa7 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:34.010501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599795a7-1982-4209-a205-1887ac8d551f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:34.011246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 194/394] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:34.020827 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:34.024298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5487e1-e4f3-451e-906c-832232d13ed5 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:34.025101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5487e1-e4f3-451e-906c-832232d13ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:34.025831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5487e1-e4f3-451e-906c-832232d13ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:34.063822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-3c5487e1-e4f3-451e-906c-832232d13ed5 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:34.067286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-3c5487e1-e4f3-451e-906c-832232d13ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:34.079893 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8684b-ce5e-4568-8e93-d40faf151398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:34.080594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8684b-ce5e-4568-8e93-d40faf151398 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:34.080879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8684b-ce5e-4568-8e93-d40faf151398 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:34.081233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8684b-ce5e-4568-8e93-d40faf151398 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6/groups/828a7cf31bdb41f4bb44b989b7749fb4/roles/a5a6c597145c4b23983d1b04377af7ed` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:34.085436 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8684b-ce5e-4568-8e93-d40faf151398 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9c0cc72f061412b9d0108f4fefb40a6, group_id=828a7cf31bdb41f4bb44b989b7749fb4, role_id=a5a6c597145c4b23983d1b04377af7ed)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:34.086926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8684b-ce5e-4568-8e93-d40faf151398 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:34.114131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 201/395] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Aug 10 07:50:33 2022] PUT /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6/groups/828a7cf31bdb41f4bb44b989b7749fb4/roles/a5a6c597145c4b23983d1b04377af7ed => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 07:50:34.157351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 195/396] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:34.192322 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8684b-ce5e-4568-8e93-d40faf151398 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:34.349714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8684b-ce5e-4568-8e93-d40faf151398 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:34.416278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3831-34b1-4d0e-bc7a-2ede32e8b69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:34.417194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3831-34b1-4d0e-bc7a-2ede32e8b69a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:34.417629 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3831-34b1-4d0e-bc7a-2ede32e8b69a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:34.418079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3831-34b1-4d0e-bc7a-2ede32e8b69a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:34.434731 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba3831-34b1-4d0e-bc7a-2ede32e8b69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-59ba3831-34b1-4d0e-bc7a-2ede32e8b69a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:34.439860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:34.440756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:34.441621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:34.441621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:34.441621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:34.441621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:34.441621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:34.441621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:34.441621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:34.441621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:34.441621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:34.441621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:34.441621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:34.441621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:34.444804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 202/397] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:34.451079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5487e1-e4f3-451e-906c-832232d13ed5 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:34.630576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:34.689098 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5487e1-e4f3-451e-906c-832232d13ed5 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:34.749157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec3560-c093-43c0-b0d6-a11a248db057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:34.749800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec3560-c093-43c0-b0d6-a11a248db057 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:34.750087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec3560-c093-43c0-b0d6-a11a248db057 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:34.750363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec3560-c093-43c0-b0d6-a11a248db057 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:34.751050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec3560-c093-43c0-b0d6-a11a248db057 None admin] RBAC: Adding query filter params (name=member) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:34.751351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec3560-c093-43c0-b0d6-a11a248db057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:34.752765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec3560-c093-43c0-b0d6-a11a248db057 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:34.762656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 196/398] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:34.768905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3831-34b1-4d0e-bc7a-2ede32e8b69a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:34.837455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:34.982426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3831-34b1-4d0e-bc7a-2ede32e8b69a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:35.030663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f2dcd-d994-4f80-a004-b88e7c7b3aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:35.031376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2dcd-d994-4f80-a004-b88e7c7b3aad None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:35.031665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2dcd-d994-4f80-a004-b88e7c7b3aad None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:35.031973 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2dcd-d994-4f80-a004-b88e7c7b3aad None admin] PATH_INFO: `/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:35.036422 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f2dcd-d994-4f80-a004-b88e7c7b3aad None admin] RBAC: Authorizing `identity:get_group(group_id=828a7cf31bdb41f4bb44b989b7749fb4)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:35.038449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f2dcd-d994-4f80-a004-b88e7c7b3aad None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:35.040450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 203/399] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:34 2022] GET /identity/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:35.046668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec3560-c093-43c0-b0d6-a11a248db057 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:35.064924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f426-0839-4568-829f-177e328b4b3a None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:35.065269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f426-0839-4568-829f-177e328b4b3a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:35.065469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f426-0839-4568-829f-177e328b4b3a None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:35.067084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 204/400] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:50:35.072344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7de623-28e1-414c-bcda-88e42016896c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:35.072628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7de623-28e1-414c-bcda-88e42016896c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:35.072907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7de623-28e1-414c-bcda-88e42016896c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:35.100801 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ab7de623-28e1-414c-bcda-88e42016896c None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:35.102180 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ab7de623-28e1-414c-bcda-88e42016896c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:35.218734 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec3560-c093-43c0-b0d6-a11a248db057 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:35.235345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 205/401] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:35.257217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7de623-28e1-414c-bcda-88e42016896c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:35.285493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e1fce-ecc6-4228-9d82-786c99677e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:35.286150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e1fce-ecc6-4228-9d82-786c99677e2a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:35.286435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e1fce-ecc6-4228-9d82-786c99677e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:35.286712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e1fce-ecc6-4228-9d82-786c99677e2a None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:35.288524 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e1fce-ecc6-4228-9d82-786c99677e2a None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:35.292655 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:35.293704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e1fce-ecc6-4228-9d82-786c99677e2a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:35.297075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 197/402] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:35 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:35.301187 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e1fce-ecc6-4228-9d82-786c99677e2a None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:35.307471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:35.427873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e1fce-ecc6-4228-9d82-786c99677e2a None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:35.441879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7de623-28e1-414c-bcda-88e42016896c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:35.465598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbb957-4380-4820-bd5a-35276fc8f945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:35.466276 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbb957-4380-4820-bd5a-35276fc8f945 None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:35.466561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbb957-4380-4820-bd5a-35276fc8f945 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:35.466842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbb957-4380-4820-bd5a-35276fc8f945 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e/groups/828a7cf31bdb41f4bb44b989b7749fb4/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:35.469052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbb957-4380-4820-bd5a-35276fc8f945 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7c2c4a65c044df4afad820df6582f3e, group_id=828a7cf31bdb41f4bb44b989b7749fb4, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:35.471053 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbb957-4380-4820-bd5a-35276fc8f945 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:35.492072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 198/403] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Aug 10 07:50:35 2022] PUT /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e/groups/828a7cf31bdb41f4bb44b989b7749fb4/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:50:35.526641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cf832-682c-4699-820b-41fb9b3b21ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:35.527307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cf832-682c-4699-820b-41fb9b3b21ce None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:35.527588 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cf832-682c-4699-820b-41fb9b3b21ce None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:35.527887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cf832-682c-4699-820b-41fb9b3b21ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:35.548557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cf832-682c-4699-820b-41fb9b3b21ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-905cf832-682c-4699-820b-41fb9b3b21ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:35.553314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:35.555604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:35.558282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:35.558282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:35.558282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:35.558282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:35.558282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:35.558282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:35.558282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:35.558282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:35.558282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:35.558282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:35.558282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:35.558282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:35.560188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 206/404] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:50:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:35.569733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbb957-4380-4820-bd5a-35276fc8f945 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:35.575177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dd54d-e8bb-4951-adcd-1361acec2d30 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:35.575567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dd54d-e8bb-4951-adcd-1361acec2d30 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:35.575835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dd54d-e8bb-4951-adcd-1361acec2d30 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:35.577494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 207/405] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:50:35.583983 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35dfd2-fc1f-4808-84ea-61dd9fa31efa None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:35.584362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35dfd2-fc1f-4808-84ea-61dd9fa31efa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:35.584579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35dfd2-fc1f-4808-84ea-61dd9fa31efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:35.617617 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5c35dfd2-fc1f-4808-84ea-61dd9fa31efa None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:35.618857 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5c35dfd2-fc1f-4808-84ea-61dd9fa31efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:35.722094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:35.748727 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 208/406] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 10 07:50:35.784542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35dfd2-fc1f-4808-84ea-61dd9fa31efa None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:35.803032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbb957-4380-4820-bd5a-35276fc8f945 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:35.828272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:35.909080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664c18e-9334-4b05-aea6-ec66d5cd2934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:35.909813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664c18e-9334-4b05-aea6-ec66d5cd2934 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:35.910102 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664c18e-9334-4b05-aea6-ec66d5cd2934 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:35.910378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664c18e-9334-4b05-aea6-ec66d5cd2934 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:35.911062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664c18e-9334-4b05-aea6-ec66d5cd2934 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:35.911365 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664c18e-9334-4b05-aea6-ec66d5cd2934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:35.912787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664c18e-9334-4b05-aea6-ec66d5cd2934 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:35.937422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 199/407] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:35.943899 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664c18e-9334-4b05-aea6-ec66d5cd2934 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:36.090147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35dfd2-fc1f-4808-84ea-61dd9fa31efa None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:36.134522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8723a64-de19-4640-b2b4-0d1125a31483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:36.135766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8723a64-de19-4640-b2b4-0d1125a31483 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:36.136063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8723a64-de19-4640-b2b4-0d1125a31483 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:36.136340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8723a64-de19-4640-b2b4-0d1125a31483 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:36.143298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664c18e-9334-4b05-aea6-ec66d5cd2934 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8723a64-de19-4640-b2b4-0d1125a31483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e8723a64-de19-4640-b2b4-0d1125a31483 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:36.159174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:36.160799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:36.161635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 209/408] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:50:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:36.163049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecc966-df1b-4f86-a2da-527334c43b6a None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:36.163049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecc966-df1b-4f86-a2da-527334c43b6a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:36.163049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecc966-df1b-4f86-a2da-527334c43b6a None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:36.163049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 210/409] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:36.169080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecc966-df1b-4f86-a2da-527334c43b6a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:36.186554 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:36.197377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beff7a9-8ebc-4222-96e2-55d72354dac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:36.198468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beff7a9-8ebc-4222-96e2-55d72354dac6 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:36.198977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beff7a9-8ebc-4222-96e2-55d72354dac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:36.199459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beff7a9-8ebc-4222-96e2-55d72354dac6 None admin] PATH_INFO: `/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:36.200956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beff7a9-8ebc-4222-96e2-55d72354dac6 None admin] RBAC: Authorizing `identity:get_group(group_id=828a7cf31bdb41f4bb44b989b7749fb4)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:36.202704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beff7a9-8ebc-4222-96e2-55d72354dac6 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:36.204854 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 200/410] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:35 2022] GET /identity/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:36.207048 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f82b3c-2156-4d79-a2f5-dcd870d1fdae None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:36.207688 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f82b3c-2156-4d79-a2f5-dcd870d1fdae None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:36.208335 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f82b3c-2156-4d79-a2f5-dcd870d1fdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:36.237605 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-27f82b3c-2156-4d79-a2f5-dcd870d1fdae None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:36.238866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-27f82b3c-2156-4d79-a2f5-dcd870d1fdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:36.283402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:36.321550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecc966-df1b-4f86-a2da-527334c43b6a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:36.327752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 201/411] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:36.327752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f82b3c-2156-4d79-a2f5-dcd870d1fdae None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:36.399414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f3ead-52fb-42e0-897d-3a7cf7c5e125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:36.401051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f3ead-52fb-42e0-897d-3a7cf7c5e125 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:36.401503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f3ead-52fb-42e0-897d-3a7cf7c5e125 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:36.401940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f3ead-52fb-42e0-897d-3a7cf7c5e125 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:36.403644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f3ead-52fb-42e0-897d-3a7cf7c5e125 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:36.404493 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f3ead-52fb-42e0-897d-3a7cf7c5e125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:36.406990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f3ead-52fb-42e0-897d-3a7cf7c5e125 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:36.427904 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 211/412] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:36.429388 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f3ead-52fb-42e0-897d-3a7cf7c5e125 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:36.455444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f82b3c-2156-4d79-a2f5-dcd870d1fdae None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:36.483722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:36.500198 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5abe8-6dcf-42d0-af04-270c0d161c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:36.500873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5abe8-6dcf-42d0-af04-270c0d161c8b None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:36.501170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5abe8-6dcf-42d0-af04-270c0d161c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:36.501526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5abe8-6dcf-42d0-af04-270c0d161c8b None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:36.502953 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5abe8-6dcf-42d0-af04-270c0d161c8b None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:36.504630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5abe8-6dcf-42d0-af04-270c0d161c8b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:36.506908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 202/413] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:36 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:36.512648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5abe8-6dcf-42d0-af04-270c0d161c8b None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:36.557863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f3ead-52fb-42e0-897d-3a7cf7c5e125 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:36.589276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:36.595372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b772e-4e09-4716-9377-becc0ed98f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:36.597017 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b772e-4e09-4716-9377-becc0ed98f02 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:36.597520 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b772e-4e09-4716-9377-becc0ed98f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:36.598112 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b772e-4e09-4716-9377-becc0ed98f02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:36.612704 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b772e-4e09-4716-9377-becc0ed98f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-493b772e-4e09-4716-9377-becc0ed98f02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:36.618506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:36.619473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:36.620609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:36.620609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:36.620609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:36.620609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:36.620609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:36.620609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:36.620609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:36.620609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:36.620609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:36.620609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:36.620609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:36.620609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:36.620609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 212/414] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:36.621267 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b772e-4e09-4716-9377-becc0ed98f02 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:36.642954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5abe8-6dcf-42d0-af04-270c0d161c8b None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:36.680704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eac24-4970-4bbd-8b97-112e255373b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:36.681725 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eac24-4970-4bbd-8b97-112e255373b9 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:36.682216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eac24-4970-4bbd-8b97-112e255373b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:36.682774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eac24-4970-4bbd-8b97-112e255373b9 None admin] PATH_INFO: `/v3/groups/fb66595b2d6a4beab0ab526332f1d556` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:36.684552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723eac24-4970-4bbd-8b97-112e255373b9 None admin] RBAC: Authorizing `identity:get_group(group_id=fb66595b2d6a4beab0ab526332f1d556)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:36.686447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723eac24-4970-4bbd-8b97-112e255373b9 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:36.688658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 203/415] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:36 2022] GET /identity/v3/groups/fb66595b2d6a4beab0ab526332f1d556 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:36.689667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eac24-4970-4bbd-8b97-112e255373b9 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:36.757068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:36.759650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b772e-4e09-4716-9377-becc0ed98f02 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:36.801429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5aaf1-6dab-4e39-8bcb-427f08e4e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:36.802998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5aaf1-6dab-4e39-8bcb-427f08e4e256 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:36.804419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5aaf1-6dab-4e39-8bcb-427f08e4e256 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:36.804977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5aaf1-6dab-4e39-8bcb-427f08e4e256 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e/groups/828a7cf31bdb41f4bb44b989b7749fb4/roles/a5a6c597145c4b23983d1b04377af7ed` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:36.807665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5aaf1-6dab-4e39-8bcb-427f08e4e256 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7c2c4a65c044df4afad820df6582f3e, group_id=828a7cf31bdb41f4bb44b989b7749fb4, role_id=a5a6c597145c4b23983d1b04377af7ed)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:36.809562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5aaf1-6dab-4e39-8bcb-427f08e4e256 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:36.817440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eac24-4970-4bbd-8b97-112e255373b9 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:36.831927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 213/416] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Aug 10 07:50:36 2022] PUT /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e/groups/828a7cf31bdb41f4bb44b989b7749fb4/roles/a5a6c597145c4b23983d1b04377af7ed => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:50:36.833305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5aaf1-6dab-4e39-8bcb-427f08e4e256 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:36.873663 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97f809-b2d5-4a4d-9734-3a6019ab807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:36.874443 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97f809-b2d5-4a4d-9734-3a6019ab807d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:36.874722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97f809-b2d5-4a4d-9734-3a6019ab807d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:36.875079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97f809-b2d5-4a4d-9734-3a6019ab807d None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:36.875898 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97f809-b2d5-4a4d-9734-3a6019ab807d None admin] RBAC: Adding query filter params (name=member) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:36.876257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97f809-b2d5-4a4d-9734-3a6019ab807d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:36.877907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97f809-b2d5-4a4d-9734-3a6019ab807d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:36.907863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 204/417] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:36.911273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97f809-b2d5-4a4d-9734-3a6019ab807d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:36.980176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:37.069577 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5aaf1-6dab-4e39-8bcb-427f08e4e256 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:37.121347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97f809-b2d5-4a4d-9734-3a6019ab807d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:37.125351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e221b42-2cd7-4c0c-8ee7-df456075bc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:37.126000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e221b42-2cd7-4c0c-8ee7-df456075bc85 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:37.126279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e221b42-2cd7-4c0c-8ee7-df456075bc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:37.126546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e221b42-2cd7-4c0c-8ee7-df456075bc85 None admin] PATH_INFO: `/v3/projects/5422809609a44bf7a3e055f250264a66` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:37.127763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e221b42-2cd7-4c0c-8ee7-df456075bc85 None admin] RBAC: Authorizing `identity:get_project(project_id=5422809609a44bf7a3e055f250264a66)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:37.129336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e221b42-2cd7-4c0c-8ee7-df456075bc85 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:37.131210 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 214/418] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:36 2022] GET /identity/v3/projects/5422809609a44bf7a3e055f250264a66 => generated 344 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:37.132470 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8a1fb-455d-439f-8bef-5119c479a75b None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:37.132750 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8a1fb-455d-439f-8bef-5119c479a75b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:37.137941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8a1fb-455d-439f-8bef-5119c479a75b None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:37.139864 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 215/419] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:37.140663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8a1fb-455d-439f-8bef-5119c479a75b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:37.150026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:37.165297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c184-7c77-4362-965a-ef292b326107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:37.166071 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c184-7c77-4362-965a-ef292b326107 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:37.166360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c184-7c77-4362-965a-ef292b326107 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:37.166636 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c184-7c77-4362-965a-ef292b326107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:37.250553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05c184-7c77-4362-965a-ef292b326107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:37.252011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05c184-7c77-4362-965a-ef292b326107 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:37.260136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8a1fb-455d-439f-8bef-5119c479a75b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:37.284520 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:37.301983 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19503980-f3d9-49b2-a761-d92b50d4d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:37.302663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19503980-f3d9-49b2-a761-d92b50d4d88e None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:37.302942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19503980-f3d9-49b2-a761-d92b50d4d88e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:37.303214 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19503980-f3d9-49b2-a761-d92b50d4d88e None admin] PATH_INFO: `/v3/projects/5422809609a44bf7a3e055f250264a66/groups/fb66595b2d6a4beab0ab526332f1d556/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:37.306114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19503980-f3d9-49b2-a761-d92b50d4d88e None admin] RBAC: Authorizing `identity:create_grant(project_id=5422809609a44bf7a3e055f250264a66, group_id=fb66595b2d6a4beab0ab526332f1d556, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:37.307566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19503980-f3d9-49b2-a761-d92b50d4d88e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:37.331867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 216/420] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Aug 10 07:50:37 2022] PUT /identity/v3/projects/5422809609a44bf7a3e055f250264a66/groups/fb66595b2d6a4beab0ab526332f1d556/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:50:37.333977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd84d5-52ae-47c5-9331-11b69663fbc0 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:37.334847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd84d5-52ae-47c5-9331-11b69663fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:37.335424 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd84d5-52ae-47c5-9331-11b69663fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:37.378741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-bbdd84d5-52ae-47c5-9331-11b69663fbc0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:37.380826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-bbdd84d5-52ae-47c5-9331-11b69663fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:37.428244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 205/421] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 07:50:37.433871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c184-7c77-4362-965a-ef292b326107 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:37.480611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:37.549406 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 217/422] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:37.593495 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd84d5-52ae-47c5-9331-11b69663fbc0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:37.602959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c184-7c77-4362-965a-ef292b326107 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:37.650016 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc378a-5317-4f7c-b4b4-6af24b04935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:37.650747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc378a-5317-4f7c-b4b4-6af24b04935f None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:37.651044 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc378a-5317-4f7c-b4b4-6af24b04935f None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:37.651441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc378a-5317-4f7c-b4b4-6af24b04935f None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:37.656684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc378a-5317-4f7c-b4b4-6af24b04935f None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:37.658268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc378a-5317-4f7c-b4b4-6af24b04935f None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:37.660424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 206/423] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:37 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:37.669728 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc378a-5317-4f7c-b4b4-6af24b04935f None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:37.776323 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd84d5-52ae-47c5-9331-11b69663fbc0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:37.795968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:37.864552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c0ec5-cc83-4298-8bc0-342af76e54f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:37.866059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c0ec5-cc83-4298-8bc0-342af76e54f0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:37.866813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c0ec5-cc83-4298-8bc0-342af76e54f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:37.867858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c0ec5-cc83-4298-8bc0-342af76e54f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:37.886441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:37.898556 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c0ec5-cc83-4298-8bc0-342af76e54f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-754c0ec5-cc83-4298-8bc0-342af76e54f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:37.911808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:37.912836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:37.913709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:37.913709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:37.913709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:37.913709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:37.913709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:37.913709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:37.913709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:37.913709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:37.913709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:37.913709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:37.913709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:37.913709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:37.920884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc378a-5317-4f7c-b4b4-6af24b04935f None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:37.921942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 218/424] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:50:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:37.926632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c0ec5-cc83-4298-8bc0-342af76e54f0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:38.008030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362948a-f69e-4e79-95d1-a4ba83ba56fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:38.009042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362948a-f69e-4e79-95d1-a4ba83ba56fa None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:38.009526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362948a-f69e-4e79-95d1-a4ba83ba56fa None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:38.010024 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362948a-f69e-4e79-95d1-a4ba83ba56fa None admin] PATH_INFO: `/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:38.012001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362948a-f69e-4e79-95d1-a4ba83ba56fa None admin] RBAC: Authorizing `identity:get_group(group_id=828a7cf31bdb41f4bb44b989b7749fb4)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:38.013570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362948a-f69e-4e79-95d1-a4ba83ba56fa None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:38.015451 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 207/425] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:37 2022] GET /identity/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4 => generated 226 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:38.016994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a65c9c-2e4e-40aa-81f5-0c240a228ba2 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:38.017179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a65c9c-2e4e-40aa-81f5-0c240a228ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:38.017469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a65c9c-2e4e-40aa-81f5-0c240a228ba2 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:38.022915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 208/426] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:38.023883 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a65c9c-2e4e-40aa-81f5-0c240a228ba2 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:38.099673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c0ec5-cc83-4298-8bc0-342af76e54f0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:38.140831 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00749-7dd2-4d30-bf19-66dd49030f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:38.141352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00749-7dd2-4d30-bf19-66dd49030f57 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:38.141740 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00749-7dd2-4d30-bf19-66dd49030f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:38.141917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00749-7dd2-4d30-bf19-66dd49030f57 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:38.142557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff00749-7dd2-4d30-bf19-66dd49030f57 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:38.142859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff00749-7dd2-4d30-bf19-66dd49030f57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:38.144295 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff00749-7dd2-4d30-bf19-66dd49030f57 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:38.153805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 219/427] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:38.155099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6ecb9-362e-466d-8503-d35f489a4f39 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:38.155392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6ecb9-362e-466d-8503-d35f489a4f39 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:38.155672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6ecb9-362e-466d-8503-d35f489a4f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:38.163983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a65c9c-2e4e-40aa-81f5-0c240a228ba2 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:38.177515 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-32d6ecb9-362e-466d-8503-d35f489a4f39 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:38.179620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-32d6ecb9-362e-466d-8503-d35f489a4f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:38.202805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f379ec3-f1ea-4442-a4d6-51d8a3cfae82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:38.203676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f379ec3-f1ea-4442-a4d6-51d8a3cfae82 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:38.204196 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f379ec3-f1ea-4442-a4d6-51d8a3cfae82 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:38.204616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f379ec3-f1ea-4442-a4d6-51d8a3cfae82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:38.205529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f379ec3-f1ea-4442-a4d6-51d8a3cfae82 None admin] RBAC: Adding query filter params (group.id=828a7cf31bdb41f4bb44b989b7749fb4, role.id=9d10ee7e27e242ba801222cf0264ea8d, scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:38.206043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f379ec3-f1ea-4442-a4d6-51d8a3cfae82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:38.207820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f379ec3-f1ea-4442-a4d6-51d8a3cfae82 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:38.216023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 209/428] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 10 07:50:38 2022] GET /identity/v3/role_assignments?group.id=828a7cf31bdb41f4bb44b989b7749fb4&scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6&role.id=9d10ee7e27e242ba801222cf0264ea8d => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:38.217415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f379ec3-f1ea-4442-a4d6-51d8a3cfae82 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:38.244168 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:38.249746 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:38.300184 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 220/429] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:38.336250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6ecb9-362e-466d-8503-d35f489a4f39 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:38.384668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f379ec3-f1ea-4442-a4d6-51d8a3cfae82 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:38.451825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a58ff2-7282-41d2-8520-4c163bffc055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:38.453361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a58ff2-7282-41d2-8520-4c163bffc055 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:38.454122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a58ff2-7282-41d2-8520-4c163bffc055 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:38.454828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a58ff2-7282-41d2-8520-4c163bffc055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:38.500084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6ecb9-362e-466d-8503-d35f489a4f39 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:38.541594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc794904-bad8-4058-baa6-472830518469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:38.542234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc794904-bad8-4058-baa6-472830518469 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:38.542513 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc794904-bad8-4058-baa6-472830518469 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:38.542781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc794904-bad8-4058-baa6-472830518469 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:38.557363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc794904-bad8-4058-baa6-472830518469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-dc794904-bad8-4058-baa6-472830518469 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:38.563102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:38.565061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:38.566648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:38.566648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:38.566648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:38.566648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:38.566648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:38.566648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:38.566648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:38.566648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:38.566648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:38.566648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:38.566648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:50:38.566648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:38.566648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 221/430] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:38.571552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc794904-bad8-4058-baa6-472830518469 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:38.592143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a58ff2-7282-41d2-8520-4c163bffc055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:38.594132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a58ff2-7282-41d2-8520-4c163bffc055 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:38.605038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:38.629421 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:38.687159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc794904-bad8-4058-baa6-472830518469 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:38.721414 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 210/431] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:38.728400 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a58ff2-7282-41d2-8520-4c163bffc055 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:38.737061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9119a-a0a2-4613-94d0-9659df7a732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:38.738087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9119a-a0a2-4613-94d0-9659df7a732f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:38.738593 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9119a-a0a2-4613-94d0-9659df7a732f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:38.739094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9119a-a0a2-4613-94d0-9659df7a732f None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:38.740094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9119a-a0a2-4613-94d0-9659df7a732f None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:38.740836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9119a-a0a2-4613-94d0-9659df7a732f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:38.742638 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9119a-a0a2-4613-94d0-9659df7a732f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:38.758059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 222/432] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:50:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:38.763279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9119a-a0a2-4613-94d0-9659df7a732f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:38.864346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a58ff2-7282-41d2-8520-4c163bffc055 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:38.892353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:38.902084 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:38.908985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9119a-a0a2-4613-94d0-9659df7a732f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:38.925347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c65c8-509c-40c1-9afa-0b9ad1910f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:38.926013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c65c8-509c-40c1-9afa-0b9ad1910f67 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:38.926774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c65c8-509c-40c1-9afa-0b9ad1910f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:38.927058 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c65c8-509c-40c1-9afa-0b9ad1910f67 None admin] PATH_INFO: `/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:38.930635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c65c8-509c-40c1-9afa-0b9ad1910f67 None admin] RBAC: Authorizing `identity:get_project(project_id=c9c0cc72f061412b9d0108f4fefb40a6)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:38.932145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c65c8-509c-40c1-9afa-0b9ad1910f67 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:38.937490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 211/433] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:38 2022] GET /identity/v3/projects/c9c0cc72f061412b9d0108f4fefb40a6 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:38.942873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c65c8-509c-40c1-9afa-0b9ad1910f67 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:38.968725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc738e2-f964-4778-a3c5-d5f5a8532a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:38.969369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc738e2-f964-4778-a3c5-d5f5a8532a9e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:38.969658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc738e2-f964-4778-a3c5-d5f5a8532a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:38.969986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc738e2-f964-4778-a3c5-d5f5a8532a9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:39.073212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc738e2-f964-4778-a3c5-d5f5a8532a9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:39.074981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc738e2-f964-4778-a3c5-d5f5a8532a9e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:39.102898 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c65c8-509c-40c1-9afa-0b9ad1910f67 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:39.163532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b90e85-5ce2-451c-aa35-e600631e035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:39.164312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b90e85-5ce2-451c-aa35-e600631e035e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:39.164601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b90e85-5ce2-451c-aa35-e600631e035e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:39.164884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b90e85-5ce2-451c-aa35-e600631e035e None admin] PATH_INFO: `/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:39.166218 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b90e85-5ce2-451c-aa35-e600631e035e None admin] RBAC: Authorizing `identity:get_group(group_id=828a7cf31bdb41f4bb44b989b7749fb4)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:39.167914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b90e85-5ce2-451c-aa35-e600631e035e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:39.170138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 212/434] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:38 2022] GET /identity/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:39.176355 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b90e85-5ce2-451c-aa35-e600631e035e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:39.212194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:39.242929 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 223/435] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 07:50:39.252684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc738e2-f964-4778-a3c5-d5f5a8532a9e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:39.294048 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:39.353282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b90e85-5ce2-451c-aa35-e600631e035e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:39.406936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc738e2-f964-4778-a3c5-d5f5a8532a9e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:39.407146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22372852-4402-40c0-9176-2c20b21262a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:39.407592 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22372852-4402-40c0-9176-2c20b21262a9 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:39.407922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22372852-4402-40c0-9176-2c20b21262a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:39.408204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22372852-4402-40c0-9176-2c20b21262a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:39.408995 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22372852-4402-40c0-9176-2c20b21262a9 None admin] RBAC: Adding query filter params (group.id=828a7cf31bdb41f4bb44b989b7749fb4, role.id=a5a6c597145c4b23983d1b04377af7ed, scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:39.409312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22372852-4402-40c0-9176-2c20b21262a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:39.412284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22372852-4402-40c0-9176-2c20b21262a9 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:39.421123 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 213/436] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 10 07:50:39 2022] GET /identity/v3/role_assignments?group.id=828a7cf31bdb41f4bb44b989b7749fb4&scope.project.id=c9c0cc72f061412b9d0108f4fefb40a6&role.id=a5a6c597145c4b23983d1b04377af7ed => generated 611 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:39.458710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8ef5d-59dc-4344-a28a-d9fd33532d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:39.459414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8ef5d-59dc-4344-a28a-d9fd33532d53 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:39.460298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8ef5d-59dc-4344-a28a-d9fd33532d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:39.460559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8ef5d-59dc-4344-a28a-d9fd33532d53 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:39.461961 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8ef5d-59dc-4344-a28a-d9fd33532d53 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:39.463594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8ef5d-59dc-4344-a28a-d9fd33532d53 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:39.465823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 224/437] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:39 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:39.471481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22372852-4402-40c0-9176-2c20b21262a9 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:39.524098 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9e576-0214-4f95-9da4-f118676984b0 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:39.524419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9e576-0214-4f95-9da4-f118676984b0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:39.527204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9e576-0214-4f95-9da4-f118676984b0 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:39.535778 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 225/438] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:39.537249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762be101-5532-4d26-99aa-b713a5baa5ed None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:39.537541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762be101-5532-4d26-99aa-b713a5baa5ed None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:39.537897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762be101-5532-4d26-99aa-b713a5baa5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:39.567356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-762be101-5532-4d26-99aa-b713a5baa5ed None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:39.573182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-762be101-5532-4d26-99aa-b713a5baa5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:39.623756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22372852-4402-40c0-9176-2c20b21262a9 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:39.640700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:39.666924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:39.670638 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 226/439] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:39.686972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c12bb-b6a6-4ebc-b059-585a2c1454f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:39.687638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c12bb-b6a6-4ebc-b059-585a2c1454f4 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:39.687976 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c12bb-b6a6-4ebc-b059-585a2c1454f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:39.688260 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c12bb-b6a6-4ebc-b059-585a2c1454f4 None admin] PATH_INFO: `/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:39.689508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c12bb-b6a6-4ebc-b059-585a2c1454f4 None admin] RBAC: Authorizing `identity:get_group(group_id=828a7cf31bdb41f4bb44b989b7749fb4)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:39.691099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c12bb-b6a6-4ebc-b059-585a2c1454f4 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:39.693162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 214/440] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:39 2022] GET /identity/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:39.695130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762be101-5532-4d26-99aa-b713a5baa5ed None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:39.701069 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c12bb-b6a6-4ebc-b059-585a2c1454f4 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:39.844646 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c12bb-b6a6-4ebc-b059-585a2c1454f4 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:39.875483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762be101-5532-4d26-99aa-b713a5baa5ed None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:39.900630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4bd69-36ff-4ec0-b12d-64a009ed9c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:39.901266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4bd69-36ff-4ec0-b12d-64a009ed9c38 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:39.901829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4bd69-36ff-4ec0-b12d-64a009ed9c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:39.901937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4bd69-36ff-4ec0-b12d-64a009ed9c38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:39.902705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4bd69-36ff-4ec0-b12d-64a009ed9c38 None admin] RBAC: Adding query filter params (group.id=828a7cf31bdb41f4bb44b989b7749fb4, role.id=9d10ee7e27e242ba801222cf0264ea8d, scope.project.id=a7c2c4a65c044df4afad820df6582f3e) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:39.903250 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4bd69-36ff-4ec0-b12d-64a009ed9c38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:39.904508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4bd69-36ff-4ec0-b12d-64a009ed9c38 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:39.912309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 215/441] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 10 07:50:39 2022] GET /identity/v3/role_assignments?group.id=828a7cf31bdb41f4bb44b989b7749fb4&scope.project.id=a7c2c4a65c044df4afad820df6582f3e&role.id=9d10ee7e27e242ba801222cf0264ea8d => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:39.914032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acdcae-32b7-4d6d-a464-2dd3d19a6710 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:39.914032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acdcae-32b7-4d6d-a464-2dd3d19a6710 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:39.914249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acdcae-32b7-4d6d-a464-2dd3d19a6710 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:39.919905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 216/442] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:39.929673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a315a5-d857-4b85-92a1-a00b31ac2221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:39.930352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a315a5-d857-4b85-92a1-a00b31ac2221 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:39.930625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a315a5-d857-4b85-92a1-a00b31ac2221 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:39.930901 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a315a5-d857-4b85-92a1-a00b31ac2221 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:39.931858 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571168e-ebd0-4c9f-bd5b-2fb90b5ed07b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:39.932425 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571168e-ebd0-4c9f-bd5b-2fb90b5ed07b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:39.932913 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571168e-ebd0-4c9f-bd5b-2fb90b5ed07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:39.953519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a315a5-d857-4b85-92a1-a00b31ac2221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-50a315a5-d857-4b85-92a1-a00b31ac2221 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:39.958449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:39.959584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:39.961583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:39.961583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:39.961583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:39.961583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:39.961583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:39.961583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:39.961583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:39.961583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:39.961583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:39.961583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:39.961583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:39.961583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:39.963222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-9571168e-ebd0-4c9f-bd5b-2fb90b5ed07b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:39.964183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 227/443] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:50:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:39.965173 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-9571168e-ebd0-4c9f-bd5b-2fb90b5ed07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:39.966955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a315a5-d857-4b85-92a1-a00b31ac2221 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:40.039564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:40.040589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:40.080182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 217/444] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:40.097698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571168e-ebd0-4c9f-bd5b-2fb90b5ed07b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:40.112795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a315a5-d857-4b85-92a1-a00b31ac2221 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:40.166246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e459d-9322-4266-8c19-6fba842fad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:40.166799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e459d-9322-4266-8c19-6fba842fad51 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:40.167800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e459d-9322-4266-8c19-6fba842fad51 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:40.167999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e459d-9322-4266-8c19-6fba842fad51 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:40.168709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e459d-9322-4266-8c19-6fba842fad51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:40.169872 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e459d-9322-4266-8c19-6fba842fad51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:40.170582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e459d-9322-4266-8c19-6fba842fad51 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:40.180449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 228/445] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:40.186022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e459d-9322-4266-8c19-6fba842fad51 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:40.235348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571168e-ebd0-4c9f-bd5b-2fb90b5ed07b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:40.282244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e60d-f4bb-416d-a1f5-eb1bdc833ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:40.282903 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e60d-f4bb-416d-a1f5-eb1bdc833ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:40.283269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e60d-f4bb-416d-a1f5-eb1bdc833ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:40.283559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e60d-f4bb-416d-a1f5-eb1bdc833ba2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:40.297724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817e60d-f4bb-416d-a1f5-eb1bdc833ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-3817e60d-f4bb-416d-a1f5-eb1bdc833ba2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:40.302737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:40.304323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:40.305447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:40.305447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:40.305447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:40.305447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:40.305447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:40.305447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:40.305447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:40.305447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:40.305447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:40.305447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:40.305447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:50:40.305447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:40.305447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 218/446] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:50:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:40.311310 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e60d-f4bb-416d-a1f5-eb1bdc833ba2 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:40.331550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e459d-9322-4266-8c19-6fba842fad51 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:40.337626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:40.378578 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:40.397019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1696a3-fea8-4f26-9fc0-bcee3bf7a4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:40.397762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1696a3-fea8-4f26-9fc0-bcee3bf7a4ac None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:40.398190 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1696a3-fea8-4f26-9fc0-bcee3bf7a4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:40.398523 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1696a3-fea8-4f26-9fc0-bcee3bf7a4ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:40.446365 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e60d-f4bb-416d-a1f5-eb1bdc833ba2 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:40.484632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1696a3-fea8-4f26-9fc0-bcee3bf7a4ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:40.486375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1696a3-fea8-4f26-9fc0-bcee3bf7a4ac None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:40.490697 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9983c-a2d0-469e-86fe-dc48010eacb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:40.491904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9983c-a2d0-469e-86fe-dc48010eacb0 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:40.492186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9983c-a2d0-469e-86fe-dc48010eacb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:40.492455 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9983c-a2d0-469e-86fe-dc48010eacb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:40.493138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9983c-a2d0-469e-86fe-dc48010eacb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:40.493441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9983c-a2d0-469e-86fe-dc48010eacb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:40.494821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9983c-a2d0-469e-86fe-dc48010eacb0 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:40.506187 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 219/447] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:40.512929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9983c-a2d0-469e-86fe-dc48010eacb0 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:40.611543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 229/448] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 07:50:40.617934 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1696a3-fea8-4f26-9fc0-bcee3bf7a4ac None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:40.621794 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:40.654712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9983c-a2d0-469e-86fe-dc48010eacb0 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:40.662413 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:40.692496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e3bcd-291d-4db3-a557-6051c38bd8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:40.693110 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e3bcd-291d-4db3-a557-6051c38bd8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:40.693389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e3bcd-291d-4db3-a557-6051c38bd8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:40.693659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e3bcd-291d-4db3-a557-6051c38bd8d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:40.727864 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1696a3-fea8-4f26-9fc0-bcee3bf7a4ac None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:40.763611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e3bcd-291d-4db3-a557-6051c38bd8d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:40.765111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e3bcd-291d-4db3-a557-6051c38bd8d5 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:40.765353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cb941-4fe1-47f8-ba64-07b26e2682c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:40.765993 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cb941-4fe1-47f8-ba64-07b26e2682c3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:40.766276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cb941-4fe1-47f8-ba64-07b26e2682c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:40.766551 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cb941-4fe1-47f8-ba64-07b26e2682c3 None admin] PATH_INFO: `/v3/projects/a7c2c4a65c044df4afad820df6582f3e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:40.767698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cb941-4fe1-47f8-ba64-07b26e2682c3 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c2c4a65c044df4afad820df6582f3e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:40.769269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cb941-4fe1-47f8-ba64-07b26e2682c3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:40.770929 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 230/449] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:40 2022] GET /identity/v3/projects/a7c2c4a65c044df4afad820df6582f3e => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:40.777134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cb941-4fe1-47f8-ba64-07b26e2682c3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:40.850450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:40.876132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 220/450] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 07:50:40.882323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e3bcd-291d-4db3-a557-6051c38bd8d5 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:40.884141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cb941-4fe1-47f8-ba64-07b26e2682c3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:40.891407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:40.924154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c478865-3454-4852-8fc7-1d14fb91c3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:40.924791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478865-3454-4852-8fc7-1d14fb91c3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:40.925076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478865-3454-4852-8fc7-1d14fb91c3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:40.925350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478865-3454-4852-8fc7-1d14fb91c3f6 None admin] PATH_INFO: `/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:40.926493 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c478865-3454-4852-8fc7-1d14fb91c3f6 None admin] RBAC: Authorizing `identity:get_group(group_id=828a7cf31bdb41f4bb44b989b7749fb4)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:40.927964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c478865-3454-4852-8fc7-1d14fb91c3f6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:40.930126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 231/451] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:40 2022] GET /identity/v3/groups/828a7cf31bdb41f4bb44b989b7749fb4 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:40.937108 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c478865-3454-4852-8fc7-1d14fb91c3f6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:40.990799 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e3bcd-291d-4db3-a557-6051c38bd8d5 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:41.038623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421d77a-1a6c-4147-96c5-780a8caf04a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:41.039836 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421d77a-1a6c-4147-96c5-780a8caf04a8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:41.039836 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421d77a-1a6c-4147-96c5-780a8caf04a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:41.039836 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421d77a-1a6c-4147-96c5-780a8caf04a8 None admin] PATH_INFO: `/v3/projects/5422809609a44bf7a3e055f250264a66` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:41.041386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421d77a-1a6c-4147-96c5-780a8caf04a8 None admin] RBAC: Authorizing `identity:get_project(project_id=5422809609a44bf7a3e055f250264a66)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:41.042922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421d77a-1a6c-4147-96c5-780a8caf04a8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:41.044629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 221/452] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:50:40 2022] GET /identity/v3/projects/5422809609a44bf7a3e055f250264a66 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:41.045178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c478865-3454-4852-8fc7-1d14fb91c3f6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:41.050155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421d77a-1a6c-4147-96c5-780a8caf04a8 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:41.081565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae0717-6580-47fd-8035-7ab435e67651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:41.082177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae0717-6580-47fd-8035-7ab435e67651 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:41.082459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae0717-6580-47fd-8035-7ab435e67651 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:41.082731 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae0717-6580-47fd-8035-7ab435e67651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:41.083458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae0717-6580-47fd-8035-7ab435e67651 None admin] RBAC: Adding query filter params (group.id=828a7cf31bdb41f4bb44b989b7749fb4, role.id=a5a6c597145c4b23983d1b04377af7ed, scope.project.id=a7c2c4a65c044df4afad820df6582f3e) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:41.083795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae0717-6580-47fd-8035-7ab435e67651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:41.085297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae0717-6580-47fd-8035-7ab435e67651 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:41.091410 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 232/453] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 10 07:50:40 2022] GET /identity/v3/role_assignments?group.id=828a7cf31bdb41f4bb44b989b7749fb4&scope.project.id=a7c2c4a65c044df4afad820df6582f3e&role.id=a5a6c597145c4b23983d1b04377af7ed => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:41.134637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:41.163534 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421d77a-1a6c-4147-96c5-780a8caf04a8 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:41.203005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da6ec8-9e19-4c2c-bc01-05eea76274ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:41.203705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da6ec8-9e19-4c2c-bc01-05eea76274ac None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:41.204018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da6ec8-9e19-4c2c-bc01-05eea76274ac None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:41.204294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da6ec8-9e19-4c2c-bc01-05eea76274ac None admin] PATH_INFO: `/v3/groups/fb66595b2d6a4beab0ab526332f1d556` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:41.205496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da6ec8-9e19-4c2c-bc01-05eea76274ac None admin] RBAC: Authorizing `identity:get_group(group_id=fb66595b2d6a4beab0ab526332f1d556)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:41.206970 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da6ec8-9e19-4c2c-bc01-05eea76274ac None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:41.208631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 222/454] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 10 07:50:41 2022] GET /identity/v3/groups/fb66595b2d6a4beab0ab526332f1d556 => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:41.215043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae0717-6580-47fd-8035-7ab435e67651 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:41.219079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:41.322437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae0717-6580-47fd-8035-7ab435e67651 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:41.357194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30c428-1210-47eb-8c1a-3f749f1a9431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:41.357800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30c428-1210-47eb-8c1a-3f749f1a9431 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:41.358081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30c428-1210-47eb-8c1a-3f749f1a9431 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:41.358351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30c428-1210-47eb-8c1a-3f749f1a9431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:41.359091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30c428-1210-47eb-8c1a-3f749f1a9431 None admin] RBAC: Adding query filter params (group.id=fb66595b2d6a4beab0ab526332f1d556, role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=5422809609a44bf7a3e055f250264a66) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:41.359395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30c428-1210-47eb-8c1a-3f749f1a9431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:41.360881 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30c428-1210-47eb-8c1a-3f749f1a9431 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:41.367450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 233/455] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 10 07:50:41 2022] GET /identity/v3/role_assignments?group.id=fb66595b2d6a4beab0ab526332f1d556&scope.project.id=5422809609a44bf7a3e055f250264a66&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:44.114352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ed1bb-458b-4a12-b124-d893ae6d16af None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:44.114863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ed1bb-458b-4a12-b124-d893ae6d16af None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:44.114936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ed1bb-458b-4a12-b124-d893ae6d16af None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:44.116617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 223/456] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:44.126495 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b45e20-c63d-4908-81e4-54cdf648db1c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:44.126982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b45e20-c63d-4908-81e4-54cdf648db1c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:44.127360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b45e20-c63d-4908-81e4-54cdf648db1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:44.162903 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b3b45e20-c63d-4908-81e4-54cdf648db1c None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:44.164743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b3b45e20-c63d-4908-81e4-54cdf648db1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:44.266000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bdffd-ac39-4001-8c3c-36c21be7e787 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:44.266278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bdffd-ac39-4001-8c3c-36c21be7e787 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:44.266748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bdffd-ac39-4001-8c3c-36c21be7e787 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:44.268371 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 224/457] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:44.277193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ec11-4b8c-46e1-802b-edb5ae46964d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:44.277793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ec11-4b8c-46e1-802b-edb5ae46964d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:44.278370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ec11-4b8c-46e1-802b-edb5ae46964d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:44.282923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:44.290008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 234/458] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:44.315689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b45e20-c63d-4908-81e4-54cdf648db1c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:44.332707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-a1e2ec11-4b8c-46e1-802b-edb5ae46964d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:44.335823 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a1e2ec11-4b8c-46e1-802b-edb5ae46964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:44.481855 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 225/459] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:44.511289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b45e20-c63d-4908-81e4-54cdf648db1c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:44.589709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2ec11-4b8c-46e1-802b-edb5ae46964d None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:44.593795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4a9ce-1e95-4549-b71d-39555d8dec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:44.593954 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4a9ce-1e95-4549-b71d-39555d8dec5c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:44.599752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4a9ce-1e95-4549-b71d-39555d8dec5c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:44.599752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4a9ce-1e95-4549-b71d-39555d8dec5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:44.606663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4a9ce-1e95-4549-b71d-39555d8dec5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:44.608508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4a9ce-1e95-4549-b71d-39555d8dec5c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-07c4a9ce-1e95-4549-b71d-39555d8dec5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:44.625676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:44.626795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:44.627666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:44.627666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:44.627666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:44.627666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 235/460] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:44.636789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4a9ce-1e95-4549-b71d-39555d8dec5c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:44.694887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:44.755148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4a9ce-1e95-4549-b71d-39555d8dec5c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:44.760092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:44.795208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af66fa0-e8b3-4da4-938e-15fb169f1fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:44.795932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af66fa0-e8b3-4da4-938e-15fb169f1fbb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:44.796288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af66fa0-e8b3-4da4-938e-15fb169f1fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:44.796569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af66fa0-e8b3-4da4-938e-15fb169f1fbb None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:44.797334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af66fa0-e8b3-4da4-938e-15fb169f1fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:44.797696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af66fa0-e8b3-4da4-938e-15fb169f1fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:44.799257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af66fa0-e8b3-4da4-938e-15fb169f1fbb None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:44.805861 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2ec11-4b8c-46e1-802b-edb5ae46964d None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:44.820492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 236/461] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:44.827242 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af66fa0-e8b3-4da4-938e-15fb169f1fbb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:44.865465 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f621bf4-241d-4d11-a5de-41204b330ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:44.866060 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f621bf4-241d-4d11-a5de-41204b330ead None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:44.866346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f621bf4-241d-4d11-a5de-41204b330ead None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:44.866619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f621bf4-241d-4d11-a5de-41204b330ead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:44.878106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f621bf4-241d-4d11-a5de-41204b330ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:44.879562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f621bf4-241d-4d11-a5de-41204b330ead None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-2f621bf4-241d-4d11-a5de-41204b330ead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:44.903757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:44.904719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:44.905590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:44.905590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:44.905590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:44.905590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 226/462] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:44.905590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ac4a8-954a-48f1-b308-1f1bffec3678 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:44.905590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ac4a8-954a-48f1-b308-1f1bffec3678 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:44.905590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ac4a8-954a-48f1-b308-1f1bffec3678 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:44.905590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 227/463] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:44.906694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ac4a8-954a-48f1-b308-1f1bffec3678 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:44.956458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af66fa0-e8b3-4da4-938e-15fb169f1fbb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:44.969414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:45.003640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21655fac-917c-4003-ac52-1621bfa3e5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:45.004387 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21655fac-917c-4003-ac52-1621bfa3e5c8 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:45.004746 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21655fac-917c-4003-ac52-1621bfa3e5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:45.005111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21655fac-917c-4003-ac52-1621bfa3e5c8 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:45.007770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21655fac-917c-4003-ac52-1621bfa3e5c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:45.007883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21655fac-917c-4003-ac52-1621bfa3e5c8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:45.039758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 237/464] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:50:44 2022] POST /identity/v3/users => generated 246 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:50:45.039758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98e5ab-6b0a-40d1-967b-9e7c916c25c2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:45.039758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98e5ab-6b0a-40d1-967b-9e7c916c25c2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:45.039758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98e5ab-6b0a-40d1-967b-9e7c916c25c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:45.045286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ac4a8-954a-48f1-b308-1f1bffec3678 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:45.063840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5c98e5ab-6b0a-40d1-967b-9e7c916c25c2 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:45.065474 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5c98e5ab-6b0a-40d1-967b-9e7c916c25c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:45.076393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:45.089974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a4e44-6934-4621-802a-7e6175a1aaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:45.090798 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4e44-6934-4621-802a-7e6175a1aaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:45.091086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4e44-6934-4621-802a-7e6175a1aaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:45.091355 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4e44-6934-4621-802a-7e6175a1aaf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:45.092050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a4e44-6934-4621-802a-7e6175a1aaf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:45.092354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a4e44-6934-4621-802a-7e6175a1aaf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:45.093796 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a4e44-6934-4621-802a-7e6175a1aaf8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:45.111050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 228/465] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:45.112888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ac78c-bd0f-4c3b-bac6-da1fd89aea7a None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:45.114173 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ac78c-bd0f-4c3b-bac6-da1fd89aea7a None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:45.114293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ac78c-bd0f-4c3b-bac6-da1fd89aea7a None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:45.119955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 229/466] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:45.119955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ac78c-bd0f-4c3b-bac6-da1fd89aea7a None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:45.182501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 238/467] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:45.184929 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c653d-77e2-4fd3-928e-29b4e844e156 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:45.185444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c653d-77e2-4fd3-928e-29b4e844e156 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:45.185920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c653d-77e2-4fd3-928e-29b4e844e156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:45.208545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7a6c653d-77e2-4fd3-928e-29b4e844e156 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:45.210433 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7a6c653d-77e2-4fd3-928e-29b4e844e156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:45.277953 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ac78c-bd0f-4c3b-bac6-da1fd89aea7a None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:45.303790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 239/468] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:45.303790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c653d-77e2-4fd3-928e-29b4e844e156 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:45.330590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc5f18-ff0b-4921-b5dc-d0a1d6ac076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:45.331625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc5f18-ff0b-4921-b5dc-d0a1d6ac076b None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:45.331952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc5f18-ff0b-4921-b5dc-d0a1d6ac076b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:45.332225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc5f18-ff0b-4921-b5dc-d0a1d6ac076b None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:45.333178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc5f18-ff0b-4921-b5dc-d0a1d6ac076b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:45.335715 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc5f18-ff0b-4921-b5dc-d0a1d6ac076b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:45.336230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:45.364719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 230/469] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:50:45 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:50:45.365866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc5f18-ff0b-4921-b5dc-d0a1d6ac076b None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:45.421193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:45.421508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c653d-77e2-4fd3-928e-29b4e844e156 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:45.459078 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb70de-dbde-4c45-befd-c1b1bd42bacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:45.460302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb70de-dbde-4c45-befd-c1b1bd42bacd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:45.460580 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb70de-dbde-4c45-befd-c1b1bd42bacd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:45.460846 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb70de-dbde-4c45-befd-c1b1bd42bacd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:45.473235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb70de-dbde-4c45-befd-c1b1bd42bacd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:45.476039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb70de-dbde-4c45-befd-c1b1bd42bacd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-1cbb70de-dbde-4c45-befd-c1b1bd42bacd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:45.493522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:45.494514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:45.495339 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:45.495339 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:45.495339 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:45.495339 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 240/470] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:45.500912 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb70de-dbde-4c45-befd-c1b1bd42bacd None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:45.501901 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc5f18-ff0b-4921-b5dc-d0a1d6ac076b None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:45.543228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ea7d3-f0bf-49d6-bd9b-3e312e8b8d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:45.543897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ea7d3-f0bf-49d6-bd9b-3e312e8b8d88 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:45.544183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ea7d3-f0bf-49d6-bd9b-3e312e8b8d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:45.544457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ea7d3-f0bf-49d6-bd9b-3e312e8b8d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:45.560418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ea7d3-f0bf-49d6-bd9b-3e312e8b8d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:45.562319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ea7d3-f0bf-49d6-bd9b-3e312e8b8d88 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-dd3ea7d3-f0bf-49d6-bd9b-3e312e8b8d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:45.582324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:45.583308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:45.584161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:45.584161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:45.584161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:45.584161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 231/471] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:45.595095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ea7d3-f0bf-49d6-bd9b-3e312e8b8d88 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:45.597635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:45.629049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb70de-dbde-4c45-befd-c1b1bd42bacd None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:45.699243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dbdd3-9f87-41bc-bcb6-3c434a4f080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:45.699888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dbdd3-9f87-41bc-bcb6-3c434a4f080e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:45.700172 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dbdd3-9f87-41bc-bcb6-3c434a4f080e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:45.700443 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dbdd3-9f87-41bc-bcb6-3c434a4f080e None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:45.701100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dbdd3-9f87-41bc-bcb6-3c434a4f080e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:45.701402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dbdd3-9f87-41bc-bcb6-3c434a4f080e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:45.702783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dbdd3-9f87-41bc-bcb6-3c434a4f080e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:45.718427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 241/472] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:45.724999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dbdd3-9f87-41bc-bcb6-3c434a4f080e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:45.749180 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:45.759319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ea7d3-f0bf-49d6-bd9b-3e312e8b8d88 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:45.814987 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c9719-ee00-4318-a8b1-ef0d27112169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:45.816079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c9719-ee00-4318-a8b1-ef0d27112169 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:45.816568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c9719-ee00-4318-a8b1-ef0d27112169 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:45.817093 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c9719-ee00-4318-a8b1-ef0d27112169 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:45.817960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c9719-ee00-4318-a8b1-ef0d27112169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:45.818521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c9719-ee00-4318-a8b1-ef0d27112169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:45.820746 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c9719-ee00-4318-a8b1-ef0d27112169 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:45.836080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 232/473] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:45.845042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c9719-ee00-4318-a8b1-ef0d27112169 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:45.855453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dbdd3-9f87-41bc-bcb6-3c434a4f080e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:45.901196 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a3885-bfcd-48ab-8d4d-bdfe27636cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:45.901817 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a3885-bfcd-48ab-8d4d-bdfe27636cd4 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:45.902101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a3885-bfcd-48ab-8d4d-bdfe27636cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:45.902380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a3885-bfcd-48ab-8d4d-bdfe27636cd4 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:45.903139 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a3885-bfcd-48ab-8d4d-bdfe27636cd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:45.905231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a3885-bfcd-48ab-8d4d-bdfe27636cd4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:45.917684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:45.941598 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 242/474] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:50:45 2022] POST /identity/v3/users => generated 249 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:50:45.943184 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b37e12-f1b1-4fc9-9c32-988e61753a92 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:45.943614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b37e12-f1b1-4fc9-9c32-988e61753a92 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:45.944528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b37e12-f1b1-4fc9-9c32-988e61753a92 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:45.946448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 243/475] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:45.955977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f328dd-6649-457d-9fe6-d662a6b38921 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:45.955977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f328dd-6649-457d-9fe6-d662a6b38921 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:45.955977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f328dd-6649-457d-9fe6-d662a6b38921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:45.979428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-46f328dd-6649-457d-9fe6-d662a6b38921 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:45.981142 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-46f328dd-6649-457d-9fe6-d662a6b38921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:45.981732 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c9719-ee00-4318-a8b1-ef0d27112169 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:46.078607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 244/476] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:46.082703 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7fcec-4a75-4ea7-8a16-f28cb7a4b8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:46.083346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7fcec-4a75-4ea7-8a16-f28cb7a4b8c6 None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:46.083632 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7fcec-4a75-4ea7-8a16-f28cb7a4b8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:46.083942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7fcec-4a75-4ea7-8a16-f28cb7a4b8c6 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:46.084785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7fcec-4a75-4ea7-8a16-f28cb7a4b8c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:46.086322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7fcec-4a75-4ea7-8a16-f28cb7a4b8c6 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:46.106107 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f328dd-6649-457d-9fe6-d662a6b38921 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:46.119427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 233/477] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:50:45 2022] POST /identity/v3/users => generated 248 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:50:46.247958 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f328dd-6649-457d-9fe6-d662a6b38921 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:46.282201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:46.295621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c050b9c-3c57-4b1c-9630-e7a2670296eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:46.296282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c050b9c-3c57-4b1c-9630-e7a2670296eb None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:46.296567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c050b9c-3c57-4b1c-9630-e7a2670296eb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:46.296844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c050b9c-3c57-4b1c-9630-e7a2670296eb None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:46.297550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c050b9c-3c57-4b1c-9630-e7a2670296eb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:46.298989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c050b9c-3c57-4b1c-9630-e7a2670296eb None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:46.308587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.sql.core [None req-5c050b9c-3c57-4b1c-9630-e7a2670296eb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 07:50:46.308587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 07:50:46.308587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [parameters: {'id': 'a1fb3867aafc483d9afb0aff6f61e022', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 07:50:46.308587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80194) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-5c050b9c-3c57-4b1c-9630-e7a2670296eb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application conn.query(q) Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application result.read() Aug 10 07:50:46.327444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return ref.to_dict() Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 07:50:46.328377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application next(self.gen) Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application yield resource Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application next(self.gen) Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise self.value Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application session.commit() Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 07:50:46.329333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self.session.flush() Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application compat.raise_( Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 07:50:46.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 07:50:46.331111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application conn.query(q) Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application result.read() Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 07:50:46.331980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [parameters: {'id': 'a1fb3867aafc483d9afb0aff6f61e022', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:46.334266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 07:50:46.336237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:46.338081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 245/478] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Aug 10 07:50:46 2022] POST /identity/v3/roles => generated 144 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:46.343931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7fcec-4a75-4ea7-8a16-f28cb7a4b8c6 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:46.359145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:46.477306 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7fcec-4a75-4ea7-8a16-f28cb7a4b8c6 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:46.518887 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a3259-3308-42b9-b793-8719faa65c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:46.519881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a3259-3308-42b9-b793-8719faa65c8e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:46.520389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a3259-3308-42b9-b793-8719faa65c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:46.520854 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a3259-3308-42b9-b793-8719faa65c8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:46.532712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a3259-3308-42b9-b793-8719faa65c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-004a3259-3308-42b9-b793-8719faa65c8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:46.538941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:46.539856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:46.540635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:46.540635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:46.540635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:46.540635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:46.540635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:46.540635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:46.540635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:46.540635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:46.540635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:46.540635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:46.540635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:50:46.540635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:46.543249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 234/479] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:50:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:46.552532 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c050b9c-3c57-4b1c-9630-e7a2670296eb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:46.737956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c050b9c-3c57-4b1c-9630-e7a2670296eb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:46.814075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1bace-6828-428c-a763-7f6acb84931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:46.814927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1bace-6828-428c-a763-7f6acb84931e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:46.815353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1bace-6828-428c-a763-7f6acb84931e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:46.815826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1bace-6828-428c-a763-7f6acb84931e None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:46.816869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1bace-6828-428c-a763-7f6acb84931e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:46.817377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1bace-6828-428c-a763-7f6acb84931e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:46.820220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1bace-6828-428c-a763-7f6acb84931e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:46.833477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 246/480] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:47.640119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3babc-f6e2-4770-9034-b98a1ffc6b3f None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:47.640668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3babc-f6e2-4770-9034-b98a1ffc6b3f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:47.640668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3babc-f6e2-4770-9034-b98a1ffc6b3f None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:47.642284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 235/481] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:47.648393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc25686-5054-4ea6-a20f-4f4b5cf0641c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:47.648845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc25686-5054-4ea6-a20f-4f4b5cf0641c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:47.649044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc25686-5054-4ea6-a20f-4f4b5cf0641c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:47.671407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8bc25686-5054-4ea6-a20f-4f4b5cf0641c None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:47.672961 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8bc25686-5054-4ea6-a20f-4f4b5cf0641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:47.747451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:47.777383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 247/482] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:47.823519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3babc-f6e2-4770-9034-b98a1ffc6b3f None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:47.938572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:48.001021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3babc-f6e2-4770-9034-b98a1ffc6b3f None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:48.057896 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5488594-0bc3-4e53-8931-ce4baeab4d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:48.058543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5488594-0bc3-4e53-8931-ce4baeab4d76 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:48.058826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5488594-0bc3-4e53-8931-ce4baeab4d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:48.059097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5488594-0bc3-4e53-8931-ce4baeab4d76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:48.078428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5488594-0bc3-4e53-8931-ce4baeab4d76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-b5488594-0bc3-4e53-8931-ce4baeab4d76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:48.083159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:48.084083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:48.085444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:48.085444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:48.085444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:48.085444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:48.085444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:48.085444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:48.085444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:48.085444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:48.085444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:48.085444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:48.085444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:48.085444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:48.085444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 236/483] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:50:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:48.093159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc25686-5054-4ea6-a20f-4f4b5cf0641c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:48.290462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc25686-5054-4ea6-a20f-4f4b5cf0641c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:48.330818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b2058-b92d-4442-800c-00f46e949e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:48.331867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b2058-b92d-4442-800c-00f46e949e9c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:48.332385 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b2058-b92d-4442-800c-00f46e949e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:48.332873 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b2058-b92d-4442-800c-00f46e949e9c None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:48.333779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b2058-b92d-4442-800c-00f46e949e9c None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:48.334285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b2058-b92d-4442-800c-00f46e949e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:48.336512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b2058-b92d-4442-800c-00f46e949e9c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:48.346187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 248/484] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:50:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:48.352213 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5488594-0bc3-4e53-8931-ce4baeab4d76 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:48.505601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5488594-0bc3-4e53-8931-ce4baeab4d76 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:48.550444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:48.555011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63143b-553f-40f8-9eb8-93520fca62a1 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:48.555355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63143b-553f-40f8-9eb8-93520fca62a1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:48.555774 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63143b-553f-40f8-9eb8-93520fca62a1 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:48.557381 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 249/485] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:48.564001 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce6733-5585-40c1-aab8-9f2a8583a0a8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:48.564276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce6733-5585-40c1-aab8-9f2a8583a0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:48.564554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce6733-5585-40c1-aab8-9f2a8583a0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:48.576377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e7f30-6ef2-4430-9a45-a9e7be20339f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:48.577029 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e7f30-6ef2-4430-9a45-a9e7be20339f None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:48.577313 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e7f30-6ef2-4430-9a45-a9e7be20339f None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:48.577595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e7f30-6ef2-4430-9a45-a9e7be20339f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:48.601416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-32ce6733-5585-40c1-aab8-9f2a8583a0a8 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:48.602649 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-32ce6733-5585-40c1-aab8-9f2a8583a0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:48.609471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e7f30-6ef2-4430-9a45-a9e7be20339f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:48.611024 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e7f30-6ef2-4430-9a45-a9e7be20339f None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-931e7f30-6ef2-4430-9a45-a9e7be20339f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:48.638589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:48.641625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:48.643423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:48.643423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:48.643423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:48.643423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 237/486] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:48.647335 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e7f30-6ef2-4430-9a45-a9e7be20339f None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:48.692186 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:48.760963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e7f30-6ef2-4430-9a45-a9e7be20339f None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:48.800262 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f4512-e803-4199-afe1-2bd7cc60be64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:48.800956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f4512-e803-4199-afe1-2bd7cc60be64 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:48.801236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f4512-e803-4199-afe1-2bd7cc60be64 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:48.801491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f4512-e803-4199-afe1-2bd7cc60be64 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:48.802186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f4512-e803-4199-afe1-2bd7cc60be64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:48.802498 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f4512-e803-4199-afe1-2bd7cc60be64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:48.804547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f4512-e803-4199-afe1-2bd7cc60be64 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:48.817895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 238/488] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:48.818159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 250/488] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:48.827698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f4512-e803-4199-afe1-2bd7cc60be64 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:48.847469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce6733-5585-40c1-aab8-9f2a8583a0a8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:48.935623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:49.003391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f4512-e803-4199-afe1-2bd7cc60be64 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:49.042780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce6733-5585-40c1-aab8-9f2a8583a0a8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:49.044055 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89811ec-2f7c-4e96-a3e0-9f300f031d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:49.044699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89811ec-2f7c-4e96-a3e0-9f300f031d26 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:49.044983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89811ec-2f7c-4e96-a3e0-9f300f031d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:49.045298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89811ec-2f7c-4e96-a3e0-9f300f031d26 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:49.054285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89811ec-2f7c-4e96-a3e0-9f300f031d26 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:49.055748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89811ec-2f7c-4e96-a3e0-9f300f031d26 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-a89811ec-2f7c-4e96-a3e0-9f300f031d26 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:50:49.071115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:49.072134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:49.073050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:49.073050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:49.073050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:50:49.073050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:50:49.073050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:50:49.073050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:50:49.073050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:50:49.073050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:50:49.073050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:50:49.073050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:49.077336 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 239/489] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 10 07:50:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:49.078563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46410dd-3ca8-430e-99e9-44f05295a44d None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:49.078854 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46410dd-3ca8-430e-99e9-44f05295a44d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:49.079278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46410dd-3ca8-430e-99e9-44f05295a44d None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:49.085481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 240/490] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:49.085481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46410dd-3ca8-430e-99e9-44f05295a44d None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:49.097298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6b3ec-2718-48f3-9a61-86f021491d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:49.098912 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6b3ec-2718-48f3-9a61-86f021491d23 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:49.099765 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6b3ec-2718-48f3-9a61-86f021491d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:49.101012 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6b3ec-2718-48f3-9a61-86f021491d23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:49.114729 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6b3ec-2718-48f3-9a61-86f021491d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e0f6b3ec-2718-48f3-9a61-86f021491d23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:49.120518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:49.121555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:49.122402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:49.122402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:49.122402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:49.122402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:49.122402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:49.122402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:49.122402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:49.122402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:49.122402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:49.122402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:49.122402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:49.122402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:49.125622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 251/491] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:50:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:49.128540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543bb5-3b40-4016-bf88-6b5be213dc1f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:49.129538 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543bb5-3b40-4016-bf88-6b5be213dc1f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:49.130111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543bb5-3b40-4016-bf88-6b5be213dc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:49.150494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e4543bb5-3b40-4016-bf88-6b5be213dc1f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:49.152343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e4543bb5-3b40-4016-bf88-6b5be213dc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:49.188030 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:49.203922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:49.207928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46410dd-3ca8-430e-99e9-44f05295a44d None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:49.243790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 252/492] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:49.244420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543bb5-3b40-4016-bf88-6b5be213dc1f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:49.257850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad117109-74d7-49df-8339-d68a61b554f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:49.259373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad117109-74d7-49df-8339-d68a61b554f9 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:49.259860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad117109-74d7-49df-8339-d68a61b554f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:49.260401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad117109-74d7-49df-8339-d68a61b554f9 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:49.262838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad117109-74d7-49df-8339-d68a61b554f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:49.263685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad117109-74d7-49df-8339-d68a61b554f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:49.267826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad117109-74d7-49df-8339-d68a61b554f9 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:49.324781 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 241/493] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 10 07:50:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:49.326300 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88123a1c-5ac3-418b-805e-1be732c4f4e0 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:49.326591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88123a1c-5ac3-418b-805e-1be732c4f4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:49.326873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88123a1c-5ac3-418b-805e-1be732c4f4e0 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:49.331423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 242/494] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:49.331423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88123a1c-5ac3-418b-805e-1be732c4f4e0 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:49.402674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543bb5-3b40-4016-bf88-6b5be213dc1f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:49.448613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9843010-8e6e-42ec-9456-663c13f59281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:49.449504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9843010-8e6e-42ec-9456-663c13f59281 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:49.449769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9843010-8e6e-42ec-9456-663c13f59281 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:49.450043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9843010-8e6e-42ec-9456-663c13f59281 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:49.450820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9843010-8e6e-42ec-9456-663c13f59281 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:49.451098 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9843010-8e6e-42ec-9456-663c13f59281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:49.452539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9843010-8e6e-42ec-9456-663c13f59281 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:49.463991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 253/495] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:50:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:49.464893 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9843010-8e6e-42ec-9456-663c13f59281 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:49.491593 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88123a1c-5ac3-418b-805e-1be732c4f4e0 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:49.500362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:49.546141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97e9a6-59dc-47de-8f32-39308a170d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:49.547043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97e9a6-59dc-47de-8f32-39308a170d40 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:49.547330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97e9a6-59dc-47de-8f32-39308a170d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:49.547609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97e9a6-59dc-47de-8f32-39308a170d40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:49.559888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97e9a6-59dc-47de-8f32-39308a170d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-9d97e9a6-59dc-47de-8f32-39308a170d40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:49.564658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:49.566225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 243/496] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:50:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:49.568154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc587b-8e25-4e51-b251-5c84cd87896b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:49.569518 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc587b-8e25-4e51-b251-5c84cd87896b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:49.569518 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc587b-8e25-4e51-b251-5c84cd87896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:49.587268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-1efc587b-8e25-4e51-b251-5c84cd87896b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:49.588449 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1efc587b-8e25-4e51-b251-5c84cd87896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:49.604714 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:49.628084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9843010-8e6e-42ec-9456-663c13f59281 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:49.669358 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42753302-7d23-48e5-a4eb-f5149b833ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:49.670034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42753302-7d23-48e5-a4eb-f5149b833ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:49.670317 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42753302-7d23-48e5-a4eb-f5149b833ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:49.670590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42753302-7d23-48e5-a4eb-f5149b833ac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:49.686022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 244/497] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:49.687649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc587b-8e25-4e51-b251-5c84cd87896b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:49.768948 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42753302-7d23-48e5-a4eb-f5149b833ac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:49.770431 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42753302-7d23-48e5-a4eb-f5149b833ac3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:49.807888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:49.833790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc587b-8e25-4e51-b251-5c84cd87896b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:49.884057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c1ebe-39fb-4635-9bf8-f3bf6608a97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:49.884602 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c1ebe-39fb-4635-9bf8-f3bf6608a97c None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:49.884880 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c1ebe-39fb-4635-9bf8-f3bf6608a97c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:49.885151 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c1ebe-39fb-4635-9bf8-f3bf6608a97c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:49.895370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c1ebe-39fb-4635-9bf8-f3bf6608a97c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:49.896874 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c1ebe-39fb-4635-9bf8-f3bf6608a97c None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:49.902723 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 254/498] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:49.903657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42753302-7d23-48e5-a4eb-f5149b833ac3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:49.906230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-3b6c1ebe-39fb-4635-9bf8-f3bf6608a97c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:49.913977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:49.915073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:49.916000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:49.916000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:49.916000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:49.916000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 245/499] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:49.916354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c1ebe-39fb-4635-9bf8-f3bf6608a97c None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:50.011014 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42753302-7d23-48e5-a4eb-f5149b833ac3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:50.025800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c1ebe-39fb-4635-9bf8-f3bf6608a97c None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:50.043803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:50.055810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190da7a-36cd-4186-8319-daad70527cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:50.056423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190da7a-36cd-4186-8319-daad70527cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:50.056698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190da7a-36cd-4186-8319-daad70527cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:50.056969 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190da7a-36cd-4186-8319-daad70527cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:50.057635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190da7a-36cd-4186-8319-daad70527cb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:50.057934 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190da7a-36cd-4186-8319-daad70527cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:50.059319 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190da7a-36cd-4186-8319-daad70527cb2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:50.068764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84428b7f-4ed3-46b5-8d2e-58b7f30decd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:50.069074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 255/500] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:50:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:50.069158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84428b7f-4ed3-46b5-8d2e-58b7f30decd2 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:50.069158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84428b7f-4ed3-46b5-8d2e-58b7f30decd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:50.069280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e68dc9-3add-492f-abf2-af8693264193 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:50.069514 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84428b7f-4ed3-46b5-8d2e-58b7f30decd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:50.070050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e68dc9-3add-492f-abf2-af8693264193 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:50.070050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e68dc9-3add-492f-abf2-af8693264193 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:50.070974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 256/501] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:50.071834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e68dc9-3add-492f-abf2-af8693264193 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:50.081686 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84428b7f-4ed3-46b5-8d2e-58b7f30decd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-84428b7f-4ed3-46b5-8d2e-58b7f30decd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:50.087513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:50.088653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:50.089601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:50.089601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:50.089601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:50.089601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:50.089601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:50.089601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:50.089601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:50.089601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:50.089601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:50.089601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:50.089601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:50.089601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:50.089601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 246/502] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:50:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:50.096801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84428b7f-4ed3-46b5-8d2e-58b7f30decd2 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:50.175800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:50.201276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e68dc9-3add-492f-abf2-af8693264193 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:50.224284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84428b7f-4ed3-46b5-8d2e-58b7f30decd2 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:50.236360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706dcc-fde9-4533-9d73-a1d2c9a9cbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:50.236986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706dcc-fde9-4533-9d73-a1d2c9a9cbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:50.237264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706dcc-fde9-4533-9d73-a1d2c9a9cbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:50.237533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706dcc-fde9-4533-9d73-a1d2c9a9cbf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:50.249119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b706dcc-fde9-4533-9d73-a1d2c9a9cbf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:50.250435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b706dcc-fde9-4533-9d73-a1d2c9a9cbf0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:50.259597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd22b7-41b1-4688-aa78-08f47bb6b7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:50.260244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd22b7-41b1-4688-aa78-08f47bb6b7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:50.260528 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd22b7-41b1-4688-aa78-08f47bb6b7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:50.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd22b7-41b1-4688-aa78-08f47bb6b7f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:50.261465 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd22b7-41b1-4688-aa78-08f47bb6b7f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:50.261771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd22b7-41b1-4688-aa78-08f47bb6b7f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:50.263170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd22b7-41b1-4688-aa78-08f47bb6b7f2 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-4b706dcc-fde9-4533-9d73-a1d2c9a9cbf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:50.266899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:50.268031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:50.269083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:50.269083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:50.269083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:50.273389 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 257/503] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:50.274146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706dcc-fde9-4533-9d73-a1d2c9a9cbf0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:50.276426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 247/504] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:50.277823 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be016c5-e454-4967-8e04-1e5f51e4f1c6 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:50.278079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be016c5-e454-4967-8e04-1e5f51e4f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:50.278354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be016c5-e454-4967-8e04-1e5f51e4f1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:50.297420 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-2be016c5-e454-4967-8e04-1e5f51e4f1c6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:50.298820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2be016c5-e454-4967-8e04-1e5f51e4f1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:50.321933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:50.371149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 248/505] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:50.372299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be016c5-e454-4967-8e04-1e5f51e4f1c6 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:50.386758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706dcc-fde9-4533-9d73-a1d2c9a9cbf0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:50.429808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a230b-80cd-499d-8794-b8f3431cebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:50.430352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a230b-80cd-499d-8794-b8f3431cebc0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:50.430633 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a230b-80cd-499d-8794-b8f3431cebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:50.430904 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a230b-80cd-499d-8794-b8f3431cebc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:50.441194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:50.442541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a230b-80cd-499d-8794-b8f3431cebc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:50.444987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a230b-80cd-499d-8794-b8f3431cebc0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-d57a230b-80cd-499d-8794-b8f3431cebc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:50.459038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:50.460167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:50.461182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:50.461182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:50.461182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:50.461182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 258/506] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:50.461182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a230b-80cd-499d-8794-b8f3431cebc0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:50.515830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be016c5-e454-4967-8e04-1e5f51e4f1c6 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:50.552868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:50.563207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a230b-80cd-499d-8794-b8f3431cebc0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:50.574229 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752ec6c-72a8-443b-9f20-c0a1345d93ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:50.574856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ec6c-72a8-443b-9f20-c0a1345d93ef None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:50.575143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ec6c-72a8-443b-9f20-c0a1345d93ef None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:50.575417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ec6c-72a8-443b-9f20-c0a1345d93ef None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:50.576137 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752ec6c-72a8-443b-9f20-c0a1345d93ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:50.576448 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752ec6c-72a8-443b-9f20-c0a1345d93ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:50.577828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752ec6c-72a8-443b-9f20-c0a1345d93ef None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:50.586545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 249/507] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:50:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:50.587370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752ec6c-72a8-443b-9f20-c0a1345d93ef None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:50.598516 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02f9e3-4104-4450-9e2d-1f05f05fd843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:50.599128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02f9e3-4104-4450-9e2d-1f05f05fd843 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:50.599421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02f9e3-4104-4450-9e2d-1f05f05fd843 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:50.599694 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02f9e3-4104-4450-9e2d-1f05f05fd843 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:50.600950 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02f9e3-4104-4450-9e2d-1f05f05fd843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:50.601256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02f9e3-4104-4450-9e2d-1f05f05fd843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:50.602644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02f9e3-4104-4450-9e2d-1f05f05fd843 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:50.616415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 259/508] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:50.617481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02f9e3-4104-4450-9e2d-1f05f05fd843 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:50.693832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752ec6c-72a8-443b-9f20-c0a1345d93ef None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:50.706868 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:50.719562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02f9e3-4104-4450-9e2d-1f05f05fd843 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:50.729403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223dc96-82a2-4c70-a05e-f71f9e648916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:50.730035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223dc96-82a2-4c70-a05e-f71f9e648916 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:50.730315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223dc96-82a2-4c70-a05e-f71f9e648916 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:50.730587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223dc96-82a2-4c70-a05e-f71f9e648916 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:50.738126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223dc96-82a2-4c70-a05e-f71f9e648916 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:50.739563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223dc96-82a2-4c70-a05e-f71f9e648916 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-e223dc96-82a2-4c70-a05e-f71f9e648916 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:50:50.750894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:50.751922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:50.752863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:50.752863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:50.752863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:50:50.752863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:50:50.752863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:50:50.752863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:50:50.752863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:50:50.752863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:50:50.752863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 07:50:50.752863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:50.752863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 250/509] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:50.752863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223dc96-82a2-4c70-a05e-f71f9e648916 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:50.758555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4368f4-cbdf-4953-b1a9-830b589c9e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:50.759197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4368f4-cbdf-4953-b1a9-830b589c9e79 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:50.759481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4368f4-cbdf-4953-b1a9-830b589c9e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:50.759778 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4368f4-cbdf-4953-b1a9-830b589c9e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:50.770462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4368f4-cbdf-4953-b1a9-830b589c9e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:50.772510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4368f4-cbdf-4953-b1a9-830b589c9e79 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-8e4368f4-cbdf-4953-b1a9-830b589c9e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:50.787147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:50.788804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:50.789663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:50.789663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:50.789663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:50.789663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 260/510] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:50.792603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4368f4-cbdf-4953-b1a9-830b589c9e79 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:50.795786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:50.861084 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223dc96-82a2-4c70-a05e-f71f9e648916 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:50.902741 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428231a7-604d-467a-896f-0a6e70d31bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:50.903033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4368f4-cbdf-4953-b1a9-830b589c9e79 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:50.903368 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428231a7-604d-467a-896f-0a6e70d31bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:50.903652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428231a7-604d-467a-896f-0a6e70d31bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:50.903949 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428231a7-604d-467a-896f-0a6e70d31bc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:50.904602 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428231a7-604d-467a-896f-0a6e70d31bc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:50.904901 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428231a7-604d-467a-896f-0a6e70d31bc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:50.906300 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428231a7-604d-467a-896f-0a6e70d31bc7 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:50.918376 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 251/511] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:50.919227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428231a7-604d-467a-896f-0a6e70d31bc7 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:50.940196 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812907ed-0ab5-42e6-8b43-a887d8de02f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:50.940823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812907ed-0ab5-42e6-8b43-a887d8de02f4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:50.941106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812907ed-0ab5-42e6-8b43-a887d8de02f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:50.941374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812907ed-0ab5-42e6-8b43-a887d8de02f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:50.952647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:50.953222 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812907ed-0ab5-42e6-8b43-a887d8de02f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:50.955610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812907ed-0ab5-42e6-8b43-a887d8de02f4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-812907ed-0ab5-42e6-8b43-a887d8de02f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:50.971049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:50.972197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:50.973027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:50.973027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:50.973027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:50.973027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 261/512] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:50.973383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812907ed-0ab5-42e6-8b43-a887d8de02f4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:51.034621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428231a7-604d-467a-896f-0a6e70d31bc7 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:51.035358 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:51.069933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02113bba-4f66-464e-92b0-568880d63d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:51.070553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02113bba-4f66-464e-92b0-568880d63d9d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:51.070834 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02113bba-4f66-464e-92b0-568880d63d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:51.071106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02113bba-4f66-464e-92b0-568880d63d9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:51.077934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02113bba-4f66-464e-92b0-568880d63d9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:51.079356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02113bba-4f66-464e-92b0-568880d63d9d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:51.080968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812907ed-0ab5-42e6-8b43-a887d8de02f4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-02113bba-4f66-464e-92b0-568880d63d9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:50:51.091509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:51.092863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:51.093979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:50:51.093979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:50:51.093979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:50:51.093979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:50:51.093979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:50:51.093979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:50:51.093979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:50:51.093979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:51.093979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 252/513] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:51.093979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02113bba-4f66-464e-92b0-568880d63d9d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:51.118355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba362000-9e3e-4532-9aaf-7686e516b697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:51.118967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba362000-9e3e-4532-9aaf-7686e516b697 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:51.119255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba362000-9e3e-4532-9aaf-7686e516b697 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:51.119534 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba362000-9e3e-4532-9aaf-7686e516b697 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:51.120366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba362000-9e3e-4532-9aaf-7686e516b697 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:51.120677 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba362000-9e3e-4532-9aaf-7686e516b697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:51.122130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba362000-9e3e-4532-9aaf-7686e516b697 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:51.160115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 262/514] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Aug 10 07:50:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:51.161078 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba362000-9e3e-4532-9aaf-7686e516b697 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:51.189951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:51.199477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02113bba-4f66-464e-92b0-568880d63d9d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:51.235824 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cb437-75fb-4032-8e97-9a149fc711a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:51.236332 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cb437-75fb-4032-8e97-9a149fc711a8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:51.236616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cb437-75fb-4032-8e97-9a149fc711a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:51.236887 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cb437-75fb-4032-8e97-9a149fc711a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:51.237533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9cb437-75fb-4032-8e97-9a149fc711a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:51.237830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9cb437-75fb-4032-8e97-9a149fc711a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:51.239208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9cb437-75fb-4032-8e97-9a149fc711a8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:51.251333 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 253/515] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:51.252347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cb437-75fb-4032-8e97-9a149fc711a8 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:51.280952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba362000-9e3e-4532-9aaf-7686e516b697 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:51.294488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:51.317294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277a04b-94ec-4074-9999-dce54e99d22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:51.317931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277a04b-94ec-4074-9999-dce54e99d22e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:51.318212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277a04b-94ec-4074-9999-dce54e99d22e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:51.318480 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277a04b-94ec-4074-9999-dce54e99d22e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:51.328994 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277a04b-94ec-4074-9999-dce54e99d22e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:51.330487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277a04b-94ec-4074-9999-dce54e99d22e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c277a04b-94ec-4074-9999-dce54e99d22e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:50:51.344332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:51.345512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:51.351971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:51.351971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:51.351971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:50:51.351971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:50:51.351971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:50:51.351971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:50:51.351971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:50:51.351971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:50:51.351971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 07:50:51.351971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:51.351971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 263/516] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:50:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:51.351971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277a04b-94ec-4074-9999-dce54e99d22e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:51.367331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cb437-75fb-4032-8e97-9a149fc711a8 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:51.405098 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f2862-77c1-45f4-932a-3ed3521b91e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:51.405712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f2862-77c1-45f4-932a-3ed3521b91e5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:51.405996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f2862-77c1-45f4-932a-3ed3521b91e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:51.406279 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f2862-77c1-45f4-932a-3ed3521b91e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:51.406926 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f2862-77c1-45f4-932a-3ed3521b91e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:51.407236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f2862-77c1-45f4-932a-3ed3521b91e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:51.408647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f2862-77c1-45f4-932a-3ed3521b91e5 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:51.420136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 254/517] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:51.420959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f2862-77c1-45f4-932a-3ed3521b91e5 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:51.439855 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:51.471610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277a04b-94ec-4074-9999-dce54e99d22e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:51.507651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b50b50-d195-434f-a895-c8c4605cc25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:51.508205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b50b50-d195-434f-a895-c8c4605cc25c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:51.508488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b50b50-d195-434f-a895-c8c4605cc25c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:51.508769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b50b50-d195-434f-a895-c8c4605cc25c None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:51.509466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b50b50-d195-434f-a895-c8c4605cc25c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:51.509778 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b50b50-d195-434f-a895-c8c4605cc25c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:51.511240 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b50b50-d195-434f-a895-c8c4605cc25c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:51.529678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 264/518] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:50:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:51.530254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b50b50-d195-434f-a895-c8c4605cc25c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:51.543798 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f2862-77c1-45f4-932a-3ed3521b91e5 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:51.566887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:51.582351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb49ab7-ab24-4771-8286-3809bafa9c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:51.582959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb49ab7-ab24-4771-8286-3809bafa9c58 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:51.583421 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb49ab7-ab24-4771-8286-3809bafa9c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:51.583711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb49ab7-ab24-4771-8286-3809bafa9c58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:51.652480 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b50b50-d195-434f-a895-c8c4605cc25c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:51.657206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb49ab7-ab24-4771-8286-3809bafa9c58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:51.658674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb49ab7-ab24-4771-8286-3809bafa9c58 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:51.675616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:51.690541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d6201-4ccc-4cd0-8069-e6857a4c591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:51.691147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d6201-4ccc-4cd0-8069-e6857a4c591b None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:51.691424 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d6201-4ccc-4cd0-8069-e6857a4c591b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:51.691703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d6201-4ccc-4cd0-8069-e6857a4c591b None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:51.692367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d6201-4ccc-4cd0-8069-e6857a4c591b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:51.693808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d6201-4ccc-4cd0-8069-e6857a4c591b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:51.716154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 265/519] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:50:51 2022] POST /identity/v3/users => generated 247 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:50:51.717073 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d6201-4ccc-4cd0-8069-e6857a4c591b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:51.786163 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 255/520] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:51.787353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb49ab7-ab24-4771-8286-3809bafa9c58 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:51.863401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:51.878483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d6201-4ccc-4cd0-8069-e6857a4c591b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:51.922204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb49ab7-ab24-4771-8286-3809bafa9c58 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:51.927435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caabcea-079d-419c-89e2-991dbaa182fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:51.927435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caabcea-079d-419c-89e2-991dbaa182fa None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:51.927703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caabcea-079d-419c-89e2-991dbaa182fa None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:51.927972 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caabcea-079d-419c-89e2-991dbaa182fa None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:51.929489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caabcea-079d-419c-89e2-991dbaa182fa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:51.929803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caabcea-079d-419c-89e2-991dbaa182fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:51.931395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caabcea-079d-419c-89e2-991dbaa182fa None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:51.940199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:51.953599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 266/521] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Aug 10 07:50:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:51.954485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caabcea-079d-419c-89e2-991dbaa182fa None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:51.968949 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22acab-d623-4a2b-bb0e-a78a005d699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:51.969729 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22acab-d623-4a2b-bb0e-a78a005d699e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:51.970024 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22acab-d623-4a2b-bb0e-a78a005d699e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:51.970295 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22acab-d623-4a2b-bb0e-a78a005d699e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:51.980497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22acab-d623-4a2b-bb0e-a78a005d699e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:51.981952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22acab-d623-4a2b-bb0e-a78a005d699e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-4b22acab-d623-4a2b-bb0e-a78a005d699e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:50:51.994923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:51.995931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:51.996850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:51.996850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:51.996850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:50:51.996850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:50:51.996850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:50:51.996850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:50:51.996850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:50:51.996850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:50:51.996850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:50:51.996850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:51.996850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 256/522] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:51.997392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22acab-d623-4a2b-bb0e-a78a005d699e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:52.086673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caabcea-079d-419c-89e2-991dbaa182fa None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:52.123464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22acab-d623-4a2b-bb0e-a78a005d699e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:52.125085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad55f80-1a67-4689-bdda-bab890ec244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:52.126001 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad55f80-1a67-4689-bdda-bab890ec244f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:52.126404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad55f80-1a67-4689-bdda-bab890ec244f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:52.127909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad55f80-1a67-4689-bdda-bab890ec244f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:52.128172 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad55f80-1a67-4689-bdda-bab890ec244f None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=6c8e7a0b9eb14983ac117690e2705eb4) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:52.128610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad55f80-1a67-4689-bdda-bab890ec244f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:52.130239 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad55f80-1a67-4689-bdda-bab890ec244f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:52.136847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 267/523] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:51 2022] GET /identity/v3/role_assignments?user.id=6c8e7a0b9eb14983ac117690e2705eb4&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:52.148143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad55f80-1a67-4689-bdda-bab890ec244f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:52.163502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:52.185284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f566ea-965b-495b-89dc-a345355c6fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:52.186221 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f566ea-965b-495b-89dc-a345355c6fab None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:52.186501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f566ea-965b-495b-89dc-a345355c6fab None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:52.186773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f566ea-965b-495b-89dc-a345355c6fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:52.201140 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f566ea-965b-495b-89dc-a345355c6fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:52.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f566ea-965b-495b-89dc-a345355c6fab None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-74f566ea-965b-495b-89dc-a345355c6fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:52.220615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:52.222662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:52.223809 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:52.223809 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:52.223809 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:52.223809 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 257/524] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:52.223809 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f566ea-965b-495b-89dc-a345355c6fab None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:52.274249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad55f80-1a67-4689-bdda-bab890ec244f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:52.276134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:52.315525 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e647169-b03e-4960-9b27-1a74a4d0d815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:52.316204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e647169-b03e-4960-9b27-1a74a4d0d815 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:52.316489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e647169-b03e-4960-9b27-1a74a4d0d815 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:52.316745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e647169-b03e-4960-9b27-1a74a4d0d815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:52.380347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f566ea-965b-495b-89dc-a345355c6fab None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:52.419894 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e647169-b03e-4960-9b27-1a74a4d0d815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:52.421395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e647169-b03e-4960-9b27-1a74a4d0d815 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:52.422144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b8a9a-9a49-4270-a99d-82139ffe18df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:52.423009 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b8a9a-9a49-4270-a99d-82139ffe18df None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:52.423769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b8a9a-9a49-4270-a99d-82139ffe18df None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:52.424246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b8a9a-9a49-4270-a99d-82139ffe18df None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:52.425280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b8a9a-9a49-4270-a99d-82139ffe18df None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:52.425801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b8a9a-9a49-4270-a99d-82139ffe18df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:52.427462 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b8a9a-9a49-4270-a99d-82139ffe18df None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:52.435062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:52.457962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 258/525] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Aug 10 07:50:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:52.459274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b8a9a-9a49-4270-a99d-82139ffe18df None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:52.571403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 268/526] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:52.572440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e647169-b03e-4960-9b27-1a74a4d0d815 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:52.574277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:52.599771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b8a9a-9a49-4270-a99d-82139ffe18df None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:52.645351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496b811-9db1-49d1-ab89-ffdf10db3710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:52.646313 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496b811-9db1-49d1-ab89-ffdf10db3710 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:52.646855 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496b811-9db1-49d1-ab89-ffdf10db3710 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:52.647440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496b811-9db1-49d1-ab89-ffdf10db3710 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:52.648427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496b811-9db1-49d1-ab89-ffdf10db3710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:52.648932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496b811-9db1-49d1-ab89-ffdf10db3710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:52.650499 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496b811-9db1-49d1-ab89-ffdf10db3710 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:52.666461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 259/527] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:52.668338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496b811-9db1-49d1-ab89-ffdf10db3710 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:52.706959 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e647169-b03e-4960-9b27-1a74a4d0d815 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:52.727039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:52.759327 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b24079-80e5-403f-8d36-16f95084c6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:52.760333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b24079-80e5-403f-8d36-16f95084c6ae None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:52.760628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b24079-80e5-403f-8d36-16f95084c6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:52.760907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b24079-80e5-403f-8d36-16f95084c6ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:52.786034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496b811-9db1-49d1-ab89-ffdf10db3710 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:52.825794 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93eefce-8e16-4320-8513-d6a86be181e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:52.826536 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93eefce-8e16-4320-8513-d6a86be181e7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:52.826790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93eefce-8e16-4320-8513-d6a86be181e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:52.827511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93eefce-8e16-4320-8513-d6a86be181e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:52.839985 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93eefce-8e16-4320-8513-d6a86be181e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:52.841445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93eefce-8e16-4320-8513-d6a86be181e7 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:52.843610 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:52.847652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b24079-80e5-403f-8d36-16f95084c6ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:52.849688 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b24079-80e5-403f-8d36-16f95084c6ae None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-e93eefce-8e16-4320-8513-d6a86be181e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:52.858373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:52.859532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:52.860612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:52.860612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:52.860612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:52.861353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 260/528] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:52.862217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93eefce-8e16-4320-8513-d6a86be181e7 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:52.972452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 269/529] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:52.973555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b24079-80e5-403f-8d36-16f95084c6ae None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:52.982865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93eefce-8e16-4320-8513-d6a86be181e7 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:52.987843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:53.022761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afdd61-84d9-4ad7-9366-3da7fd837c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:53.023768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afdd61-84d9-4ad7-9366-3da7fd837c5e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:53.024258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afdd61-84d9-4ad7-9366-3da7fd837c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:53.024701 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afdd61-84d9-4ad7-9366-3da7fd837c5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:53.032539 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afdd61-84d9-4ad7-9366-3da7fd837c5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:53.034380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afdd61-84d9-4ad7-9366-3da7fd837c5e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-a6afdd61-84d9-4ad7-9366-3da7fd837c5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:50:53.048552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:53.049550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:53.050493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:50:53.050493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:50:53.050493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:50:53.050493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:50:53.050493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:50:53.050493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:50:53.050493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:50:53.050493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:53.057392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 261/530] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:53.058753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afdd61-84d9-4ad7-9366-3da7fd837c5e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:53.085910 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b24079-80e5-403f-8d36-16f95084c6ae None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:53.124744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:53.124962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ec046-8b69-41d9-9ba6-d2da3fc37859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:53.126049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ec046-8b69-41d9-9ba6-d2da3fc37859 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:53.126401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ec046-8b69-41d9-9ba6-d2da3fc37859 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:53.126894 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ec046-8b69-41d9-9ba6-d2da3fc37859 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:53.128437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ec046-8b69-41d9-9ba6-d2da3fc37859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:53.128853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ec046-8b69-41d9-9ba6-d2da3fc37859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:53.130626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ec046-8b69-41d9-9ba6-d2da3fc37859 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:53.145258 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 270/531] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:53.146139 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ec046-8b69-41d9-9ba6-d2da3fc37859 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:53.184241 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afdd61-84d9-4ad7-9366-3da7fd837c5e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:53.224333 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bca44d-3596-4144-89db-f1ba207a3cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:53.225523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bca44d-3596-4144-89db-f1ba207a3cec None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:53.225816 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bca44d-3596-4144-89db-f1ba207a3cec None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:53.226093 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bca44d-3596-4144-89db-f1ba207a3cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:53.226804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:53.240642 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bca44d-3596-4144-89db-f1ba207a3cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:53.242305 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bca44d-3596-4144-89db-f1ba207a3cec None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-62bca44d-3596-4144-89db-f1ba207a3cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:53.258993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:53.260805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:53.263226 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:53.263226 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:53.263226 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:53.263226 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 262/532] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:53.263226 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bca44d-3596-4144-89db-f1ba207a3cec None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:53.267869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ec046-8b69-41d9-9ba6-d2da3fc37859 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:53.307390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc7f8-b82a-4c90-9d34-f91c267d0a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:53.308054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc7f8-b82a-4c90-9d34-f91c267d0a47 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:53.308342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc7f8-b82a-4c90-9d34-f91c267d0a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:53.308621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc7f8-b82a-4c90-9d34-f91c267d0a47 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:53.309439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbc7f8-b82a-4c90-9d34-f91c267d0a47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:53.309756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbc7f8-b82a-4c90-9d34-f91c267d0a47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:53.311417 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbc7f8-b82a-4c90-9d34-f91c267d0a47 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:53.330410 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 271/533] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:50:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:53.331492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc7f8-b82a-4c90-9d34-f91c267d0a47 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:53.374774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bca44d-3596-4144-89db-f1ba207a3cec None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:53.382889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:53.414244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11e42-db68-452c-8fc3-6045bef936d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:53.414952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11e42-db68-452c-8fc3-6045bef936d6 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:53.415160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11e42-db68-452c-8fc3-6045bef936d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:53.415460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11e42-db68-452c-8fc3-6045bef936d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:53.423673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b11e42-db68-452c-8fc3-6045bef936d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:53.425135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b11e42-db68-452c-8fc3-6045bef936d6 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-57b11e42-db68-452c-8fc3-6045bef936d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:50:53.439152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:53.440194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:53.441121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:50:53.441121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:50:53.441121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:50:53.441121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:50:53.441121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:50:53.441121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:50:53.441121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:50:53.441121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:53.441121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 263/534] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:53.441644 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11e42-db68-452c-8fc3-6045bef936d6 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:53.456285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc7f8-b82a-4c90-9d34-f91c267d0a47 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:53.493723 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:53.501218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338353c-e710-4de8-91e2-1fae7bea12f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:53.502201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338353c-e710-4de8-91e2-1fae7bea12f5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:53.502803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338353c-e710-4de8-91e2-1fae7bea12f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:53.503229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338353c-e710-4de8-91e2-1fae7bea12f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:53.504109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338353c-e710-4de8-91e2-1fae7bea12f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:53.504587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338353c-e710-4de8-91e2-1fae7bea12f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:53.506362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338353c-e710-4de8-91e2-1fae7bea12f5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:53.525914 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 272/535] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:53.527303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338353c-e710-4de8-91e2-1fae7bea12f5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:53.563013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11e42-db68-452c-8fc3-6045bef936d6 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:53.614603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399eff6-7f82-4b50-b557-0b8213f1f8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:53.614832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399eff6-7f82-4b50-b557-0b8213f1f8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:53.615111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399eff6-7f82-4b50-b557-0b8213f1f8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:53.615446 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399eff6-7f82-4b50-b557-0b8213f1f8e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:53.616839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399eff6-7f82-4b50-b557-0b8213f1f8e4 None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=553916344aaf40ae8abb050540f10559) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:53.617299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399eff6-7f82-4b50-b557-0b8213f1f8e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:53.618663 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399eff6-7f82-4b50-b557-0b8213f1f8e4 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:53.631756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 264/536] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:53 2022] GET /identity/v3/role_assignments?user.id=553916344aaf40ae8abb050540f10559&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:53.631756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399eff6-7f82-4b50-b557-0b8213f1f8e4 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:53.683390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338353c-e710-4de8-91e2-1fae7bea12f5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:53.716250 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:53.753187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7d7e2-39c5-4833-9bcf-3ac8aa4917b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:53.753937 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7d7e2-39c5-4833-9bcf-3ac8aa4917b2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:53.754294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7d7e2-39c5-4833-9bcf-3ac8aa4917b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:53.754643 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7d7e2-39c5-4833-9bcf-3ac8aa4917b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:53.755440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7d7e2-39c5-4833-9bcf-3ac8aa4917b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:53.755862 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7d7e2-39c5-4833-9bcf-3ac8aa4917b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:53.757566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7d7e2-39c5-4833-9bcf-3ac8aa4917b2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:53.765533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399eff6-7f82-4b50-b557-0b8213f1f8e4 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:53.772694 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 273/537] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:50:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:53.783762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7d7e2-39c5-4833-9bcf-3ac8aa4917b2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:53.856573 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:53.870189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844c482-3800-4ecd-83aa-94a0593ad333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:53.870900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844c482-3800-4ecd-83aa-94a0593ad333 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:53.871123 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844c482-3800-4ecd-83aa-94a0593ad333 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:53.871399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844c482-3800-4ecd-83aa-94a0593ad333 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:53.880112 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844c482-3800-4ecd-83aa-94a0593ad333 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:53.881928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844c482-3800-4ecd-83aa-94a0593ad333 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-d844c482-3800-4ecd-83aa-94a0593ad333 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:50:53.896835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:53.897743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:53.898576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:50:53.898576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:50:53.898576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:50:53.898576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:50:53.898576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:50:53.898576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:50:53.898576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:50:53.898576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:53.898576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 265/538] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:53.903764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddffc01-4dad-4f5b-ad44-bb7b108d1772 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:53.903764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddffc01-4dad-4f5b-ad44-bb7b108d1772 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:53.903764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddffc01-4dad-4f5b-ad44-bb7b108d1772 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:53.906515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 266/539] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:53.908194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea032ca5-f370-45e1-81e1-1ab70aa2f80e None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:53.908469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea032ca5-f370-45e1-81e1-1ab70aa2f80e None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:53.908750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea032ca5-f370-45e1-81e1-1ab70aa2f80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:53.930821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-ea032ca5-f370-45e1-81e1-1ab70aa2f80e None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:53.932129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ea032ca5-f370-45e1-81e1-1ab70aa2f80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:53.963291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7d7e2-39c5-4833-9bcf-3ac8aa4917b2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:54.013070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 267/540] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:54.019883 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea032ca5-f370-45e1-81e1-1ab70aa2f80e None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:54.027561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e673cce-0237-4752-8bde-7094341652a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:54.028582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e673cce-0237-4752-8bde-7094341652a6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:54.029065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e673cce-0237-4752-8bde-7094341652a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:54.029544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e673cce-0237-4752-8bde-7094341652a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:54.030815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e673cce-0237-4752-8bde-7094341652a6 None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=bb3537ce04d24347b155855d2e29cd9c) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:54.031319 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e673cce-0237-4752-8bde-7094341652a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:54.033940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e673cce-0237-4752-8bde-7094341652a6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:54.044256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 274/541] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:53 2022] GET /identity/v3/role_assignments?user.id=bb3537ce04d24347b155855d2e29cd9c&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:54.065059 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:54.074759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e673cce-0237-4752-8bde-7094341652a6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:54.165016 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea032ca5-f370-45e1-81e1-1ab70aa2f80e None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:54.206353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db989d76-8ab9-4f72-b1a7-281601c9f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:54.207033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db989d76-8ab9-4f72-b1a7-281601c9f018 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:54.207320 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db989d76-8ab9-4f72-b1a7-281601c9f018 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:54.207594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db989d76-8ab9-4f72-b1a7-281601c9f018 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:54.208339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db989d76-8ab9-4f72-b1a7-281601c9f018 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:54.208642 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db989d76-8ab9-4f72-b1a7-281601c9f018 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:54.210261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db989d76-8ab9-4f72-b1a7-281601c9f018 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:54.232129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 268/542] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:50:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:54.241671 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db989d76-8ab9-4f72-b1a7-281601c9f018 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:54.296909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e673cce-0237-4752-8bde-7094341652a6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:54.328694 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:54.374259 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f111f-cf01-42fe-ab17-09d373db4687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:54.374949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f111f-cf01-42fe-ab17-09d373db4687 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:54.375236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f111f-cf01-42fe-ab17-09d373db4687 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:54.375513 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f111f-cf01-42fe-ab17-09d373db4687 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:54.400367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f111f-cf01-42fe-ab17-09d373db4687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-a98f111f-cf01-42fe-ab17-09d373db4687 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:54.407462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:54.408671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:54.410151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:54.410151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:54.410151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:54.410151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:54.410151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:54.410151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:54.410151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:54.410151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:54.410151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:54.410151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:54.410151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:54.410151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:54.410151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 275/543] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:50:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:54.416879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f111f-cf01-42fe-ab17-09d373db4687 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:54.417842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:54.478595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db989d76-8ab9-4f72-b1a7-281601c9f018 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:54.590679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f111f-cf01-42fe-ab17-09d373db4687 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:54.604514 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa77df-c168-42b0-b68f-f03d9be735c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:54.605377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa77df-c168-42b0-b68f-f03d9be735c5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:54.605668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa77df-c168-42b0-b68f-f03d9be735c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:54.605945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa77df-c168-42b0-b68f-f03d9be735c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:54.606689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa77df-c168-42b0-b68f-f03d9be735c5 None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=ab0470979f1643a390c667efc55c4069) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:54.607114 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa77df-c168-42b0-b68f-f03d9be735c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:54.608959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa77df-c168-42b0-b68f-f03d9be735c5 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:54.627423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 269/544] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:54 2022] GET /identity/v3/role_assignments?user.id=ab0470979f1643a390c667efc55c4069&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 259 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:54.639540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c7b37-2139-46f6-a094-da9dbcbde368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:54.640215 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7b37-2139-46f6-a094-da9dbcbde368 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:54.640500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7b37-2139-46f6-a094-da9dbcbde368 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:54.640842 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7b37-2139-46f6-a094-da9dbcbde368 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:54.641606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c7b37-2139-46f6-a094-da9dbcbde368 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:54.641917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c7b37-2139-46f6-a094-da9dbcbde368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:54.643557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c7b37-2139-46f6-a094-da9dbcbde368 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:54.665578 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 276/545] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:50:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:54.671640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa77df-c168-42b0-b68f-f03d9be735c5 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:54.841890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa77df-c168-42b0-b68f-f03d9be735c5 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:54.887675 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873ed6e-a404-4711-a30c-34f4b0fe2586 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:54.888021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873ed6e-a404-4711-a30c-34f4b0fe2586 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:54.888294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873ed6e-a404-4711-a30c-34f4b0fe2586 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:54.890083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb49f30-7b8e-4c02-a189-d5dd280c52da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:54.890818 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb49f30-7b8e-4c02-a189-d5dd280c52da None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:54.891247 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb49f30-7b8e-4c02-a189-d5dd280c52da None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:54.891525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb49f30-7b8e-4c02-a189-d5dd280c52da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:54.901153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 277/546] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:50:54.902937 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a4c2a-357e-4d52-a960-e4a2d12ddd21 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:54.903223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a4c2a-357e-4d52-a960-e4a2d12ddd21 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:54.903553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a4c2a-357e-4d52-a960-e4a2d12ddd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:54.914093 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb49f30-7b8e-4c02-a189-d5dd280c52da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:54.915575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb49f30-7b8e-4c02-a189-d5dd280c52da None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:54.929089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:54.947138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-389a4c2a-357e-4d52-a960-e4a2d12ddd21 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:54.949129 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-389a4c2a-357e-4d52-a960-e4a2d12ddd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-dbb49f30-7b8e-4c02-a189-d5dd280c52da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:54.958604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:54.961254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:54.962915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:54.962915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:54.962915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:54.969865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 270/547] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:54.972629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb49f30-7b8e-4c02-a189-d5dd280c52da None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:55.055373 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:55.167994 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 278/548] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:50:55.181481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb49f30-7b8e-4c02-a189-d5dd280c52da None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:55.207610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a4c2a-357e-4d52-a960-e4a2d12ddd21 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:55.241969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb76e63-51e4-4770-a659-2e856775dab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:55.243541 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb76e63-51e4-4770-a659-2e856775dab9 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:55.245189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb76e63-51e4-4770-a659-2e856775dab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:55.246560 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb76e63-51e4-4770-a659-2e856775dab9 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:55.248984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb76e63-51e4-4770-a659-2e856775dab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:55.249478 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb76e63-51e4-4770-a659-2e856775dab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:55.251274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb76e63-51e4-4770-a659-2e856775dab9 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:55.275755 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 271/549] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:55.277623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb76e63-51e4-4770-a659-2e856775dab9 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:55.396535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:55.451534 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a4c2a-357e-4d52-a960-e4a2d12ddd21 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:55.488589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb76e63-51e4-4770-a659-2e856775dab9 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:55.538814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602968ce-db38-4871-93c2-8f8b5d7f0442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:55.539797 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602968ce-db38-4871-93c2-8f8b5d7f0442 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:55.540563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602968ce-db38-4871-93c2-8f8b5d7f0442 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:55.541170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602968ce-db38-4871-93c2-8f8b5d7f0442 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:55.543153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ed2ee-3523-4a65-a09d-65a393a7af23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:55.545452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ed2ee-3523-4a65-a09d-65a393a7af23 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:55.546324 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ed2ee-3523-4a65-a09d-65a393a7af23 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:55.546752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ed2ee-3523-4a65-a09d-65a393a7af23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:55.564719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602968ce-db38-4871-93c2-8f8b5d7f0442 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:55.566442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602968ce-db38-4871-93c2-8f8b5d7f0442 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:55.570390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ed2ee-3523-4a65-a09d-65a393a7af23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-5a2ed2ee-3523-4a65-a09d-65a393a7af23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:55.581031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:55.582458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:55.583453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:55.583453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:55.583453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:55.583453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:55.583453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:55.583453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:55.583453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:55.583453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:55.583453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:55.583453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:55.583453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:55.583453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:55.591021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 279/550] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:50:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:55.592311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ed2ee-3523-4a65-a09d-65a393a7af23 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-602968ce-db38-4871-93c2-8f8b5d7f0442 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:50:55.593309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:55.594426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:55.595762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:55.595762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:55.595762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:50:55.595762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:50:55.595762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:50:55.595762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:50:55.595762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:50:55.595762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:50:55.595762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:50:55.595762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:55.601309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 272/551] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:50:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:50:55.606785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602968ce-db38-4871-93c2-8f8b5d7f0442 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:55.664415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:55.792450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602968ce-db38-4871-93c2-8f8b5d7f0442 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:55.806923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ed2ee-3523-4a65-a09d-65a393a7af23 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:55.831397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:55.851254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334a9c5-35b4-4da3-9adf-2f12a431bcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:55.851905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334a9c5-35b4-4da3-9adf-2f12a431bcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:55.852192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334a9c5-35b4-4da3-9adf-2f12a431bcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:55.852464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334a9c5-35b4-4da3-9adf-2f12a431bcf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:55.853149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334a9c5-35b4-4da3-9adf-2f12a431bcf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:55.853457 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334a9c5-35b4-4da3-9adf-2f12a431bcf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:55.854965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334a9c5-35b4-4da3-9adf-2f12a431bcf6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:55.860708 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210672a7-a3cc-4744-bd69-1d64ee37e229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:55.861335 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210672a7-a3cc-4744-bd69-1d64ee37e229 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:55.861621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210672a7-a3cc-4744-bd69-1d64ee37e229 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:55.861915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210672a7-a3cc-4744-bd69-1d64ee37e229 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:55.862639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210672a7-a3cc-4744-bd69-1d64ee37e229 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:55.862950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210672a7-a3cc-4744-bd69-1d64ee37e229 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:55.864412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210672a7-a3cc-4744-bd69-1d64ee37e229 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:55.874006 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 280/552] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:50:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:55.886128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334a9c5-35b4-4da3-9adf-2f12a431bcf6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:55.909953 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 273/553] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Aug 10 07:50:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:50:55.920830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210672a7-a3cc-4744-bd69-1d64ee37e229 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:56.000845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:56.018012 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334a9c5-35b4-4da3-9adf-2f12a431bcf6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:56.057002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746280cb-111c-4495-91aa-d765248e380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:56.057735 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746280cb-111c-4495-91aa-d765248e380d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:56.057817 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746280cb-111c-4495-91aa-d765248e380d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:56.058126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746280cb-111c-4495-91aa-d765248e380d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:56.070371 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746280cb-111c-4495-91aa-d765248e380d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:56.071895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746280cb-111c-4495-91aa-d765248e380d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-746280cb-111c-4495-91aa-d765248e380d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:56.088171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:56.089407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:56.090280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:56.090280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:56.090280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:56.090280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 281/554] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:56.095159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746280cb-111c-4495-91aa-d765248e380d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:56.205993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210672a7-a3cc-4744-bd69-1d64ee37e229 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:56.257165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5baefa-8d7a-4ec1-a494-36a1c4c69979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:56.258045 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5baefa-8d7a-4ec1-a494-36a1c4c69979 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:56.260654 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5baefa-8d7a-4ec1-a494-36a1c4c69979 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:56.260959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5baefa-8d7a-4ec1-a494-36a1c4c69979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:56.324881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:56.335217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746280cb-111c-4495-91aa-d765248e380d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:56.367329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5baefa-8d7a-4ec1-a494-36a1c4c69979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:56.370036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5baefa-8d7a-4ec1-a494-36a1c4c69979 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:56.411789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1004c90-65fa-40b9-9d82-bf25cff9ddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:56.413896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1004c90-65fa-40b9-9d82-bf25cff9ddae None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:56.414810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1004c90-65fa-40b9-9d82-bf25cff9ddae None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:56.415536 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1004c90-65fa-40b9-9d82-bf25cff9ddae None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:56.417045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1004c90-65fa-40b9-9d82-bf25cff9ddae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:56.417983 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1004c90-65fa-40b9-9d82-bf25cff9ddae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:56.421027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1004c90-65fa-40b9-9d82-bf25cff9ddae None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:56.436247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:56.442888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 282/555] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:56.444916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc960db8-1c0a-494e-bd9b-e79248cac1ae None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:56.445114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc960db8-1c0a-494e-bd9b-e79248cac1ae None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:56.445266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc960db8-1c0a-494e-bd9b-e79248cac1ae None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:56.451022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 283/556] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:56.452369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40e0d-368e-48e5-92ad-cccb9b460653 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:56.452654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40e0d-368e-48e5-92ad-cccb9b460653 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:56.452928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40e0d-368e-48e5-92ad-cccb9b460653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:56.476182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4fd40e0d-368e-48e5-92ad-cccb9b460653 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:56.478298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4fd40e0d-368e-48e5-92ad-cccb9b460653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:56.545653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 274/557] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:50:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:50:56.546992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5baefa-8d7a-4ec1-a494-36a1c4c69979 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:56.579919 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 284/558] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:56.581113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40e0d-368e-48e5-92ad-cccb9b460653 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:56.660623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:56.694775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5baefa-8d7a-4ec1-a494-36a1c4c69979 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:56.710599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40e0d-368e-48e5-92ad-cccb9b460653 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:56.734693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2315-06b9-465b-a201-cab02c9c6aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:56.735450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2315-06b9-465b-a201-cab02c9c6aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:56.735766 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2315-06b9-465b-a201-cab02c9c6aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:56.736186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2315-06b9-465b-a201-cab02c9c6aa3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:56.745249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:56.748412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e2315-06b9-465b-a201-cab02c9c6aa3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:56.750653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e2315-06b9-465b-a201-cab02c9c6aa3 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:56.752625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3763041-0b6e-4545-9a77-bee1a1152e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:56.753280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763041-0b6e-4545-9a77-bee1a1152e4f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:56.753563 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763041-0b6e-4545-9a77-bee1a1152e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:56.753839 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763041-0b6e-4545-9a77-bee1a1152e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:56.765810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3763041-0b6e-4545-9a77-bee1a1152e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-8b3e2315-06b9-465b-a201-cab02c9c6aa3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:50:56.766401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:56.767500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:56.768641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:56.768641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:56.768641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:50:56.768641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:50:56.768641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:50:56.768641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:50:56.768641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:50:56.768641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:50:56.768641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:50:56.768641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:56.769288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3763041-0b6e-4545-9a77-bee1a1152e4f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:56.769371 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 275/559] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 10 07:50:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:56.773709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2315-06b9-465b-a201-cab02c9c6aa3 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-a3763041-0b6e-4545-9a77-bee1a1152e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:56.789500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:56.790570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:56.791487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:56.791487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:56.791487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:56.795348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 285/560] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:56.797192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198aa3-7eaa-4e1e-b9aa-79515f15e30a None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:56.797673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198aa3-7eaa-4e1e-b9aa-79515f15e30a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:56.798021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198aa3-7eaa-4e1e-b9aa-79515f15e30a None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:56.799628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 286/561] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:56.800370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63198aa3-7eaa-4e1e-b9aa-79515f15e30a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:56.906068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2315-06b9-465b-a201-cab02c9c6aa3 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:56.927007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63198aa3-7eaa-4e1e-b9aa-79515f15e30a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:56.947863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1898c61-2879-4eb2-bce7-6b1710da8b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:56.948400 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1898c61-2879-4eb2-bce7-6b1710da8b4e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:56.948646 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1898c61-2879-4eb2-bce7-6b1710da8b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:56.948919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1898c61-2879-4eb2-bce7-6b1710da8b4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:56.951160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:56.962450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1898c61-2879-4eb2-bce7-6b1710da8b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-d1898c61-2879-4eb2-bce7-6b1710da8b4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:56.967764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:56.968761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 276/562] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:50:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:56.974758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1898c61-2879-4eb2-bce7-6b1710da8b4e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:56.976460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa84a6-047e-4605-a35e-f69547128fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:56.976460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa84a6-047e-4605-a35e-f69547128fff None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:56.976460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa84a6-047e-4605-a35e-f69547128fff None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:56.976681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa84a6-047e-4605-a35e-f69547128fff None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:56.977783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa84a6-047e-4605-a35e-f69547128fff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:56.978171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa84a6-047e-4605-a35e-f69547128fff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:56.979751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa84a6-047e-4605-a35e-f69547128fff None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:57.001986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 287/563] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 10 07:50:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:57.003709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c135bd-3e44-42d7-bccb-38aeb443eeaa None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:57.004249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c135bd-3e44-42d7-bccb-38aeb443eeaa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:57.004708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c135bd-3e44-42d7-bccb-38aeb443eeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:57.025239 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-43c135bd-3e44-42d7-bccb-38aeb443eeaa None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:57.026512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-43c135bd-3e44-42d7-bccb-38aeb443eeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:57.062898 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:57.096099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1898c61-2879-4eb2-bce7-6b1710da8b4e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:57.099667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 288/564] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:57.100719 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c135bd-3e44-42d7-bccb-38aeb443eeaa None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:57.150172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c38e76-66aa-437b-800d-5e7c2d62fa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:57.150872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c38e76-66aa-437b-800d-5e7c2d62fa56 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:57.151186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c38e76-66aa-437b-800d-5e7c2d62fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:57.151511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c38e76-66aa-437b-800d-5e7c2d62fa56 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:57.152359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c38e76-66aa-437b-800d-5e7c2d62fa56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:57.152699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c38e76-66aa-437b-800d-5e7c2d62fa56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:57.154200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c38e76-66aa-437b-800d-5e7c2d62fa56 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:57.167669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 277/565] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:57.168541 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c38e76-66aa-437b-800d-5e7c2d62fa56 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:57.213152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c135bd-3e44-42d7-bccb-38aeb443eeaa None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:57.227364 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:57.248828 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92588c0a-b999-4c3c-b16b-098da25340fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:57.249451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92588c0a-b999-4c3c-b16b-098da25340fe None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:57.249817 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92588c0a-b999-4c3c-b16b-098da25340fe None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:57.250127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92588c0a-b999-4c3c-b16b-098da25340fe None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:57.250813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92588c0a-b999-4c3c-b16b-098da25340fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:57.251124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92588c0a-b999-4c3c-b16b-098da25340fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:57.252543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92588c0a-b999-4c3c-b16b-098da25340fe None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:57.261425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 289/566] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:50:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:57.262263 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92588c0a-b999-4c3c-b16b-098da25340fe None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:57.279862 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c38e76-66aa-437b-800d-5e7c2d62fa56 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:57.295773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:57.316027 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292aa31-95a9-4821-b2f4-fd38f5043390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:57.316658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292aa31-95a9-4821-b2f4-fd38f5043390 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:57.316944 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292aa31-95a9-4821-b2f4-fd38f5043390 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:57.317224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292aa31-95a9-4821-b2f4-fd38f5043390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:57.328034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292aa31-95a9-4821-b2f4-fd38f5043390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:57.329477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292aa31-95a9-4821-b2f4-fd38f5043390 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-3292aa31-95a9-4821-b2f4-fd38f5043390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:57.344139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:57.345304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:57.346172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:57.346172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:57.346172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:57.346172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 278/567] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:57.346951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4cdd0-1be9-4ceb-a96f-e0c3d10fa162 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:57.347064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4cdd0-1be9-4ceb-a96f-e0c3d10fa162 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:57.347281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4cdd0-1be9-4ceb-a96f-e0c3d10fa162 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:57.348665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 279/568] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:50:57.349301 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4cdd0-1be9-4ceb-a96f-e0c3d10fa162 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:57.370157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92588c0a-b999-4c3c-b16b-098da25340fe None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:57.404721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282cc33-da8f-4f38-9f98-568350b7a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:57.405461 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282cc33-da8f-4f38-9f98-568350b7a441 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:57.405764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282cc33-da8f-4f38-9f98-568350b7a441 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:57.406035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282cc33-da8f-4f38-9f98-568350b7a441 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:57.416278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282cc33-da8f-4f38-9f98-568350b7a441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e282cc33-da8f-4f38-9f98-568350b7a441 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:57.421505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:57.422611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 290/569] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:50:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:57.423485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282cc33-da8f-4f38-9f98-568350b7a441 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:57.458492 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4cdd0-1be9-4ceb-a96f-e0c3d10fa162 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:57.465995 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:57.494936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d100c-d9d2-4fdb-afd0-afcb66f6e259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:57.495842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d100c-d9d2-4fdb-afd0-afcb66f6e259 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:57.496273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d100c-d9d2-4fdb-afd0-afcb66f6e259 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:57.496546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d100c-d9d2-4fdb-afd0-afcb66f6e259 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:57.503178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d100c-d9d2-4fdb-afd0-afcb66f6e259 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:57.504591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d100c-d9d2-4fdb-afd0-afcb66f6e259 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-304d100c-d9d2-4fdb-afd0-afcb66f6e259 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:50:57.515872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:57.516821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:57.518435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:50:57.518435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:50:57.518435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:50:57.518435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:50:57.518435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:50:57.518435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:50:57.518435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:50:57.518435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:57.518435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 280/570] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:57.518435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d100c-d9d2-4fdb-afd0-afcb66f6e259 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:57.523074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:57.532255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282cc33-da8f-4f38-9f98-568350b7a441 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:57.566581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ba252-5803-46a5-af01-e6bef1b96db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:57.567250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ba252-5803-46a5-af01-e6bef1b96db1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:57.567536 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ba252-5803-46a5-af01-e6bef1b96db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:57.567842 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ba252-5803-46a5-af01-e6bef1b96db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:57.579169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ba252-5803-46a5-af01-e6bef1b96db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:57.580678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ba252-5803-46a5-af01-e6bef1b96db1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-254ba252-5803-46a5-af01-e6bef1b96db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:57.595349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:57.596359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:57.597297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:57.597297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:57.597297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:57.597297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 291/571] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:57.598572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45edbe-93ef-4e03-8469-730bacb61fe8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:57.599254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45edbe-93ef-4e03-8469-730bacb61fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:57.599506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45edbe-93ef-4e03-8469-730bacb61fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:57.618594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9c45edbe-93ef-4e03-8469-730bacb61fe8 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:50:57.619989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9c45edbe-93ef-4e03-8469-730bacb61fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:50:57.639350 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d100c-d9d2-4fdb-afd0-afcb66f6e259 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:57.681163 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a599d-b333-4e23-aa64-f3577eaf951f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:57.681768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a599d-b333-4e23-aa64-f3577eaf951f None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:57.682047 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a599d-b333-4e23-aa64-f3577eaf951f None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:57.682317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a599d-b333-4e23-aa64-f3577eaf951f None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:57.682953 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a599d-b333-4e23-aa64-f3577eaf951f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:57.683254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a599d-b333-4e23-aa64-f3577eaf951f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:57.684628 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a599d-b333-4e23-aa64-f3577eaf951f None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:57.690711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 292/572] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:50:57.691574 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45edbe-93ef-4e03-8469-730bacb61fe8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:57.702050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 281/573] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:57.702050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a599d-b333-4e23-aa64-f3577eaf951f None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:57.731177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:57.771067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:57.797884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45edbe-93ef-4e03-8469-730bacb61fe8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:57.809380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a599d-b333-4e23-aa64-f3577eaf951f None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:57.833292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27419c27-4686-4c57-91f0-4093135e8d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:57.833902 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27419c27-4686-4c57-91f0-4093135e8d73 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:57.834188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27419c27-4686-4c57-91f0-4093135e8d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:57.834757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27419c27-4686-4c57-91f0-4093135e8d73 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:57.835430 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27419c27-4686-4c57-91f0-4093135e8d73 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:57.835779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27419c27-4686-4c57-91f0-4093135e8d73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:57.837155 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27419c27-4686-4c57-91f0-4093135e8d73 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:57.845700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 293/574] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:50:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:57.846523 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27419c27-4686-4c57-91f0-4093135e8d73 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:57.847498 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcbe3e-1f0c-4a3f-a76a-34c0569c707e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:57.848138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcbe3e-1f0c-4a3f-a76a-34c0569c707e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:57.848453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcbe3e-1f0c-4a3f-a76a-34c0569c707e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:57.848695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcbe3e-1f0c-4a3f-a76a-34c0569c707e None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:57.849433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcbe3e-1f0c-4a3f-a76a-34c0569c707e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:57.849739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcbe3e-1f0c-4a3f-a76a-34c0569c707e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:57.851878 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcbe3e-1f0c-4a3f-a76a-34c0569c707e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:57.863561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 282/575] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:50:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:57.864422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcbe3e-1f0c-4a3f-a76a-34c0569c707e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:57.963204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:57.972612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27419c27-4686-4c57-91f0-4093135e8d73 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:57.978702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcbe3e-1f0c-4a3f-a76a-34c0569c707e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:58.006570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588e501-8f36-4825-b73d-d84c2f724eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:58.007178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588e501-8f36-4825-b73d-d84c2f724eaf None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:58.007453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588e501-8f36-4825-b73d-d84c2f724eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:58.007743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588e501-8f36-4825-b73d-d84c2f724eaf None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:58.008372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588e501-8f36-4825-b73d-d84c2f724eaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:58.008673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588e501-8f36-4825-b73d-d84c2f724eaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:58.010029 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588e501-8f36-4825-b73d-d84c2f724eaf None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:58.011806 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d1a2b-988e-4345-859e-4d4381906974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:58.012451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:58.012566 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d1a2b-988e-4345-859e-4d4381906974 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:58.012715 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d1a2b-988e-4345-859e-4d4381906974 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:58.012991 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d1a2b-988e-4345-859e-4d4381906974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:58.020094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d1a2b-988e-4345-859e-4d4381906974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:58.021519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d1a2b-988e-4345-859e-4d4381906974 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:58.023076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 294/576] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:58.023907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588e501-8f36-4825-b73d-d84c2f724eaf None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-0b9d1a2b-988e-4345-859e-4d4381906974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:50:58.033422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:58.034475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:58.035491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:50:58.035491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:50:58.035491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:50:58.035491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:50:58.035491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:50:58.035491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:50:58.035491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:50:58.035491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:58.035491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 283/577] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:58.036105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d1a2b-988e-4345-859e-4d4381906974 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:58.127411 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588e501-8f36-4825-b73d-d84c2f724eaf None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:58.138220 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d1a2b-988e-4345-859e-4d4381906974 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:58.161421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1aa4b-66f9-4f00-b910-509a06ad2fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:58.162049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1aa4b-66f9-4f00-b910-509a06ad2fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:58.162332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1aa4b-66f9-4f00-b910-509a06ad2fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:58.163188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1aa4b-66f9-4f00-b910-509a06ad2fd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:58.171909 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e20ef-1f55-40cf-a285-4ee6b3638470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:58.172537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e20ef-1f55-40cf-a285-4ee6b3638470 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:58.172820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e20ef-1f55-40cf-a285-4ee6b3638470 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:58.173096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e20ef-1f55-40cf-a285-4ee6b3638470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:58.173187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1aa4b-66f9-4f00-b910-509a06ad2fd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-dda1aa4b-66f9-4f00-b910-509a06ad2fd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:50:58.177899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:58.179173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:58.180021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:58.180021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:58.180021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:58.180021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:58.180021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:50:58.180021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:50:58.180021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:50:58.180021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:50:58.180021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:50:58.180021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:50:58.180021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:50:58.180021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:58.180021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 295/578] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:50:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:58.180705 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1aa4b-66f9-4f00-b910-509a06ad2fd0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:58.185015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e20ef-1f55-40cf-a285-4ee6b3638470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:58.186582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e20ef-1f55-40cf-a285-4ee6b3638470 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:58.193283 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-5e2e20ef-1f55-40cf-a285-4ee6b3638470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:58.201800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:58.202814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:58.204073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:58.204073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:58.204073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:58.204073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 284/579] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:58.204073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e20ef-1f55-40cf-a285-4ee6b3638470 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:58.242460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:58.286930 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1aa4b-66f9-4f00-b910-509a06ad2fd0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:58.305839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e20ef-1f55-40cf-a285-4ee6b3638470 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:58.327595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe24f5-ddba-4fd8-aecc-87b099d4a1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:58.328231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe24f5-ddba-4fd8-aecc-87b099d4a1bb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:58.328512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe24f5-ddba-4fd8-aecc-87b099d4a1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:58.328781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe24f5-ddba-4fd8-aecc-87b099d4a1bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:58.330400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe24f5-ddba-4fd8-aecc-87b099d4a1bb None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=867485ce37eb41359a8e53b2b78061f6) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:58.330400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe24f5-ddba-4fd8-aecc-87b099d4a1bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:58.331241 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe24f5-ddba-4fd8-aecc-87b099d4a1bb None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:58.337212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 296/580] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:50:58 2022] GET /identity/v3/role_assignments?user.id=867485ce37eb41359a8e53b2b78061f6&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:58.338053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe24f5-ddba-4fd8-aecc-87b099d4a1bb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:58.347587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaaa11-55a2-4328-b0b4-d39fb85f2041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:58.348309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaaa11-55a2-4328-b0b4-d39fb85f2041 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:58.348594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaaa11-55a2-4328-b0b4-d39fb85f2041 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:58.348866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaaa11-55a2-4328-b0b4-d39fb85f2041 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:58.358502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eaaa11-55a2-4328-b0b4-d39fb85f2041 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:58.360010 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eaaa11-55a2-4328-b0b4-d39fb85f2041 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-45eaaa11-55a2-4328-b0b4-d39fb85f2041 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:50:58.372410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:58.373403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:58.374402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:58.374402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:58.374402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:50:58.374402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:50:58.374402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:50:58.374402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:50:58.374402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:50:58.374402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:50:58.374402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 07:50:58.374402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:58.374402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 285/581] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:58.375008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaaa11-55a2-4328-b0b4-d39fb85f2041 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:58.445700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:58.475954 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe24f5-ddba-4fd8-aecc-87b099d4a1bb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:58.501783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaaa11-55a2-4328-b0b4-d39fb85f2041 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:58.502030 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:58.519352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336f467-ce9a-4c61-b0a6-3ab716b0bb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:58.520312 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f467-ce9a-4c61-b0a6-3ab716b0bb1e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:58.520596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f467-ce9a-4c61-b0a6-3ab716b0bb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:58.520868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f467-ce9a-4c61-b0a6-3ab716b0bb1e None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:58.521571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336f467-ce9a-4c61-b0a6-3ab716b0bb1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:58.522435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336f467-ce9a-4c61-b0a6-3ab716b0bb1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:58.524399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336f467-ce9a-4c61-b0a6-3ab716b0bb1e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:58.538218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 297/582] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:58.539001 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336f467-ce9a-4c61-b0a6-3ab716b0bb1e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:58.553107 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da225e80-ffd4-408f-a507-a512bf1031df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:58.554779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da225e80-ffd4-408f-a507-a512bf1031df None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:58.555343 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da225e80-ffd4-408f-a507-a512bf1031df None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:58.555900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da225e80-ffd4-408f-a507-a512bf1031df None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:58.556815 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da225e80-ffd4-408f-a507-a512bf1031df None admin] RBAC: Adding query filter params (name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:58.557210 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da225e80-ffd4-408f-a507-a512bf1031df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:58.558785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da225e80-ffd4-408f-a507-a512bf1031df None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:58.567496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 286/583] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:50:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:58.568192 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da225e80-ffd4-408f-a507-a512bf1031df None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:58.663582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336f467-ce9a-4c61-b0a6-3ab716b0bb1e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:58.697191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da225e80-ffd4-408f-a507-a512bf1031df None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:58.700534 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd715c8-6ab6-471a-beea-dadc55f17da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:58.701149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd715c8-6ab6-471a-beea-dadc55f17da8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:58.701431 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd715c8-6ab6-471a-beea-dadc55f17da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:58.701698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd715c8-6ab6-471a-beea-dadc55f17da8 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:58.702340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd715c8-6ab6-471a-beea-dadc55f17da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:58.702640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd715c8-6ab6-471a-beea-dadc55f17da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:58.704032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd715c8-6ab6-471a-beea-dadc55f17da8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:58.722409 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 298/584] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:58.726423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:58.727870 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd715c8-6ab6-471a-beea-dadc55f17da8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:58.750521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833b222-9db2-40af-9d45-2297eb094239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:58.751136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833b222-9db2-40af-9d45-2297eb094239 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:58.751423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833b222-9db2-40af-9d45-2297eb094239 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:58.751706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833b222-9db2-40af-9d45-2297eb094239 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:58.752507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833b222-9db2-40af-9d45-2297eb094239 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:58.752758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833b222-9db2-40af-9d45-2297eb094239 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:58.754177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833b222-9db2-40af-9d45-2297eb094239 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:58.775316 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:58.780968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 287/585] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Aug 10 07:50:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:58.781739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833b222-9db2-40af-9d45-2297eb094239 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:58.853881 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd715c8-6ab6-471a-beea-dadc55f17da8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:58.895943 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234738d-38d8-4ca2-b2b6-3360e384629f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:58.896607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234738d-38d8-4ca2-b2b6-3360e384629f None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:58.896922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234738d-38d8-4ca2-b2b6-3360e384629f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:58.897195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234738d-38d8-4ca2-b2b6-3360e384629f None admin] PATH_INFO: `/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/6c8e7a0b9eb14983ac117690e2705eb4/roles/6a4c16cbe590427c8b82f03b71c9a2c0` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:58.916106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833b222-9db2-40af-9d45-2297eb094239 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:58.918220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234738d-38d8-4ca2-b2b6-3360e384629f None admin] RBAC: Authorizing `identity:create_grant(project_id=bad7eba8964f4acf9c6c1397df7cd1dd, user_id=6c8e7a0b9eb14983ac117690e2705eb4, role_id=6a4c16cbe590427c8b82f03b71c9a2c0)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:58.919701 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234738d-38d8-4ca2-b2b6-3360e384629f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:58.934747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 299/586] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:50:58 2022] PUT /identity/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/6c8e7a0b9eb14983ac117690e2705eb4/roles/6a4c16cbe590427c8b82f03b71c9a2c0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:50:58.939945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234738d-38d8-4ca2-b2b6-3360e384629f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:58.966292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08825d3f-1d3d-4b33-9890-9213d68db02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:58.967121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08825d3f-1d3d-4b33-9890-9213d68db02a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:58.967475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08825d3f-1d3d-4b33-9890-9213d68db02a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:58.967887 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08825d3f-1d3d-4b33-9890-9213d68db02a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:58.980759 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08825d3f-1d3d-4b33-9890-9213d68db02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:58.982544 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08825d3f-1d3d-4b33-9890-9213d68db02a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-08825d3f-1d3d-4b33-9890-9213d68db02a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:59.010057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:59.012461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:59.014477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:59.014477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:59.014477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:59.014477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 288/587] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:59.014477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08825d3f-1d3d-4b33-9890-9213d68db02a None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:59.064512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:59.086056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:59.101891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234738d-38d8-4ca2-b2b6-3360e384629f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:59.156237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebed98-30f6-4fb5-a5b1-4056201ee3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:59.157214 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebed98-30f6-4fb5-a5b1-4056201ee3eb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:59.159870 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebed98-30f6-4fb5-a5b1-4056201ee3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:59.159870 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebed98-30f6-4fb5-a5b1-4056201ee3eb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:59.160109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08825d3f-1d3d-4b33-9890-9213d68db02a None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:59.169392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebed98-30f6-4fb5-a5b1-4056201ee3eb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:59.171488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebed98-30f6-4fb5-a5b1-4056201ee3eb None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2cebed98-30f6-4fb5-a5b1-4056201ee3eb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:50:59.188022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:59.189201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:59.190335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:59.190335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:59.190335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:50:59.190335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:50:59.190335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:50:59.190335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:50:59.190335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:50:59.190335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:50:59.190335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 07:50:59.190335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:59.193147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 300/588] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:50:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:59.194749 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebed98-30f6-4fb5-a5b1-4056201ee3eb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:59.211178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76006a4-6bab-4ec1-aeec-2f31163bd219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:59.212097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76006a4-6bab-4ec1-aeec-2f31163bd219 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:59.212536 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76006a4-6bab-4ec1-aeec-2f31163bd219 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:59.212881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76006a4-6bab-4ec1-aeec-2f31163bd219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:59.226811 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76006a4-6bab-4ec1-aeec-2f31163bd219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:59.229080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76006a4-6bab-4ec1-aeec-2f31163bd219 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-a76006a4-6bab-4ec1-aeec-2f31163bd219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:59.249925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:59.251142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:59.252361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:59.252361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:59.252361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:59.253507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 289/589] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:59.258880 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76006a4-6bab-4ec1-aeec-2f31163bd219 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:59.314489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebed98-30f6-4fb5-a5b1-4056201ee3eb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:59.351391 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f619574-d802-4f15-8e2f-5a1643e872ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:59.352011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f619574-d802-4f15-8e2f-5a1643e872ec None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:59.352291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f619574-d802-4f15-8e2f-5a1643e872ec None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:59.352564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f619574-d802-4f15-8e2f-5a1643e872ec None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:59.353207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f619574-d802-4f15-8e2f-5a1643e872ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:59.353507 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f619574-d802-4f15-8e2f-5a1643e872ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:59.354890 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f619574-d802-4f15-8e2f-5a1643e872ec None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:59.367678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 301/590] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:59.367996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:59.368258 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f619574-d802-4f15-8e2f-5a1643e872ec None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:59.383089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:59.399774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76006a4-6bab-4ec1-aeec-2f31163bd219 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:59.442387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f27e5-27aa-4ee3-88cc-7ae3835b50b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:59.443002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f27e5-27aa-4ee3-88cc-7ae3835b50b0 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:59.443281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f27e5-27aa-4ee3-88cc-7ae3835b50b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:59.444096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f27e5-27aa-4ee3-88cc-7ae3835b50b0 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:59.444844 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f27e5-27aa-4ee3-88cc-7ae3835b50b0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:59.445149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f27e5-27aa-4ee3-88cc-7ae3835b50b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:59.446924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f27e5-27aa-4ee3-88cc-7ae3835b50b0 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:59.466604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 290/591] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Aug 10 07:50:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:59.467295 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f27e5-27aa-4ee3-88cc-7ae3835b50b0 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:59.501938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f619574-d802-4f15-8e2f-5a1643e872ec None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:59.545914 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b36cf7-5d15-4732-ab5f-dd188571c27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:59.546588 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b36cf7-5d15-4732-ab5f-dd188571c27e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:59.546868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b36cf7-5d15-4732-ab5f-dd188571c27e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:59.547158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b36cf7-5d15-4732-ab5f-dd188571c27e None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:59.548289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b36cf7-5d15-4732-ab5f-dd188571c27e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:50:59.548595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b36cf7-5d15-4732-ab5f-dd188571c27e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:59.550269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b36cf7-5d15-4732-ab5f-dd188571c27e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:59.573342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 302/592] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:50:59.573342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b36cf7-5d15-4732-ab5f-dd188571c27e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:59.634858 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f27e5-27aa-4ee3-88cc-7ae3835b50b0 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:59.664884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:59.687249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f13d14-a693-49ca-a34c-d2f9ec511329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:59.688234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f13d14-a693-49ca-a34c-d2f9ec511329 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:59.688656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f13d14-a693-49ca-a34c-d2f9ec511329 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:59.689097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f13d14-a693-49ca-a34c-d2f9ec511329 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:59.697195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f13d14-a693-49ca-a34c-d2f9ec511329 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:59.699076 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f13d14-a693-49ca-a34c-d2f9ec511329 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:59.702132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:50:59.705595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b36cf7-5d15-4732-ab5f-dd188571c27e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-96f13d14-a693-49ca-a34c-d2f9ec511329 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:50:59.714756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:59.715699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:59.718648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:59.718648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:59.718648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:50:59.718648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:50:59.718648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:50:59.718648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:50:59.718648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:50:59.718648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:50:59.718648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:50:59.718648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:50:59.722721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 291/593] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:50:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:59.724452 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f13d14-a693-49ca-a34c-d2f9ec511329 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:59.764769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed0a66-f062-48b4-ad07-8ee58fbbf175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:59.766008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed0a66-f062-48b4-ad07-8ee58fbbf175 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:59.766545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed0a66-f062-48b4-ad07-8ee58fbbf175 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:59.767077 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed0a66-f062-48b4-ad07-8ee58fbbf175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:59.790654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed0a66-f062-48b4-ad07-8ee58fbbf175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:59.793430 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed0a66-f062-48b4-ad07-8ee58fbbf175 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-4aed0a66-f062-48b4-ad07-8ee58fbbf175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:50:59.823955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:50:59.825726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:50:59.827446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:50:59.827446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:50:59.827446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:50:59.827446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 303/594] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:50:59.827446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed0a66-f062-48b4-ad07-8ee58fbbf175 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:50:59.907350 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f13d14-a693-49ca-a34c-d2f9ec511329 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:59.959502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4655d-7dfc-496c-8282-bbb495251702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:50:59.960203 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4655d-7dfc-496c-8282-bbb495251702 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:50:59.960487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4655d-7dfc-496c-8282-bbb495251702 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:50:59.960765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4655d-7dfc-496c-8282-bbb495251702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:50:59.970581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4655d-7dfc-496c-8282-bbb495251702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:50:59.972347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4655d-7dfc-496c-8282-bbb495251702 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:50:59.986583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed0a66-f062-48b4-ad07-8ee58fbbf175 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-7cb4655d-7dfc-496c-8282-bbb495251702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:50:59.987830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:50:59.988747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:00.002919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:00.002919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:00.002919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:00.002919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:00.002919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:00.002919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:00.002919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:00.002919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:00.004322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 292/595] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:50:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:00.005422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4655d-7dfc-496c-8282-bbb495251702 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:00.014995 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:00.033949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60b64b-ed8b-4b03-bea7-141019f6b2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:00.033949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60b64b-ed8b-4b03-bea7-141019f6b2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:00.033949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60b64b-ed8b-4b03-bea7-141019f6b2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:00.033949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60b64b-ed8b-4b03-bea7-141019f6b2d9 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:00.034383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60b64b-ed8b-4b03-bea7-141019f6b2d9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:00.034383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60b64b-ed8b-4b03-bea7-141019f6b2d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:00.034383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60b64b-ed8b-4b03-bea7-141019f6b2d9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:00.058608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 304/596] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Aug 10 07:50:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:00.060144 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60b64b-ed8b-4b03-bea7-141019f6b2d9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:00.128202 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:00.163526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4655d-7dfc-496c-8282-bbb495251702 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:00.186324 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60b64b-ed8b-4b03-bea7-141019f6b2d9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:00.214971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d215a2-b0f7-4215-911d-44908b0f4cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:00.215589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d215a2-b0f7-4215-911d-44908b0f4cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:00.215934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d215a2-b0f7-4215-911d-44908b0f4cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:00.216268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d215a2-b0f7-4215-911d-44908b0f4cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:00.217315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d215a2-b0f7-4215-911d-44908b0f4cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:00.218164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d215a2-b0f7-4215-911d-44908b0f4cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:00.220195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d215a2-b0f7-4215-911d-44908b0f4cf2 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:00.229232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61c91e-db0c-46d9-9830-9234c5d23ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:00.229852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c91e-db0c-46d9-9830-9234c5d23ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:00.230134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c91e-db0c-46d9-9830-9234c5d23ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:00.230408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c91e-db0c-46d9-9830-9234c5d23ab4 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:00.231101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61c91e-db0c-46d9-9830-9234c5d23ab4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:00.231401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61c91e-db0c-46d9-9830-9234c5d23ab4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:00.232882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61c91e-db0c-46d9-9830-9234c5d23ab4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:00.235978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 293/597] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:00.236869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d215a2-b0f7-4215-911d-44908b0f4cf2 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:00.249801 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 305/598] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:00.250668 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61c91e-db0c-46d9-9830-9234c5d23ab4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:00.297003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:00.366352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61c91e-db0c-46d9-9830-9234c5d23ab4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:00.377986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d215a2-b0f7-4215-911d-44908b0f4cf2 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:00.401320 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:00.416011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f27ad0-96c7-41c6-928d-b2374db1c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:00.417355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f27ad0-96c7-41c6-928d-b2374db1c487 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:00.418244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f27ad0-96c7-41c6-928d-b2374db1c487 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:00.418679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f27ad0-96c7-41c6-928d-b2374db1c487 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:00.425056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c2a9b-a8bc-4863-9822-eeb00e2cd89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:00.425698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c2a9b-a8bc-4863-9822-eeb00e2cd89a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:00.425987 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c2a9b-a8bc-4863-9822-eeb00e2cd89a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:00.426690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c2a9b-a8bc-4863-9822-eeb00e2cd89a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:00.427302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f27ad0-96c7-41c6-928d-b2374db1c487 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:00.430024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f27ad0-96c7-41c6-928d-b2374db1c487 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:00.440099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c2a9b-a8bc-4863-9822-eeb00e2cd89a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:00.441571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c2a9b-a8bc-4863-9822-eeb00e2cd89a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-57f27ad0-96c7-41c6-928d-b2374db1c487 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:00.446304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:00.447376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:00.448369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:00.448369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:00.448369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:00.448369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:00.448369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:00.448369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:00.448369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:00.448369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:00.451870 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 306/599] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:00.452877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f27ad0-96c7-41c6-928d-b2374db1c487 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-7c3c2a9b-a8bc-4863-9822-eeb00e2cd89a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:00.463817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:00.465042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:00.466007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:00.466007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:00.466007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:00.466007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 294/600] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:00.466249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c2a9b-a8bc-4863-9822-eeb00e2cd89a None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:00.598229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:00.603093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f27ad0-96c7-41c6-928d-b2374db1c487 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:00.610256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c2a9b-a8bc-4863-9822-eeb00e2cd89a None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:00.640999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d304d-968e-4b95-b704-ae948be9b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:00.641781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d304d-968e-4b95-b704-ae948be9b3b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:00.642057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d304d-968e-4b95-b704-ae948be9b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:00.642329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d304d-968e-4b95-b704-ae948be9b3b3 None admin] PATH_INFO: `/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/553916344aaf40ae8abb050540f10559/roles/6a4c16cbe590427c8b82f03b71c9a2c0` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:00.650752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2738050-27e9-4ffd-ab21-ce47466f0440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:00.651523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2738050-27e9-4ffd-ab21-ce47466f0440 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:00.652223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2738050-27e9-4ffd-ab21-ce47466f0440 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:00.652507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2738050-27e9-4ffd-ab21-ce47466f0440 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:00.653316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2738050-27e9-4ffd-ab21-ce47466f0440 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:00.653619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2738050-27e9-4ffd-ab21-ce47466f0440 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:00.654959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2738050-27e9-4ffd-ab21-ce47466f0440 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:00.658725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d304d-968e-4b95-b704-ae948be9b3b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bad7eba8964f4acf9c6c1397df7cd1dd, user_id=553916344aaf40ae8abb050540f10559, role_id=6a4c16cbe590427c8b82f03b71c9a2c0)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:00.660608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d304d-968e-4b95-b704-ae948be9b3b3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:00.669004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 295/601] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:00.669987 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2738050-27e9-4ffd-ab21-ce47466f0440 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:00.695863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 307/602] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:51:00 2022] PUT /identity/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/553916344aaf40ae8abb050540f10559/roles/6a4c16cbe590427c8b82f03b71c9a2c0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:51:00.695863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5815fa1-f1b1-4124-8190-c123c248242e None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:00.695863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5815fa1-f1b1-4124-8190-c123c248242e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:00.695863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5815fa1-f1b1-4124-8190-c123c248242e None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:00.695863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 308/603] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:00.695863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5815fa1-f1b1-4124-8190-c123c248242e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:00.719455 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:00.827918 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2738050-27e9-4ffd-ab21-ce47466f0440 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:00.865184 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5815fa1-f1b1-4124-8190-c123c248242e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:00.875916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c8f61-77a4-4f07-b328-c11073c1c46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:00.877331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c8f61-77a4-4f07-b328-c11073c1c46a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:00.877704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c8f61-77a4-4f07-b328-c11073c1c46a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:00.878079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c8f61-77a4-4f07-b328-c11073c1c46a None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:00.878847 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c8f61-77a4-4f07-b328-c11073c1c46a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:00.879421 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c8f61-77a4-4f07-b328-c11073c1c46a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:00.882129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c8f61-77a4-4f07-b328-c11073c1c46a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:00.897331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 296/604] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:00.898776 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263170be-d3eb-427d-a5e9-45f467c59eb4 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:00.899068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263170be-d3eb-427d-a5e9-45f467c59eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:00.899347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263170be-d3eb-427d-a5e9-45f467c59eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:00.913864 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6217f-55c3-478f-9c90-1839a089a98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:00.915239 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6217f-55c3-478f-9c90-1839a089a98d None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:00.915239 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6217f-55c3-478f-9c90-1839a089a98d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:00.915642 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6217f-55c3-478f-9c90-1839a089a98d None admin] PATH_INFO: `/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/bb3537ce04d24347b155855d2e29cd9c/roles/6a4c16cbe590427c8b82f03b71c9a2c0` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:00.930334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-263170be-d3eb-427d-a5e9-45f467c59eb4 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:00.930603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-263170be-d3eb-427d-a5e9-45f467c59eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:00.934986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6217f-55c3-478f-9c90-1839a089a98d None admin] RBAC: Authorizing `identity:create_grant(project_id=bad7eba8964f4acf9c6c1397df7cd1dd, user_id=bb3537ce04d24347b155855d2e29cd9c, role_id=6a4c16cbe590427c8b82f03b71c9a2c0)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:00.936672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6217f-55c3-478f-9c90-1839a089a98d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:00.957868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 309/605] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:51:00 2022] PUT /identity/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/bb3537ce04d24347b155855d2e29cd9c/roles/6a4c16cbe590427c8b82f03b71c9a2c0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:51:00.958561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:00.964669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6217f-55c3-478f-9c90-1839a089a98d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:01.022956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 297/606] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:01.066033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263170be-d3eb-427d-a5e9-45f467c59eb4 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:01.108955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:01.196964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263170be-d3eb-427d-a5e9-45f467c59eb4 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:01.206163 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6217f-55c3-478f-9c90-1839a089a98d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:01.244120 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee54947-9e5f-4619-802c-612eb24dbe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:01.244895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54947-9e5f-4619-802c-612eb24dbe83 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:01.245269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54947-9e5f-4619-802c-612eb24dbe83 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:01.245850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54947-9e5f-4619-802c-612eb24dbe83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:01.247848 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d2d39-5e52-41c3-a385-645dd40dfa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:01.248800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d2d39-5e52-41c3-a385-645dd40dfa51 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:01.249083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d2d39-5e52-41c3-a385-645dd40dfa51 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:01.249798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d2d39-5e52-41c3-a385-645dd40dfa51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:01.258479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d2d39-5e52-41c3-a385-645dd40dfa51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:01.260283 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d2d39-5e52-41c3-a385-645dd40dfa51 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:01.260475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee54947-9e5f-4619-802c-612eb24dbe83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-6ee54947-9e5f-4619-802c-612eb24dbe83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:01.265476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:01.266453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:01.267389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:01.267389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:01.267389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:01.267389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:01.267389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:01.267389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:01.267389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:01.267389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:01.267389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:01.267389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:01.267389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:01.267389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:01.267389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 298/607] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:51:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:01.268495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2eb9d-fd4b-4f14-bc32-5194c82fdee9 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:01.268495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2eb9d-fd4b-4f14-bc32-5194c82fdee9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:01.268722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2eb9d-fd4b-4f14-bc32-5194c82fdee9 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:01.269957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 299/608] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:01.275659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2eb9d-fd4b-4f14-bc32-5194c82fdee9 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-830d2d39-5e52-41c3-a385-645dd40dfa51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:01.278243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:01.280244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:01.282386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:01.282386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:01.282386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:01.282386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:01.282386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:01.282386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:01.282386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:01.282386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:01.282386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 310/609] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:01.282386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3530b0-617e-4e97-8646-2c23bf36c4ae None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:01.283646 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3530b0-617e-4e97-8646-2c23bf36c4ae None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:01.283646 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3530b0-617e-4e97-8646-2c23bf36c4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:01.306795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7f3530b0-617e-4e97-8646-2c23bf36c4ae None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:01.308408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7f3530b0-617e-4e97-8646-2c23bf36c4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:01.383956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:01.389627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:01.399787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 311/610] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:01.401057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3530b0-617e-4e97-8646-2c23bf36c4ae None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:01.419250 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2eb9d-fd4b-4f14-bc32-5194c82fdee9 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:01.461611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e90a95-762b-4187-8975-52a5544de3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:01.462175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e90a95-762b-4187-8975-52a5544de3eb None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:01.462459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e90a95-762b-4187-8975-52a5544de3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:01.462735 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e90a95-762b-4187-8975-52a5544de3eb None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:01.463702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e90a95-762b-4187-8975-52a5544de3eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:01.463848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e90a95-762b-4187-8975-52a5544de3eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:01.465208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e90a95-762b-4187-8975-52a5544de3eb None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:01.474750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 300/611] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:51:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:01.475673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e90a95-762b-4187-8975-52a5544de3eb None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:01.519156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3530b0-617e-4e97-8646-2c23bf36c4ae None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:01.562481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d50165-0134-4442-b462-f90ab5243e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:01.563655 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d50165-0134-4442-b462-f90ab5243e77 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:01.564224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d50165-0134-4442-b462-f90ab5243e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:01.564743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d50165-0134-4442-b462-f90ab5243e77 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:01.566033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d50165-0134-4442-b462-f90ab5243e77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:01.566612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d50165-0134-4442-b462-f90ab5243e77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:01.569115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d50165-0134-4442-b462-f90ab5243e77 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:01.585636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 312/612] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:01.586950 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d50165-0134-4442-b462-f90ab5243e77 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:01.588833 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e90a95-762b-4187-8975-52a5544de3eb None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:01.636972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed89c3-913e-4a1a-845f-6e95f3e17239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:01.637646 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed89c3-913e-4a1a-845f-6e95f3e17239 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:01.637931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed89c3-913e-4a1a-845f-6e95f3e17239 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:01.638203 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed89c3-913e-4a1a-845f-6e95f3e17239 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:01.649300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:01.652444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed89c3-913e-4a1a-845f-6e95f3e17239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-cbed89c3-913e-4a1a-845f-6e95f3e17239 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:01.661515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:01.663049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:01.663959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:01.663959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:01.663959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:01.663959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:01.663959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:01.663959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:01.663959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:01.663959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:01.663959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:01.663959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:01.663959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:01.663959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:01.664594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 301/613] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:51:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:01.665167 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed89c3-913e-4a1a-845f-6e95f3e17239 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:01.670299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:01.716272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d50165-0134-4442-b462-f90ab5243e77 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:01.757008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dacbef-b849-4330-867d-f2e87a3c2a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:01.757963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dacbef-b849-4330-867d-f2e87a3c2a26 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:01.758402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dacbef-b849-4330-867d-f2e87a3c2a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:01.758841 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dacbef-b849-4330-867d-f2e87a3c2a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:01.771587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dacbef-b849-4330-867d-f2e87a3c2a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:01.773599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dacbef-b849-4330-867d-f2e87a3c2a26 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-32dacbef-b849-4330-867d-f2e87a3c2a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:01.791100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:01.792353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:01.793712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:01.793712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:01.793712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:01.793712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 313/614] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:01.793712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dacbef-b849-4330-867d-f2e87a3c2a26 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:01.813098 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed89c3-913e-4a1a-845f-6e95f3e17239 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:01.860052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b05b82-6c77-410e-9e5b-cbc30ab3c589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:01.861191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b05b82-6c77-410e-9e5b-cbc30ab3c589 None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:01.861681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b05b82-6c77-410e-9e5b-cbc30ab3c589 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:01.862149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b05b82-6c77-410e-9e5b-cbc30ab3c589 None admin] PATH_INFO: `/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/ab0470979f1643a390c667efc55c4069/roles/6a4c16cbe590427c8b82f03b71c9a2c0` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:01.882560 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b05b82-6c77-410e-9e5b-cbc30ab3c589 None admin] RBAC: Authorizing `identity:create_grant(project_id=bad7eba8964f4acf9c6c1397df7cd1dd, user_id=ab0470979f1643a390c667efc55c4069, role_id=6a4c16cbe590427c8b82f03b71c9a2c0)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:01.884908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b05b82-6c77-410e-9e5b-cbc30ab3c589 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:01.907890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 302/615] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:51:01 2022] PUT /identity/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/ab0470979f1643a390c667efc55c4069/roles/6a4c16cbe590427c8b82f03b71c9a2c0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:51:01.908895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b05b82-6c77-410e-9e5b-cbc30ab3c589 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:01.920660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dacbef-b849-4330-867d-f2e87a3c2a26 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:01.923427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:01.969636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e517ee-909f-4235-b165-54358b0c3855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:01.970177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e517ee-909f-4235-b165-54358b0c3855 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:01.970725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e517ee-909f-4235-b165-54358b0c3855 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:01.970725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e517ee-909f-4235-b165-54358b0c3855 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:01.971392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e517ee-909f-4235-b165-54358b0c3855 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:01.971701 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e517ee-909f-4235-b165-54358b0c3855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:01.973165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e517ee-909f-4235-b165-54358b0c3855 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:01.982775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 314/616] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:51:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:01.989531 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:01.991297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e517ee-909f-4235-b165-54358b0c3855 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:02.095270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b05b82-6c77-410e-9e5b-cbc30ab3c589 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:02.145376 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc1f83-d78b-47d2-8bc1-9e5a09cbf87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:02.145999 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc1f83-d78b-47d2-8bc1-9e5a09cbf87a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:02.146286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc1f83-d78b-47d2-8bc1-9e5a09cbf87a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:02.146597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc1f83-d78b-47d2-8bc1-9e5a09cbf87a None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:02.147275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc1f83-d78b-47d2-8bc1-9e5a09cbf87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:02.147581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc1f83-d78b-47d2-8bc1-9e5a09cbf87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:02.149073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc1f83-d78b-47d2-8bc1-9e5a09cbf87a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:02.182367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 303/617] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:02.189055 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc1f83-d78b-47d2-8bc1-9e5a09cbf87a None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:02.226329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e517ee-909f-4235-b165-54358b0c3855 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:02.279974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44d2ae-b38f-4eab-a288-8e044a094e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:02.280940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44d2ae-b38f-4eab-a288-8e044a094e04 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:02.281236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44d2ae-b38f-4eab-a288-8e044a094e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:02.281515 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44d2ae-b38f-4eab-a288-8e044a094e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:02.293989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44d2ae-b38f-4eab-a288-8e044a094e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:02.295970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44d2ae-b38f-4eab-a288-8e044a094e04 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-1d44d2ae-b38f-4eab-a288-8e044a094e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:02.311285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:02.312279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:02.313140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:02.313140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:02.313140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:02.313140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 315/618] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:02.319445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44d2ae-b38f-4eab-a288-8e044a094e04 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:02.368126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:02.419150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc1f83-d78b-47d2-8bc1-9e5a09cbf87a None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:02.450923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:02.503339 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44d2ae-b38f-4eab-a288-8e044a094e04 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:02.509004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90437c-a70c-4c48-847a-773fc4fa13d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:02.509656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90437c-a70c-4c48-847a-773fc4fa13d0 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:02.510091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90437c-a70c-4c48-847a-773fc4fa13d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:02.510381 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90437c-a70c-4c48-847a-773fc4fa13d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:02.528961 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90437c-a70c-4c48-847a-773fc4fa13d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:02.531229 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90437c-a70c-4c48-847a-773fc4fa13d0 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:02.547161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09211a5d-c6c6-49ef-9237-8f1a301c951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:02.547876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09211a5d-c6c6-49ef-9237-8f1a301c951c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:02.548334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09211a5d-c6c6-49ef-9237-8f1a301c951c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:02.548617 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09211a5d-c6c6-49ef-9237-8f1a301c951c None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:02.549325 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09211a5d-c6c6-49ef-9237-8f1a301c951c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:02.549636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09211a5d-c6c6-49ef-9237-8f1a301c951c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:02.551027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09211a5d-c6c6-49ef-9237-8f1a301c951c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-3b90437c-a70c-4c48-847a-773fc4fa13d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:02.554091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:02.556640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:02.559077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:02.559077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:02.559077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:02.559077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:02.559077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:02.559077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:02.559077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:02.559077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:02.559077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:51:02.559077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:02.559077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 304/619] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:51:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:02.565583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90437c-a70c-4c48-847a-773fc4fa13d0 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:02.565901 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 316/620] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:02.573716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09211a5d-c6c6-49ef-9237-8f1a301c951c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:02.736879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90437c-a70c-4c48-847a-773fc4fa13d0 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:02.788164 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:02.789336 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de829f-49f9-4cf0-a8ed-15417f47f0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:02.790107 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de829f-49f9-4cf0-a8ed-15417f47f0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:02.790445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de829f-49f9-4cf0-a8ed-15417f47f0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:02.790772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de829f-49f9-4cf0-a8ed-15417f47f0c2 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:02.791596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de829f-49f9-4cf0-a8ed-15417f47f0c2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:02.791957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de829f-49f9-4cf0-a8ed-15417f47f0c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:02.793513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de829f-49f9-4cf0-a8ed-15417f47f0c2 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:02.822804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09211a5d-c6c6-49ef-9237-8f1a301c951c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:02.920600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2704242-f51d-47c9-856a-a41afb5b1eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:02.921382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2704242-f51d-47c9-856a-a41afb5b1eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:02.921703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2704242-f51d-47c9-856a-a41afb5b1eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:02.922009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2704242-f51d-47c9-856a-a41afb5b1eb9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:02.937626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2704242-f51d-47c9-856a-a41afb5b1eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:02.939326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2704242-f51d-47c9-856a-a41afb5b1eb9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-a2704242-f51d-47c9-856a-a41afb5b1eb9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:02.972121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:02.973285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:02.974330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:02.974330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:02.974330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:02.974330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:02.974330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:02.974330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:02.974330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:02.974330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:02.974330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:51:02.974330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:02.974330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 317/621] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 10 07:51:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:02.981738 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2704242-f51d-47c9-856a-a41afb5b1eb9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:02.988813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 305/622] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Aug 10 07:51:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:02.997197 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de829f-49f9-4cf0-a8ed-15417f47f0c2 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:03.062316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:03.136200 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2704242-f51d-47c9-856a-a41afb5b1eb9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:03.182247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c2d60-c558-4904-b33d-e95c4aa41bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:03.183119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c2d60-c558-4904-b33d-e95c4aa41bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:03.183571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c2d60-c558-4904-b33d-e95c4aa41bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:03.183875 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c2d60-c558-4904-b33d-e95c4aa41bf0 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:03.184614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c2d60-c558-4904-b33d-e95c4aa41bf0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:03.184921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c2d60-c558-4904-b33d-e95c4aa41bf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:03.186469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c2d60-c558-4904-b33d-e95c4aa41bf0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:03.189504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:03.210984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 318/623] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 10 07:51:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:03.215589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de829f-49f9-4cf0-a8ed-15417f47f0c2 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:03.221754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c2d60-c558-4904-b33d-e95c4aa41bf0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:03.280939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afae72b-ed05-443a-af36-a7bcfceee6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:03.282352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afae72b-ed05-443a-af36-a7bcfceee6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:03.282997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afae72b-ed05-443a-af36-a7bcfceee6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:03.283754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afae72b-ed05-443a-af36-a7bcfceee6e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:03.302846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afae72b-ed05-443a-af36-a7bcfceee6e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:03.305665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afae72b-ed05-443a-af36-a7bcfceee6e7 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-5afae72b-ed05-443a-af36-a7bcfceee6e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:03.330315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:03.332159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:03.333724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:03.333724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:03.333724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:03.336227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 306/624] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:03.338104 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2818d3a-e628-48f4-b39b-a17c59ad22c9 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:03.338643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2818d3a-e628-48f4-b39b-a17c59ad22c9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:03.339130 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2818d3a-e628-48f4-b39b-a17c59ad22c9 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:03.340679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 307/625] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:03.342372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2818d3a-e628-48f4-b39b-a17c59ad22c9 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:03.384270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c2d60-c558-4904-b33d-e95c4aa41bf0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:03.432059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dab0b3-8ec4-4c26-883d-e8ade1522c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:03.432914 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dab0b3-8ec4-4c26-883d-e8ade1522c11 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:03.433200 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dab0b3-8ec4-4c26-883d-e8ade1522c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:03.433473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dab0b3-8ec4-4c26-883d-e8ade1522c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:03.453248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:03.478128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2818d3a-e628-48f4-b39b-a17c59ad22c9 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:03.516424 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:03.524144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486ed83-7831-4d84-b7ec-3f8e1a750bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:03.524769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486ed83-7831-4d84-b7ec-3f8e1a750bfb None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:03.525059 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486ed83-7831-4d84-b7ec-3f8e1a750bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:03.525337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486ed83-7831-4d84-b7ec-3f8e1a750bfb None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:03.525996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486ed83-7831-4d84-b7ec-3f8e1a750bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:03.526301 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486ed83-7831-4d84-b7ec-3f8e1a750bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:03.527683 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486ed83-7831-4d84-b7ec-3f8e1a750bfb None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:03.532608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dab0b3-8ec4-4c26-883d-e8ade1522c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:03.534611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dab0b3-8ec4-4c26-883d-e8ade1522c11 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:03.544902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 308/626] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:03.549141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb049aa-c232-4e99-a4fe-f23272269d2a None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:03.550030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb049aa-c232-4e99-a4fe-f23272269d2a None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:03.550744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb049aa-c232-4e99-a4fe-f23272269d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:03.578080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-bfb049aa-c232-4e99-a4fe-f23272269d2a None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:03.579450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-bfb049aa-c232-4e99-a4fe-f23272269d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:03.686979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 309/627] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:03.688480 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb049aa-c232-4e99-a4fe-f23272269d2a None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:03.714247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 319/628] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:51:03.714247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d7dc2-a926-4745-9965-a4819cc52e7c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:03.714247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d7dc2-a926-4745-9965-a4819cc52e7c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:03.714247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d7dc2-a926-4745-9965-a4819cc52e7c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:03.716438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 320/629] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:03.718047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d7dc2-a926-4745-9965-a4819cc52e7c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:03.823265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:03.857291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb049aa-c232-4e99-a4fe-f23272269d2a None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:03.863960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:03.871553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d7dc2-a926-4745-9965-a4819cc52e7c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:03.910345 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf11d77-cfe9-43eb-9df4-4085278bf5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:03.914278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf11d77-cfe9-43eb-9df4-4085278bf5df None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:03.914278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf11d77-cfe9-43eb-9df4-4085278bf5df None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:03.914278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf11d77-cfe9-43eb-9df4-4085278bf5df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:03.915936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feed88c-2634-420a-acc1-525ea78900c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:03.916717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feed88c-2634-420a-acc1-525ea78900c2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:03.917045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feed88c-2634-420a-acc1-525ea78900c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:03.917421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feed88c-2634-420a-acc1-525ea78900c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:03.923121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf11d77-cfe9-43eb-9df4-4085278bf5df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:03.925302 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf11d77-cfe9-43eb-9df4-4085278bf5df None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:03.928963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feed88c-2634-420a-acc1-525ea78900c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:03.930474 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feed88c-2634-420a-acc1-525ea78900c2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-0bf11d77-cfe9-43eb-9df4-4085278bf5df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:03.940667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:03.941820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:03.942915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:03.942915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:03.942915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:03.942915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:03.942915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:03.942915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:03.942915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:03.942915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:03.947529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 310/630] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2feed88c-2634-420a-acc1-525ea78900c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:03.948630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:03.958220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:03.962401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:03.962401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:03.962401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:03.964129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6865-01da-479d-998e-de9ac8b229fc None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:03.964129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6865-01da-479d-998e-de9ac8b229fc None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:03.964129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6865-01da-479d-998e-de9ac8b229fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:03.964811 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 321/631] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:03.964811 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feed88c-2634-420a-acc1-525ea78900c2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:03.974255 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-0ecf6865-01da-479d-998e-de9ac8b229fc None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:03.975628 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0ecf6865-01da-479d-998e-de9ac8b229fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:04.066224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 311/632] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:04.066906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf6865-01da-479d-998e-de9ac8b229fc None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:04.099396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feed88c-2634-420a-acc1-525ea78900c2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:04.138403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:04.138911 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2de912-d80f-4fdf-b476-251912b644e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:04.139847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2de912-d80f-4fdf-b476-251912b644e8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:04.139991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2de912-d80f-4fdf-b476-251912b644e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:04.140347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2de912-d80f-4fdf-b476-251912b644e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:04.152333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2de912-d80f-4fdf-b476-251912b644e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-5f2de912-d80f-4fdf-b476-251912b644e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:04.157568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:04.158521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:04.159344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:04.159344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:04.159344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:04.159344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:04.159344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:04.159344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:04.159344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:04.159344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:04.159344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:04.159344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:04.159344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:04.159344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:04.163689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 322/633] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:51:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:04.164564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2de912-d80f-4fdf-b476-251912b644e8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:04.173383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:04.197235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf6865-01da-479d-998e-de9ac8b229fc None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:04.236181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c18447-6f44-4cf1-a9e3-c94e3eb3a99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:04.236846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c18447-6f44-4cf1-a9e3-c94e3eb3a99d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:04.237090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c18447-6f44-4cf1-a9e3-c94e3eb3a99d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:04.237378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c18447-6f44-4cf1-a9e3-c94e3eb3a99d None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:04.238005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c18447-6f44-4cf1-a9e3-c94e3eb3a99d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:04.238665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c18447-6f44-4cf1-a9e3-c94e3eb3a99d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:04.239714 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c18447-6f44-4cf1-a9e3-c94e3eb3a99d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:04.258378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 312/634] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:04.258378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c18447-6f44-4cf1-a9e3-c94e3eb3a99d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:04.280616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2de912-d80f-4fdf-b476-251912b644e8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:04.323329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c8287-ab74-43ac-a7dd-8528ad140882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:04.324004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c8287-ab74-43ac-a7dd-8528ad140882 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:04.324337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c8287-ab74-43ac-a7dd-8528ad140882 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:04.324621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c8287-ab74-43ac-a7dd-8528ad140882 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:04.325289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c8287-ab74-43ac-a7dd-8528ad140882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:04.325595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c8287-ab74-43ac-a7dd-8528ad140882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:04.326992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c8287-ab74-43ac-a7dd-8528ad140882 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:04.341094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 323/635] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:04.341948 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c8287-ab74-43ac-a7dd-8528ad140882 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:04.388444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c18447-6f44-4cf1-a9e3-c94e3eb3a99d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:04.414483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:04.426314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:04.427462 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bef9b-0335-4e6d-93c7-c71fc6eef8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:04.428169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bef9b-0335-4e6d-93c7-c71fc6eef8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:04.428454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bef9b-0335-4e6d-93c7-c71fc6eef8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:04.428986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bef9b-0335-4e6d-93c7-c71fc6eef8a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:04.441199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bef9b-0335-4e6d-93c7-c71fc6eef8a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-668bef9b-0335-4e6d-93c7-c71fc6eef8a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:04.447083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:04.448222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:04.449078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:04.449078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:04.449078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:04.449078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:04.449078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:04.449078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:04.449078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:04.449078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:04.449078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:04.449078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:04.449078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:04.449078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:04.449078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 313/636] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:51:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:04.449770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bef9b-0335-4e6d-93c7-c71fc6eef8a1 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:04.475756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c8287-ab74-43ac-a7dd-8528ad140882 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:04.516569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ba950-05d1-4ce5-bbdb-33f0312f75ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:04.517190 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ba950-05d1-4ce5-bbdb-33f0312f75ab None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:04.518188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ba950-05d1-4ce5-bbdb-33f0312f75ab None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:04.518188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ba950-05d1-4ce5-bbdb-33f0312f75ab None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:04.519033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ba950-05d1-4ce5-bbdb-33f0312f75ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:04.519033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ba950-05d1-4ce5-bbdb-33f0312f75ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:04.520552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ba950-05d1-4ce5-bbdb-33f0312f75ab None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:04.532538 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 324/637] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:51:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:04.533381 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ba950-05d1-4ce5-bbdb-33f0312f75ab None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:04.566400 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bef9b-0335-4e6d-93c7-c71fc6eef8a1 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:04.604635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8a4f4-af44-42e8-b64e-a0eced699074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:04.605291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a4f4-af44-42e8-b64e-a0eced699074 None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:04.605572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a4f4-af44-42e8-b64e-a0eced699074 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:04.605846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a4f4-af44-42e8-b64e-a0eced699074 None admin] PATH_INFO: `/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/867485ce37eb41359a8e53b2b78061f6/roles/6a4c16cbe590427c8b82f03b71c9a2c0` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:04.625264 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8a4f4-af44-42e8-b64e-a0eced699074 None admin] RBAC: Authorizing `identity:create_grant(project_id=bad7eba8964f4acf9c6c1397df7cd1dd, user_id=867485ce37eb41359a8e53b2b78061f6, role_id=6a4c16cbe590427c8b82f03b71c9a2c0)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:04.627183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8a4f4-af44-42e8-b64e-a0eced699074 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:04.640962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 314/638] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:51:04 2022] PUT /identity/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/867485ce37eb41359a8e53b2b78061f6/roles/6a4c16cbe590427c8b82f03b71c9a2c0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:51:04.641993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8a4f4-af44-42e8-b64e-a0eced699074 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:04.651873 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ba950-05d1-4ce5-bbdb-33f0312f75ab None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:04.696304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:04.698507 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:04.712931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df7e64-8ec3-4801-9090-a69d318efbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:04.713677 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df7e64-8ec3-4801-9090-a69d318efbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:04.713971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df7e64-8ec3-4801-9090-a69d318efbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:04.714245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df7e64-8ec3-4801-9090-a69d318efbb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:04.723246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df7e64-8ec3-4801-9090-a69d318efbb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:04.725754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df7e64-8ec3-4801-9090-a69d318efbb9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-38df7e64-8ec3-4801-9090-a69d318efbb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:04.739473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:04.741166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:04.742217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:04.742217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:04.742217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:04.742217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:04.742217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:04.742217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:04.742217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:04.742217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:04.748875 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 325/639] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:04.750574 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f83b31-48f7-4dca-a71c-5d6576aa5f9b None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:04.751058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f83b31-48f7-4dca-a71c-5d6576aa5f9b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:04.751337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f83b31-48f7-4dca-a71c-5d6576aa5f9b None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:04.753032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 326/640] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:04.753818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f83b31-48f7-4dca-a71c-5d6576aa5f9b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:04.788017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8a4f4-af44-42e8-b64e-a0eced699074 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:04.840081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61910ab1-7d30-48dd-915b-42b19bee8006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:04.840759 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61910ab1-7d30-48dd-915b-42b19bee8006 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:04.841041 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61910ab1-7d30-48dd-915b-42b19bee8006 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:04.841314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61910ab1-7d30-48dd-915b-42b19bee8006 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:04.842054 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61910ab1-7d30-48dd-915b-42b19bee8006 None admin] RBAC: Adding query filter params (name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:04.842353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61910ab1-7d30-48dd-915b-42b19bee8006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:04.843738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61910ab1-7d30-48dd-915b-42b19bee8006 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:04.853706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 315/641] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:51:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:04.855961 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61910ab1-7d30-48dd-915b-42b19bee8006 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:04.899899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f83b31-48f7-4dca-a71c-5d6576aa5f9b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:04.942583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3bcc1-296e-4c4e-97b0-98cc19cf9385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:04.943225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3bcc1-296e-4c4e-97b0-98cc19cf9385 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:04.944132 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3bcc1-296e-4c4e-97b0-98cc19cf9385 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:04.944405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3bcc1-296e-4c4e-97b0-98cc19cf9385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:04.955535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3bcc1-296e-4c4e-97b0-98cc19cf9385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:04.956939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3bcc1-296e-4c4e-97b0-98cc19cf9385 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-86c3bcc1-296e-4c4e-97b0-98cc19cf9385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:04.975412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:04.976652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:04.977743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:04.977743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:04.977743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:04.981274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 327/642] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:04.982512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd7915-1f42-4fa5-a2cf-a494f2a29a5b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:04.982799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd7915-1f42-4fa5-a2cf-a494f2a29a5b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:04.983074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd7915-1f42-4fa5-a2cf-a494f2a29a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:05.002025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:05.003907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0ebd7915-1f42-4fa5-a2cf-a494f2a29a5b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:05.005362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0ebd7915-1f42-4fa5-a2cf-a494f2a29a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:05.010026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61910ab1-7d30-48dd-915b-42b19bee8006 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:05.049164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320ef0a-73c7-4a86-b977-5987165a80cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:05.049763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320ef0a-73c7-4a86-b977-5987165a80cd None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:05.050045 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320ef0a-73c7-4a86-b977-5987165a80cd None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:05.050316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320ef0a-73c7-4a86-b977-5987165a80cd None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:05.051014 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320ef0a-73c7-4a86-b977-5987165a80cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:05.051321 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320ef0a-73c7-4a86-b977-5987165a80cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:05.052622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:05.053242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320ef0a-73c7-4a86-b977-5987165a80cd None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:05.073061 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 316/643] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:05.073061 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320ef0a-73c7-4a86-b977-5987165a80cd None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:05.098822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 328/644] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:05.100635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd7915-1f42-4fa5-a2cf-a494f2a29a5b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:05.205688 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320ef0a-73c7-4a86-b977-5987165a80cd None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:05.223030 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd7915-1f42-4fa5-a2cf-a494f2a29a5b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:05.249492 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62d3a1-73ba-4827-810a-d7c7ece8da9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:05.250823 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62d3a1-73ba-4827-810a-d7c7ece8da9f None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:05.251285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62d3a1-73ba-4827-810a-d7c7ece8da9f None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:05.251783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62d3a1-73ba-4827-810a-d7c7ece8da9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:05.264168 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62d3a1-73ba-4827-810a-d7c7ece8da9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:05.266019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62d3a1-73ba-4827-810a-d7c7ece8da9f None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:05.273765 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18625611-be82-447c-bdef-ba9e077b0f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:05.274505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18625611-be82-447c-bdef-ba9e077b0f44 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:05.274786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18625611-be82-447c-bdef-ba9e077b0f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:05.275060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18625611-be82-447c-bdef-ba9e077b0f44 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:05.275708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18625611-be82-447c-bdef-ba9e077b0f44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:05.276041 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18625611-be82-447c-bdef-ba9e077b0f44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:05.277426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18625611-be82-447c-bdef-ba9e077b0f44 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-6a62d3a1-73ba-4827-810a-d7c7ece8da9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:05.284585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:05.285572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:05.286612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:05.286612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:05.286612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:05.286612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 317/645] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:05.286881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62d3a1-73ba-4827-810a-d7c7ece8da9f None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:05.292396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 329/646] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:05.294209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18625611-be82-447c-bdef-ba9e077b0f44 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:05.302351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:05.331169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:05.429410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62d3a1-73ba-4827-810a-d7c7ece8da9f None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:05.430040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18625611-be82-447c-bdef-ba9e077b0f44 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:05.475405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c8913-efd5-4efc-8246-791073a2b5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:05.475988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c8913-efd5-4efc-8246-791073a2b5ea None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:05.476266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c8913-efd5-4efc-8246-791073a2b5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:05.476542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c8913-efd5-4efc-8246-791073a2b5ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:05.479941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1e99f-560a-469c-b8b3-672ecb7dc9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:05.480926 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1e99f-560a-469c-b8b3-672ecb7dc9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:05.481407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1e99f-560a-469c-b8b3-672ecb7dc9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:05.481881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1e99f-560a-469c-b8b3-672ecb7dc9c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:05.483183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1e99f-560a-469c-b8b3-672ecb7dc9c3 None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=6c8e7a0b9eb14983ac117690e2705eb4) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:05.483742 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1e99f-560a-469c-b8b3-672ecb7dc9c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:05.486368 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1e99f-560a-469c-b8b3-672ecb7dc9c3 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:05.487562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c8913-efd5-4efc-8246-791073a2b5ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-8c0c8913-efd5-4efc-8246-791073a2b5ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:05.492843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:05.493920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 330/647] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:51:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:05.495500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c8913-efd5-4efc-8246-791073a2b5ea None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:05.507805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 318/648] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:05 2022] GET /identity/v3/role_assignments?user.id=6c8e7a0b9eb14983ac117690e2705eb4&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:05.507805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1e99f-560a-469c-b8b3-672ecb7dc9c3 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:05.605599 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:05.630870 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:05.643338 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c8913-efd5-4efc-8246-791073a2b5ea None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:05.647142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1e99f-560a-469c-b8b3-672ecb7dc9c3 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:05.682629 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7872ba5-039c-4846-82f6-19ca9bd2d865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:05.683203 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7872ba5-039c-4846-82f6-19ca9bd2d865 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:05.683490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7872ba5-039c-4846-82f6-19ca9bd2d865 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:05.683810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7872ba5-039c-4846-82f6-19ca9bd2d865 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:05.684466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7872ba5-039c-4846-82f6-19ca9bd2d865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:05.684764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7872ba5-039c-4846-82f6-19ca9bd2d865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:05.686159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7872ba5-039c-4846-82f6-19ca9bd2d865 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:05.687684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5a66d-931c-4db6-b211-1e3cc3309a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:05.688857 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5a66d-931c-4db6-b211-1e3cc3309a88 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:05.689224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5a66d-931c-4db6-b211-1e3cc3309a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:05.689477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5a66d-931c-4db6-b211-1e3cc3309a88 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:05.697928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5a66d-931c-4db6-b211-1e3cc3309a88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:05.699381 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5a66d-931c-4db6-b211-1e3cc3309a88 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:05.700745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 331/649] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:05.701746 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7872ba5-039c-4846-82f6-19ca9bd2d865 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-31b5a66d-931c-4db6-b211-1e3cc3309a88 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:05.711978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:05.714038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:05.714960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:05.714960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:05.714960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:05.714960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:05.714960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:05.714960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:05.714960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:05.714960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:05.714960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 07:51:05.714960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:05.714960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 319/650] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:51:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:05.714960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5a66d-931c-4db6-b211-1e3cc3309a88 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:05.829295 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7872ba5-039c-4846-82f6-19ca9bd2d865 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:05.837548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5a66d-931c-4db6-b211-1e3cc3309a88 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:05.871126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f05ad6-98bc-4fd6-8719-7877c98bfab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:05.871806 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f05ad6-98bc-4fd6-8719-7877c98bfab6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:05.872153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f05ad6-98bc-4fd6-8719-7877c98bfab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:05.872429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f05ad6-98bc-4fd6-8719-7877c98bfab6 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:05.873199 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f05ad6-98bc-4fd6-8719-7877c98bfab6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:05.873564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f05ad6-98bc-4fd6-8719-7877c98bfab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:05.875172 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f05ad6-98bc-4fd6-8719-7877c98bfab6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:05.875643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:05.883597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c790b-af35-4ecd-8a9f-bd6f5d04e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:05.884543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c790b-af35-4ecd-8a9f-bd6f5d04e47e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:05.884832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c790b-af35-4ecd-8a9f-bd6f5d04e47e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:05.885107 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c790b-af35-4ecd-8a9f-bd6f5d04e47e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:05.886474 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 332/651] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:51:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:05.887477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f05ad6-98bc-4fd6-8719-7877c98bfab6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:05.899771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c790b-af35-4ecd-8a9f-bd6f5d04e47e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:05.899771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c790b-af35-4ecd-8a9f-bd6f5d04e47e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:05.906020 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-da7c790b-af35-4ecd-8a9f-bd6f5d04e47e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:05.923227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:05.924289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:05.925428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:05.925428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:05.925428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:05.925428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:05.925428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:05.925428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:05.925428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:05.925428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:05.925428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 07:51:05.925428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:05.925428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 320/652] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:51:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:05.930960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c790b-af35-4ecd-8a9f-bd6f5d04e47e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:06.027000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f05ad6-98bc-4fd6-8719-7877c98bfab6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:06.050389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c790b-af35-4ecd-8a9f-bd6f5d04e47e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:06.072674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9a081-1808-4e8a-8b68-053a1a1cb325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:06.073292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9a081-1808-4e8a-8b68-053a1a1cb325 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:06.073574 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9a081-1808-4e8a-8b68-053a1a1cb325 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:06.073847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9a081-1808-4e8a-8b68-053a1a1cb325 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:06.075093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9a081-1808-4e8a-8b68-053a1a1cb325 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:06.075408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9a081-1808-4e8a-8b68-053a1a1cb325 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:06.077186 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9a081-1808-4e8a-8b68-053a1a1cb325 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:06.093980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab47f76-09a3-476a-af34-5f5df6537c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:06.094734 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab47f76-09a3-476a-af34-5f5df6537c04 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:06.095088 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab47f76-09a3-476a-af34-5f5df6537c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:06.095461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab47f76-09a3-476a-af34-5f5df6537c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:06.100177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 333/653] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Aug 10 07:51:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:06.101022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9a081-1808-4e8a-8b68-053a1a1cb325 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:06.108952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab47f76-09a3-476a-af34-5f5df6537c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:06.110714 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab47f76-09a3-476a-af34-5f5df6537c04 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-fab47f76-09a3-476a-af34-5f5df6537c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:06.127504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:06.129468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:06.132087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:06.132087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:06.132087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:06.132087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 321/654] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:06.132087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab47f76-09a3-476a-af34-5f5df6537c04 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:06.188909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:06.190276 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:06.233350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9a081-1808-4e8a-8b68-053a1a1cb325 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:06.260120 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab47f76-09a3-476a-af34-5f5df6537c04 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:06.279522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae112c3-93e0-4900-b387-ed84b2625b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:06.280416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae112c3-93e0-4900-b387-ed84b2625b27 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:06.280701 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae112c3-93e0-4900-b387-ed84b2625b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:06.280977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae112c3-93e0-4900-b387-ed84b2625b27 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:06.282100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae112c3-93e0-4900-b387-ed84b2625b27 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:06.282408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae112c3-93e0-4900-b387-ed84b2625b27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:06.283876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae112c3-93e0-4900-b387-ed84b2625b27 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:06.301502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7a6fe-de61-4ddf-871d-a050b32db50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:06.303245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7a6fe-de61-4ddf-871d-a050b32db50b None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:06.303543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7a6fe-de61-4ddf-871d-a050b32db50b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:06.304100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7a6fe-de61-4ddf-871d-a050b32db50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:06.307493 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 334/655] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Aug 10 07:51:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:06.308664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae112c3-93e0-4900-b387-ed84b2625b27 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:06.394999 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7a6fe-de61-4ddf-871d-a050b32db50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:06.396997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7a6fe-de61-4ddf-871d-a050b32db50b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:06.438015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae112c3-93e0-4900-b387-ed84b2625b27 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:06.456995 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:06.469462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:06.478567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb776f-d0a5-4522-9791-4905434440d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:06.479296 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb776f-d0a5-4522-9791-4905434440d3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:06.479683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb776f-d0a5-4522-9791-4905434440d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:06.480092 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb776f-d0a5-4522-9791-4905434440d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:06.480891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb776f-d0a5-4522-9791-4905434440d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:06.481294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb776f-d0a5-4522-9791-4905434440d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:06.482748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb776f-d0a5-4522-9791-4905434440d3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:06.495606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 335/656] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:06.496601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb776f-d0a5-4522-9791-4905434440d3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:06.535215 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 322/657] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:51:06.538110 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7a6fe-de61-4ddf-871d-a050b32db50b None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:06.611347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb776f-d0a5-4522-9791-4905434440d3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:06.650759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acaa8e-176e-48ce-9617-49ddc8d9f296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:06.651303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acaa8e-176e-48ce-9617-49ddc8d9f296 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:06.651587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acaa8e-176e-48ce-9617-49ddc8d9f296 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:06.651892 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acaa8e-176e-48ce-9617-49ddc8d9f296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:06.673187 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7a6fe-de61-4ddf-871d-a050b32db50b None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:06.729342 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d766c01-2b91-4419-80c2-3570a008a269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:06.729987 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d766c01-2b91-4419-80c2-3570a008a269 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:06.730275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d766c01-2b91-4419-80c2-3570a008a269 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:06.730543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d766c01-2b91-4419-80c2-3570a008a269 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:06.738936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d766c01-2b91-4419-80c2-3570a008a269 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:06.739964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:06.741780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d766c01-2b91-4419-80c2-3570a008a269 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-1d766c01-2b91-4419-80c2-3570a008a269 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:06.755980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:06.758334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:06.760822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:06.760822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:06.760822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:06.760822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:06.760822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:06.760822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:06.760822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:06.760822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:06.760822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:51:06.760822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:06.760822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 323/658] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:51:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:06.760822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d766c01-2b91-4419-80c2-3570a008a269 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:06.762488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acaa8e-176e-48ce-9617-49ddc8d9f296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:06.762488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acaa8e-176e-48ce-9617-49ddc8d9f296 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:06.762891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:06.882020 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d766c01-2b91-4419-80c2-3570a008a269 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:06.931792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 336/659] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:51:06.933152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acaa8e-176e-48ce-9617-49ddc8d9f296 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:06.938027 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9a704-6b70-40cd-87fa-09a7add7e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:06.939944 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9a704-6b70-40cd-87fa-09a7add7e969 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:06.940445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9a704-6b70-40cd-87fa-09a7add7e969 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:06.940885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9a704-6b70-40cd-87fa-09a7add7e969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:06.954702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9a704-6b70-40cd-87fa-09a7add7e969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:06.956741 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9a704-6b70-40cd-87fa-09a7add7e969 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-e5d9a704-6b70-40cd-87fa-09a7add7e969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:06.974359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:06.975929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:06.976801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:06.976801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:06.976801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:06.976801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 324/660] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:06.977644 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc77a6d-79ad-4c5d-865f-3a7da8520293 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:06.977644 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc77a6d-79ad-4c5d-865f-3a7da8520293 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:06.977900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc77a6d-79ad-4c5d-865f-3a7da8520293 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:06.979271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 325/661] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:06.983773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc77a6d-79ad-4c5d-865f-3a7da8520293 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:07.056282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:07.065182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:07.084696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acaa8e-176e-48ce-9617-49ddc8d9f296 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:07.109717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc77a6d-79ad-4c5d-865f-3a7da8520293 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:07.124488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fcb93-f58c-443e-bb91-70c71acc518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:07.125108 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fcb93-f58c-443e-bb91-70c71acc518b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:07.125387 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fcb93-f58c-443e-bb91-70c71acc518b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:07.125659 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fcb93-f58c-443e-bb91-70c71acc518b None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:07.126385 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fcb93-f58c-443e-bb91-70c71acc518b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:07.126690 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fcb93-f58c-443e-bb91-70c71acc518b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:07.128186 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fcb93-f58c-443e-bb91-70c71acc518b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:07.157386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 337/662] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Aug 10 07:51:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:07.157386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3cc3-b054-426d-a2c0-d371e8a0510a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:07.157386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3cc3-b054-426d-a2c0-d371e8a0510a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:07.157386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3cc3-b054-426d-a2c0-d371e8a0510a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:07.159958 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c6d16-c6c6-4002-b17c-21149e5b9ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:07.161023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6d16-c6c6-4002-b17c-21149e5b9ecc None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:07.161511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6d16-c6c6-4002-b17c-21149e5b9ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:07.161985 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6d16-c6c6-4002-b17c-21149e5b9ecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:07.177923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ca8c3cc3-b054-426d-a2c0-d371e8a0510a None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:07.179884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ca8c3cc3-b054-426d-a2c0-d371e8a0510a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:07.181435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c6d16-c6c6-4002-b17c-21149e5b9ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:07.182890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c6d16-c6c6-4002-b17c-21149e5b9ecc None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-807c6d16-c6c6-4002-b17c-21149e5b9ecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:07.201081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:07.202352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:07.203428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:07.203428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:07.203428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:07.210179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 326/663] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:07.210179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c6d16-c6c6-4002-b17c-21149e5b9ecc None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:07.267774 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 338/664] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:07.267774 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c3cc3-b054-426d-a2c0-d371e8a0510a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:07.323540 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c6d16-c6c6-4002-b17c-21149e5b9ecc None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:07.334814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:07.362011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bc363-8f45-4b92-b1fb-5e2b2e49493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:07.362617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bc363-8f45-4b92-b1fb-5e2b2e49493b None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:07.362897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bc363-8f45-4b92-b1fb-5e2b2e49493b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:07.363165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bc363-8f45-4b92-b1fb-5e2b2e49493b None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:07.364088 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bc363-8f45-4b92-b1fb-5e2b2e49493b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:07.364198 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bc363-8f45-4b92-b1fb-5e2b2e49493b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:07.365576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bc363-8f45-4b92-b1fb-5e2b2e49493b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:07.382855 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 327/665] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:07.382855 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bc363-8f45-4b92-b1fb-5e2b2e49493b None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:07.386439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:07.416568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c3cc3-b054-426d-a2c0-d371e8a0510a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:07.452906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ab2cc-b8e6-4f88-b3a1-e47098960282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:07.453514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ab2cc-b8e6-4f88-b3a1-e47098960282 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:07.453725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ab2cc-b8e6-4f88-b3a1-e47098960282 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:07.453958 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ab2cc-b8e6-4f88-b3a1-e47098960282 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:07.499902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bc363-8f45-4b92-b1fb-5e2b2e49493b None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:07.524629 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ab2cc-b8e6-4f88-b3a1-e47098960282 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:07.526105 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ab2cc-b8e6-4f88-b3a1-e47098960282 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:07.538579 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4791c4-f9ac-47ed-96ed-4f66ef52cd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:07.539282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4791c4-f9ac-47ed-96ed-4f66ef52cd5e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:07.539565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4791c4-f9ac-47ed-96ed-4f66ef52cd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:07.539876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4791c4-f9ac-47ed-96ed-4f66ef52cd5e None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:07.540640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4791c4-f9ac-47ed-96ed-4f66ef52cd5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:07.540947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4791c4-f9ac-47ed-96ed-4f66ef52cd5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:07.542624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4791c4-f9ac-47ed-96ed-4f66ef52cd5e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:07.555794 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 328/666] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:07.560968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4791c4-f9ac-47ed-96ed-4f66ef52cd5e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:07.592936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:07.607318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:07.638963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 339/667] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:51:07.638963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ab2cc-b8e6-4f88-b3a1-e47098960282 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:07.679017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4791c4-f9ac-47ed-96ed-4f66ef52cd5e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:07.716603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6d5b7-14df-4a0d-a770-b606bb360b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:07.717155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6d5b7-14df-4a0d-a770-b606bb360b6e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:07.717438 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6d5b7-14df-4a0d-a770-b606bb360b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:07.717711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6d5b7-14df-4a0d-a770-b606bb360b6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:07.728579 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6d5b7-14df-4a0d-a770-b606bb360b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-76f6d5b7-14df-4a0d-a770-b606bb360b6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:07.733805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:07.734788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 329/668] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:51:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:07.740689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6d5b7-14df-4a0d-a770-b606bb360b6e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:07.759628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ab2cc-b8e6-4f88-b3a1-e47098960282 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:07.798609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107d9ee-d5ae-492e-b56a-485520cf0c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:07.799535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d9ee-d5ae-492e-b56a-485520cf0c91 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:07.799853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d9ee-d5ae-492e-b56a-485520cf0c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:07.800130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d9ee-d5ae-492e-b56a-485520cf0c91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:07.807990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107d9ee-d5ae-492e-b56a-485520cf0c91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:07.809443 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107d9ee-d5ae-492e-b56a-485520cf0c91 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2107d9ee-d5ae-492e-b56a-485520cf0c91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:07.821514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:07.827332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:07.828522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:07.828522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:07.828522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:07.828522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:07.828522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:07.828522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:07.828522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:07.828522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:07.828522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 340/669] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:07.828522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107d9ee-d5ae-492e-b56a-485520cf0c91 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:07.843474 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:07.859460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6d5b7-14df-4a0d-a770-b606bb360b6e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:07.876721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:07.917884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8f8ae-5255-4631-98eb-1d95bc353571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:07.918531 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8f8ae-5255-4631-98eb-1d95bc353571 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:07.918828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8f8ae-5255-4631-98eb-1d95bc353571 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:07.919107 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8f8ae-5255-4631-98eb-1d95bc353571 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:07.927584 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8f8ae-5255-4631-98eb-1d95bc353571 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:07.929884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8f8ae-5255-4631-98eb-1d95bc353571 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-62a8f8ae-5255-4631-98eb-1d95bc353571 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:07.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:07.944337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:07.945224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:07.945224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:07.945224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:07.945224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:07.945224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:07.945224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:07.945224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:07.945224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:07.945224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 330/670] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:07.945224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8f8ae-5255-4631-98eb-1d95bc353571 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:07.959812 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107d9ee-d5ae-492e-b56a-485520cf0c91 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:07.996584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c3670-93aa-4c43-921a-a4382d23c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:07.997138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c3670-93aa-4c43-921a-a4382d23c090 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:07.997421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c3670-93aa-4c43-921a-a4382d23c090 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:07.997697 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c3670-93aa-4c43-921a-a4382d23c090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:08.008740 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c3670-93aa-4c43-921a-a4382d23c090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:08.010442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c3670-93aa-4c43-921a-a4382d23c090 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-347c3670-93aa-4c43-921a-a4382d23c090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:08.025062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:08.026064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:08.027016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:08.027016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:08.027016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:08.027016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 341/671] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:08.027016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c3670-93aa-4c43-921a-a4382d23c090 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:08.050465 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8f8ae-5255-4631-98eb-1d95bc353571 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:08.085438 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05eeeb-6e99-458d-8401-9537c26a2f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:08.086045 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05eeeb-6e99-458d-8401-9537c26a2f3b None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:08.086325 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05eeeb-6e99-458d-8401-9537c26a2f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:08.086596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05eeeb-6e99-458d-8401-9537c26a2f3b None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:08.087261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05eeeb-6e99-458d-8401-9537c26a2f3b None admin] RBAC: Adding query filter params (name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:08.087569 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05eeeb-6e99-458d-8401-9537c26a2f3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:08.088956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05eeeb-6e99-458d-8401-9537c26a2f3b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:08.097154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 331/672] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:51:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:08.098368 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6a640-fed0-4334-bae6-1c4a7cf90f4b None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:08.098656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6a640-fed0-4334-bae6-1c4a7cf90f4b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:08.098936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6a640-fed0-4334-bae6-1c4a7cf90f4b None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:08.100174 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 332/673] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:08.100886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6a640-fed0-4334-bae6-1c4a7cf90f4b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:08.114066 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:08.119843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:08.133244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c3670-93aa-4c43-921a-a4382d23c090 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:08.173752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5ea1a-b309-4920-8e9c-69d1ae14e108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:08.174366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5ea1a-b309-4920-8e9c-69d1ae14e108 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:08.174648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5ea1a-b309-4920-8e9c-69d1ae14e108 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:08.174925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5ea1a-b309-4920-8e9c-69d1ae14e108 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:08.175615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5ea1a-b309-4920-8e9c-69d1ae14e108 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:08.175947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5ea1a-b309-4920-8e9c-69d1ae14e108 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:08.177390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5ea1a-b309-4920-8e9c-69d1ae14e108 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:08.191519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 342/674] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:08.192402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5ea1a-b309-4920-8e9c-69d1ae14e108 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:08.243223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6a640-fed0-4334-bae6-1c4a7cf90f4b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:08.277950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46139d-f39f-459d-b4a1-e7ba56a909bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:08.278480 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46139d-f39f-459d-b4a1-e7ba56a909bb None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:08.278765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46139d-f39f-459d-b4a1-e7ba56a909bb None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:08.279037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46139d-f39f-459d-b4a1-e7ba56a909bb None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:08.279750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46139d-f39f-459d-b4a1-e7ba56a909bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:08.280063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46139d-f39f-459d-b4a1-e7ba56a909bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:08.281477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46139d-f39f-459d-b4a1-e7ba56a909bb None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:08.293675 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 333/675] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:08.294497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46139d-f39f-459d-b4a1-e7ba56a909bb None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:08.305982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5ea1a-b309-4920-8e9c-69d1ae14e108 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:08.340442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107710f-dafc-4332-8b7b-9001ccefec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:08.341063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107710f-dafc-4332-8b7b-9001ccefec31 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:08.341357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107710f-dafc-4332-8b7b-9001ccefec31 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:08.341687 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107710f-dafc-4332-8b7b-9001ccefec31 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:08.342353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107710f-dafc-4332-8b7b-9001ccefec31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:08.342656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107710f-dafc-4332-8b7b-9001ccefec31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:08.344066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107710f-dafc-4332-8b7b-9001ccefec31 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:08.357212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 343/676] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:08.358532 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b3faa-f4e7-4d8a-a24f-35cca29166d6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:08.358815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b3faa-f4e7-4d8a-a24f-35cca29166d6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:08.359094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b3faa-f4e7-4d8a-a24f-35cca29166d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:08.374016 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:08.377745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fb8b3faa-f4e7-4d8a-a24f-35cca29166d6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:08.379016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fb8b3faa-f4e7-4d8a-a24f-35cca29166d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:08.381211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:08.407841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46139d-f39f-459d-b4a1-e7ba56a909bb None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:08.442528 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a91f5-32af-4ff1-b5ea-36ff838848f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:08.443162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a91f5-32af-4ff1-b5ea-36ff838848f4 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:08.443443 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a91f5-32af-4ff1-b5ea-36ff838848f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:08.443743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a91f5-32af-4ff1-b5ea-36ff838848f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:08.448896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 344/677] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:08.449792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b3faa-f4e7-4d8a-a24f-35cca29166d6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:08.454627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a91f5-32af-4ff1-b5ea-36ff838848f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:08.456111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a91f5-32af-4ff1-b5ea-36ff838848f4 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-222a91f5-32af-4ff1-b5ea-36ff838848f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:08.470752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:08.471948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:08.472810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:08.472810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:08.472810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:08.472810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 334/678] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:08.473348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a91f5-32af-4ff1-b5ea-36ff838848f4 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:08.571407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b3faa-f4e7-4d8a-a24f-35cca29166d6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:08.588269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a91f5-32af-4ff1-b5ea-36ff838848f4 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:08.609270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dcfce-23cf-4ac3-8562-eb10a0de8c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:08.609882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dcfce-23cf-4ac3-8562-eb10a0de8c4f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:08.610166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dcfce-23cf-4ac3-8562-eb10a0de8c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:08.610434 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dcfce-23cf-4ac3-8562-eb10a0de8c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:08.611174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871dcfce-23cf-4ac3-8562-eb10a0de8c4f None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=553916344aaf40ae8abb050540f10559) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:08.611479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871dcfce-23cf-4ac3-8562-eb10a0de8c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:08.611872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:08.613069 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871dcfce-23cf-4ac3-8562-eb10a0de8c4f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:08.622908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 345/679] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:08 2022] GET /identity/v3/role_assignments?user.id=553916344aaf40ae8abb050540f10559&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:08.623804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dcfce-23cf-4ac3-8562-eb10a0de8c4f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:08.626867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:08.627777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae84f2-3a72-42fb-9347-0e988c43d74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:08.628607 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae84f2-3a72-42fb-9347-0e988c43d74c None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:08.628916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae84f2-3a72-42fb-9347-0e988c43d74c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:08.629379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae84f2-3a72-42fb-9347-0e988c43d74c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:08.630754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae84f2-3a72-42fb-9347-0e988c43d74c None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=bb3537ce04d24347b155855d2e29cd9c) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:08.631884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae84f2-3a72-42fb-9347-0e988c43d74c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:08.634685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae84f2-3a72-42fb-9347-0e988c43d74c None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:08.643073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 335/680] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:08 2022] GET /identity/v3/role_assignments?user.id=bb3537ce04d24347b155855d2e29cd9c&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:08.644300 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae84f2-3a72-42fb-9347-0e988c43d74c None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:08.815125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dcfce-23cf-4ac3-8562-eb10a0de8c4f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:08.849877 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae84f2-3a72-42fb-9347-0e988c43d74c None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:08.864872 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f758c-95d3-4287-946d-aaa58e3180fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:08.866768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f758c-95d3-4287-946d-aaa58e3180fb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:08.867466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f758c-95d3-4287-946d-aaa58e3180fb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:08.867954 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f758c-95d3-4287-946d-aaa58e3180fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:08.879412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f758c-95d3-4287-946d-aaa58e3180fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:08.882669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f758c-95d3-4287-946d-aaa58e3180fb None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-999f758c-95d3-4287-946d-aaa58e3180fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:08.900990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:08.901946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:08.902851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:08.902851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:08.902851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:08.902851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:08.902851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:08.902851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:08.902851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:08.902851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:08.902851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 346/681] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:08.903341 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f758c-95d3-4287-946d-aaa58e3180fb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:08.924591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19df02-a7f4-43e7-a131-28d57394e2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:08.925803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19df02-a7f4-43e7-a131-28d57394e2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:08.926099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19df02-a7f4-43e7-a131-28d57394e2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:08.926375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19df02-a7f4-43e7-a131-28d57394e2f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:08.943292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19df02-a7f4-43e7-a131-28d57394e2f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-5d19df02-a7f4-43e7-a131-28d57394e2f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:08.952290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:08.953285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:08.954178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:08.954178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:08.954178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:08.954178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:08.954178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:08.954178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:08.954178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:08.954178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:08.954178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:08.954178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:08.954178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:08.954178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:08.954178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 336/682] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:51:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:08.954860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19df02-a7f4-43e7-a131-28d57394e2f5 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:09.007515 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:09.020472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:09.064772 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f758c-95d3-4287-946d-aaa58e3180fb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:09.094942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19df02-a7f4-43e7-a131-28d57394e2f5 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:09.108233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b38b1-f88d-49f0-8058-d1e698ddde7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:09.108784 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b38b1-f88d-49f0-8058-d1e698ddde7f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:09.109114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b38b1-f88d-49f0-8058-d1e698ddde7f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:09.109393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b38b1-f88d-49f0-8058-d1e698ddde7f None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:09.110165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b38b1-f88d-49f0-8058-d1e698ddde7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:09.110582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b38b1-f88d-49f0-8058-d1e698ddde7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:09.112014 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b38b1-f88d-49f0-8058-d1e698ddde7f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:09.127019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 347/683] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:09.128051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b38b1-f88d-49f0-8058-d1e698ddde7f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:09.137228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b78147-4915-4b50-9b7a-5fb7804821c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:09.137855 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b78147-4915-4b50-9b7a-5fb7804821c1 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:09.138144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b78147-4915-4b50-9b7a-5fb7804821c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:09.138421 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b78147-4915-4b50-9b7a-5fb7804821c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:09.139130 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b78147-4915-4b50-9b7a-5fb7804821c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:09.139438 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b78147-4915-4b50-9b7a-5fb7804821c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:09.140911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b78147-4915-4b50-9b7a-5fb7804821c1 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:09.154380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 337/684] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:09.155311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b78147-4915-4b50-9b7a-5fb7804821c1 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:09.250196 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b38b1-f88d-49f0-8058-d1e698ddde7f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:09.281416 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b78147-4915-4b50-9b7a-5fb7804821c1 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:09.288681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:09.292784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:09.309138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808ac2b-6d74-43c1-bd99-a690a8deda0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:09.309773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808ac2b-6d74-43c1-bd99-a690a8deda0d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:09.310752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808ac2b-6d74-43c1-bd99-a690a8deda0d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:09.311029 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808ac2b-6d74-43c1-bd99-a690a8deda0d None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:09.311754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808ac2b-6d74-43c1-bd99-a690a8deda0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:09.312387 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808ac2b-6d74-43c1-bd99-a690a8deda0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:09.314185 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808ac2b-6d74-43c1-bd99-a690a8deda0d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:09.327932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 348/685] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:51:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:09.329028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808ac2b-6d74-43c1-bd99-a690a8deda0d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:09.329297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf23215-7f43-45b6-b854-afb148e99f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:09.329962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf23215-7f43-45b6-b854-afb148e99f26 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:09.330247 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf23215-7f43-45b6-b854-afb148e99f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:09.330522 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf23215-7f43-45b6-b854-afb148e99f26 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:09.342471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf23215-7f43-45b6-b854-afb148e99f26 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:09.344694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf23215-7f43-45b6-b854-afb148e99f26 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-dcf23215-7f43-45b6-b854-afb148e99f26 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:09.362933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:09.364968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:09.366314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:09.366314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:09.366314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:09.366314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:09.366314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:09.366314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:09.366314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:09.366314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:09.366314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:51:09.366314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:09.366314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 338/686] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:51:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:09.366314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf23215-7f43-45b6-b854-afb148e99f26 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:09.481213 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808ac2b-6d74-43c1-bd99-a690a8deda0d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:09.509380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf23215-7f43-45b6-b854-afb148e99f26 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:09.529137 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151f655-3667-47e4-84c1-6d6cbd9e9107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:09.529956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151f655-3667-47e4-84c1-6d6cbd9e9107 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:09.530334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151f655-3667-47e4-84c1-6d6cbd9e9107 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:09.530705 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151f655-3667-47e4-84c1-6d6cbd9e9107 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:09.531867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151f655-3667-47e4-84c1-6d6cbd9e9107 None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=ab0470979f1643a390c667efc55c4069) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:09.532289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151f655-3667-47e4-84c1-6d6cbd9e9107 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:09.534017 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151f655-3667-47e4-84c1-6d6cbd9e9107 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:09.542536 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 349/687] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:09 2022] GET /identity/v3/role_assignments?user.id=ab0470979f1643a390c667efc55c4069&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:09.543625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151f655-3667-47e4-84c1-6d6cbd9e9107 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:09.559562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2820b83-f603-4375-9102-718942f5fc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:09.560275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2820b83-f603-4375-9102-718942f5fc78 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:09.563015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2820b83-f603-4375-9102-718942f5fc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:09.563412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2820b83-f603-4375-9102-718942f5fc78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:09.593617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2820b83-f603-4375-9102-718942f5fc78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:09.595258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2820b83-f603-4375-9102-718942f5fc78 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-b2820b83-f603-4375-9102-718942f5fc78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:09.619576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:09.620761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:09.621851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:09.621851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:09.621851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:09.621851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 339/688] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:09.627635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2820b83-f603-4375-9102-718942f5fc78 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:09.664522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:09.665544 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:09.734495 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151f655-3667-47e4-84c1-6d6cbd9e9107 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:09.800860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa58cf-b357-4a94-850e-4f9ba4d9b2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:09.801784 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa58cf-b357-4a94-850e-4f9ba4d9b2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:09.801907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2820b83-f603-4375-9102-718942f5fc78 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:09.802202 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa58cf-b357-4a94-850e-4f9ba4d9b2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:09.802709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa58cf-b357-4a94-850e-4f9ba4d9b2f2 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:09.804629 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa58cf-b357-4a94-850e-4f9ba4d9b2f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:09.805172 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa58cf-b357-4a94-850e-4f9ba4d9b2f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:09.807644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa58cf-b357-4a94-850e-4f9ba4d9b2f2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:09.844527 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 350/689] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Aug 10 07:51:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:09.852835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa58cf-b357-4a94-850e-4f9ba4d9b2f2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:09.865416 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd9744-e518-48a1-bccd-86e54922b6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:09.866052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd9744-e518-48a1-bccd-86e54922b6dd None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:09.867018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd9744-e518-48a1-bccd-86e54922b6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:09.867298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd9744-e518-48a1-bccd-86e54922b6dd None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:09.868062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd9744-e518-48a1-bccd-86e54922b6dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:09.868375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd9744-e518-48a1-bccd-86e54922b6dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:09.871556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd9744-e518-48a1-bccd-86e54922b6dd None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:09.890888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 340/690] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:09.897398 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd9744-e518-48a1-bccd-86e54922b6dd None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:09.982367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa58cf-b357-4a94-850e-4f9ba4d9b2f2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:09.991171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:09.994469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:10.027020 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd9744-e518-48a1-bccd-86e54922b6dd None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:10.027264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5158c3-865d-4e81-bfbc-5b9bac34b898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:10.027694 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5158c3-865d-4e81-bfbc-5b9bac34b898 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:10.028015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5158c3-865d-4e81-bfbc-5b9bac34b898 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:10.028292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5158c3-865d-4e81-bfbc-5b9bac34b898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:10.066827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7f99c-40ee-4d0b-bb41-4fae24dd619d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:10.067477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7f99c-40ee-4d0b-bb41-4fae24dd619d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:10.067774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7f99c-40ee-4d0b-bb41-4fae24dd619d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:10.068051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7f99c-40ee-4d0b-bb41-4fae24dd619d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:10.076854 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7f99c-40ee-4d0b-bb41-4fae24dd619d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:10.078315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7f99c-40ee-4d0b-bb41-4fae24dd619d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-15a7f99c-40ee-4d0b-bb41-4fae24dd619d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:10.091193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:10.093316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:10.095169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:10.095169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:10.095169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:10.095169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:10.095169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:10.095169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:10.095169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:10.095169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:10.095169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:51:10.095169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:10.095169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 341/691] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 10 07:51:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:10.103782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7f99c-40ee-4d0b-bb41-4fae24dd619d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:10.109430 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5158c3-865d-4e81-bfbc-5b9bac34b898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:10.110937 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5158c3-865d-4e81-bfbc-5b9bac34b898 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:10.235494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 351/692] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:51:10.242604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5158c3-865d-4e81-bfbc-5b9bac34b898 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:10.251065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:10.277263 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7f99c-40ee-4d0b-bb41-4fae24dd619d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:10.335623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8827b52-453b-4806-abe5-a610faa37016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:10.336559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8827b52-453b-4806-abe5-a610faa37016 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:10.336969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8827b52-453b-4806-abe5-a610faa37016 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:10.337435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8827b52-453b-4806-abe5-a610faa37016 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:10.338649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8827b52-453b-4806-abe5-a610faa37016 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:10.339107 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8827b52-453b-4806-abe5-a610faa37016 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:10.341371 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8827b52-453b-4806-abe5-a610faa37016 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:10.357012 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:10.375072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 342/693] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 10 07:51:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:10.380512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8827b52-453b-4806-abe5-a610faa37016 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:10.422074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5158c3-865d-4e81-bfbc-5b9bac34b898 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:10.525497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70e170-0e2c-4873-a8bb-73f66b6314c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:10.526065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70e170-0e2c-4873-a8bb-73f66b6314c2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:10.526348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70e170-0e2c-4873-a8bb-73f66b6314c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:10.526620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70e170-0e2c-4873-a8bb-73f66b6314c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:10.549738 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70e170-0e2c-4873-a8bb-73f66b6314c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:10.551272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70e170-0e2c-4873-a8bb-73f66b6314c2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:10.556845 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8827b52-453b-4806-abe5-a610faa37016 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-3c70e170-0e2c-4873-a8bb-73f66b6314c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:10.585604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:10.587852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:10.589938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:10.589938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:10.589938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:10.596198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 352/694] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:10.597169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70e170-0e2c-4873-a8bb-73f66b6314c2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:10.618701 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd5f27-3630-4a5a-b396-a7448fb76e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:10.619839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd5f27-3630-4a5a-b396-a7448fb76e90 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:10.620295 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd5f27-3630-4a5a-b396-a7448fb76e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:10.620743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd5f27-3630-4a5a-b396-a7448fb76e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:10.706362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:10.715453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd5f27-3630-4a5a-b396-a7448fb76e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:10.717136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd5f27-3630-4a5a-b396-a7448fb76e90 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:10.724135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:10.835280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70e170-0e2c-4873-a8bb-73f66b6314c2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:10.847750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 343/695] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 07:51:10.852948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd5f27-3630-4a5a-b396-a7448fb76e90 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:10.933157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5bd6-c829-4a70-b8b0-ca1a79ff0bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:10.933777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5bd6-c829-4a70-b8b0-ca1a79ff0bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:10.934063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5bd6-c829-4a70-b8b0-ca1a79ff0bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:10.934336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5bd6-c829-4a70-b8b0-ca1a79ff0bc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:10.934986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc5bd6-c829-4a70-b8b0-ca1a79ff0bc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:10.935288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc5bd6-c829-4a70-b8b0-ca1a79ff0bc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:10.936693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc5bd6-c829-4a70-b8b0-ca1a79ff0bc5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:10.969946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 353/696] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:10.974715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5bd6-c829-4a70-b8b0-ca1a79ff0bc5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:11.077700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd5f27-3630-4a5a-b396-a7448fb76e90 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:11.108276 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:11.142863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62cf4-0e10-4eb5-a4d6-a75c82ffa37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:11.143994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62cf4-0e10-4eb5-a4d6-a75c82ffa37e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:11.144492 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62cf4-0e10-4eb5-a4d6-a75c82ffa37e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:11.144984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62cf4-0e10-4eb5-a4d6-a75c82ffa37e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:11.163872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce62cf4-0e10-4eb5-a4d6-a75c82ffa37e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:11.166496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce62cf4-0e10-4eb5-a4d6-a75c82ffa37e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-6ce62cf4-0e10-4eb5-a4d6-a75c82ffa37e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:11.194070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:11.195109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:11.196033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:11.196033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:11.196033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:11.201200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 344/697] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:11.202566 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62cf4-0e10-4eb5-a4d6-a75c82ffa37e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:11.219144 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5bd6-c829-4a70-b8b0-ca1a79ff0bc5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:11.256986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:11.278508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac343d7-1830-4419-813b-21c77a140864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:11.279219 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac343d7-1830-4419-813b-21c77a140864 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:11.279501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac343d7-1830-4419-813b-21c77a140864 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:11.279795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac343d7-1830-4419-813b-21c77a140864 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:11.288209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac343d7-1830-4419-813b-21c77a140864 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:11.289651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac343d7-1830-4419-813b-21c77a140864 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-1ac343d7-1830-4419-813b-21c77a140864 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:11.301529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:11.302467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:11.303473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:11.303473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:11.303473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:11.303473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:11.303473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:11.303473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:11.303473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:11.303473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:11.307800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 354/698] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:11.309221 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86111db1-2f44-4a37-b66e-83005ab8b841 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:11.309505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86111db1-2f44-4a37-b66e-83005ab8b841 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:11.309776 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86111db1-2f44-4a37-b66e-83005ab8b841 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:11.311309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 355/699] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:11.313089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29b349-6d4a-4de0-aec4-053036b6aa93 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:11.313809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29b349-6d4a-4de0-aec4-053036b6aa93 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:11.314537 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29b349-6d4a-4de0-aec4-053036b6aa93 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:11.318064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 356/700] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:11.320432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29b349-6d4a-4de0-aec4-053036b6aa93 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:11.351837 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62cf4-0e10-4eb5-a4d6-a75c82ffa37e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:11.405861 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845d9cb-b8f7-4077-b07a-b5c67f0912f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:11.406815 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845d9cb-b8f7-4077-b07a-b5c67f0912f2 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:11.407303 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845d9cb-b8f7-4077-b07a-b5c67f0912f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:11.407786 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845d9cb-b8f7-4077-b07a-b5c67f0912f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:11.408875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845d9cb-b8f7-4077-b07a-b5c67f0912f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:11.409410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845d9cb-b8f7-4077-b07a-b5c67f0912f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:11.412430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845d9cb-b8f7-4077-b07a-b5c67f0912f2 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:11.439030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 345/701] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:11.439030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7117-1155-4009-85ac-2967339bfd63 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:11.439030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7117-1155-4009-85ac-2967339bfd63 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:11.439030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7117-1155-4009-85ac-2967339bfd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:11.452905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29b349-6d4a-4de0-aec4-053036b6aa93 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:11.466771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-c75d7117-1155-4009-85ac-2967339bfd63 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:11.468820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-c75d7117-1155-4009-85ac-2967339bfd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:11.472380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:11.495831 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eff2d7-04e8-4d60-bf68-9556187f719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:11.496461 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eff2d7-04e8-4d60-bf68-9556187f719a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:11.496753 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eff2d7-04e8-4d60-bf68-9556187f719a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:11.497001 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eff2d7-04e8-4d60-bf68-9556187f719a None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:11.497698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eff2d7-04e8-4d60-bf68-9556187f719a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:11.498000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eff2d7-04e8-4d60-bf68-9556187f719a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:11.499613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eff2d7-04e8-4d60-bf68-9556187f719a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:11.513589 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 357/702] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:11.514862 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609ad6d-1443-4ad8-8b55-137e1acaba06 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:11.515152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609ad6d-1443-4ad8-8b55-137e1acaba06 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:11.515425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609ad6d-1443-4ad8-8b55-137e1acaba06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:11.536312 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5609ad6d-1443-4ad8-8b55-137e1acaba06 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:11.538101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5609ad6d-1443-4ad8-8b55-137e1acaba06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:11.567585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 346/703] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:11.569302 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7117-1155-4009-85ac-2967339bfd63 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:11.575018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:11.618611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 358/704] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:11.619404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609ad6d-1443-4ad8-8b55-137e1acaba06 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:11.698998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7117-1155-4009-85ac-2967339bfd63 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:11.738343 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af020bf8-0af5-405f-8e50-082242b88037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:11.738997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af020bf8-0af5-405f-8e50-082242b88037 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:11.739282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af020bf8-0af5-405f-8e50-082242b88037 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:11.739568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af020bf8-0af5-405f-8e50-082242b88037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:11.748338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af020bf8-0af5-405f-8e50-082242b88037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:11.749915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af020bf8-0af5-405f-8e50-082242b88037 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:11.752264 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:11.758254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609ad6d-1443-4ad8-8b55-137e1acaba06 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-af020bf8-0af5-405f-8e50-082242b88037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:11.763650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:11.764842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:11.765740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:11.765740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:11.765740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:11.765740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:11.765740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:11.765740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:11.765740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:11.765740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:11.770129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 347/705] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:11.770643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af020bf8-0af5-405f-8e50-082242b88037 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:11.805345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762da561-9fee-4362-bc82-45bf35d134fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:11.805965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762da561-9fee-4362-bc82-45bf35d134fc None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:11.806242 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762da561-9fee-4362-bc82-45bf35d134fc None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:11.806512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762da561-9fee-4362-bc82-45bf35d134fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:11.807280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762da561-9fee-4362-bc82-45bf35d134fc None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=867485ce37eb41359a8e53b2b78061f6) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:11.807584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762da561-9fee-4362-bc82-45bf35d134fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:11.809100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762da561-9fee-4362-bc82-45bf35d134fc None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:11.818630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 359/706] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:11 2022] GET /identity/v3/role_assignments?user.id=867485ce37eb41359a8e53b2b78061f6&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:11.819484 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762da561-9fee-4362-bc82-45bf35d134fc None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:11.863474 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:11.937472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af020bf8-0af5-405f-8e50-082242b88037 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:11.973565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762da561-9fee-4362-bc82-45bf35d134fc None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:11.982056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1a10d-a982-4534-9293-3e406bce36ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:11.982707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a10d-a982-4534-9293-3e406bce36ca None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:11.982991 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a10d-a982-4534-9293-3e406bce36ca None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:11.983571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a10d-a982-4534-9293-3e406bce36ca None admin] PATH_INFO: `/v3/services/network` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:11.984662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1a10d-a982-4534-9293-3e406bce36ca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:11.987429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1a10d-a982-4534-9293-3e406bce36ca None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-a0c1a10d-a982-4534-9293-3e406bce36ca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:12.000623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:12.001738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:12.002585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 348/707] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:11 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:12.003392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1a10d-a982-4534-9293-3e406bce36ca None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:12.028844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95715a-2b91-410c-86aa-4d6e141035e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:12.030134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95715a-2b91-410c-86aa-4d6e141035e1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:12.030587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95715a-2b91-410c-86aa-4d6e141035e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:12.031510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95715a-2b91-410c-86aa-4d6e141035e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:12.048947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95715a-2b91-410c-86aa-4d6e141035e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:12.051062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95715a-2b91-410c-86aa-4d6e141035e1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-ee95715a-2b91-410c-86aa-4d6e141035e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:12.070644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:12.071639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:12.072556 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:12.072556 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:12.072556 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:12.074331 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 360/708] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:12.075482 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95715a-2b91-410c-86aa-4d6e141035e1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:12.105246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:12.161932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1a10d-a982-4534-9293-3e406bce36ca None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:12.212533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:12.218413 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064093e-8c97-44e7-9726-ffb6117ae53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:12.219973 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064093e-8c97-44e7-9726-ffb6117ae53d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:12.220505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064093e-8c97-44e7-9726-ffb6117ae53d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:12.220983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064093e-8c97-44e7-9726-ffb6117ae53d None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:12.222609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064093e-8c97-44e7-9726-ffb6117ae53d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:12.223283 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064093e-8c97-44e7-9726-ffb6117ae53d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:12.225597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064093e-8c97-44e7-9726-ffb6117ae53d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:12.232929 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95715a-2b91-410c-86aa-4d6e141035e1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:12.241623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 349/709] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:12.242293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064093e-8c97-44e7-9726-ffb6117ae53d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:12.279240 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec84097-290e-4c4d-8fdd-351e2d4d3a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:12.279910 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84097-290e-4c4d-8fdd-351e2d4d3a2b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:12.280193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84097-290e-4c4d-8fdd-351e2d4d3a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:12.280464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84097-290e-4c4d-8fdd-351e2d4d3a2b None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:12.281115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec84097-290e-4c4d-8fdd-351e2d4d3a2b None admin] RBAC: Adding query filter params (name=network) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:12.281417 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec84097-290e-4c4d-8fdd-351e2d4d3a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:12.282861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec84097-290e-4c4d-8fdd-351e2d4d3a2b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:12.288275 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 361/710] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 10 07:51:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:12.289567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec159006-cc83-425d-90b7-6fb840324a27 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:12.289850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec159006-cc83-425d-90b7-6fb840324a27 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:12.290124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec159006-cc83-425d-90b7-6fb840324a27 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:12.295453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 362/711] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:12.295453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec159006-cc83-425d-90b7-6fb840324a27 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:12.371475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064093e-8c97-44e7-9726-ffb6117ae53d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:12.397973 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:12.411219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317cacb-6894-4533-957c-4fa8dff877cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:12.411885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317cacb-6894-4533-957c-4fa8dff877cf None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:12.412214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317cacb-6894-4533-957c-4fa8dff877cf None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:12.412494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317cacb-6894-4533-957c-4fa8dff877cf None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:12.413161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317cacb-6894-4533-957c-4fa8dff877cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:12.413471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317cacb-6894-4533-957c-4fa8dff877cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:12.414865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317cacb-6894-4533-957c-4fa8dff877cf None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:12.416634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec159006-cc83-425d-90b7-6fb840324a27 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:12.432772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 350/712] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:12.432772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317cacb-6894-4533-957c-4fa8dff877cf None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:12.462786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31e25d-9d91-49d7-a4d7-d777380b3508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:12.463800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31e25d-9d91-49d7-a4d7-d777380b3508 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:12.464277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31e25d-9d91-49d7-a4d7-d777380b3508 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:12.464748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31e25d-9d91-49d7-a4d7-d777380b3508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:12.466045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31e25d-9d91-49d7-a4d7-d777380b3508 None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=6c8e7a0b9eb14983ac117690e2705eb4) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:12.466597 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31e25d-9d91-49d7-a4d7-d777380b3508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:12.469201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31e25d-9d91-49d7-a4d7-d777380b3508 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:12.478879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 363/713] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:12 2022] GET /identity/v3/role_assignments?user.id=6c8e7a0b9eb14983ac117690e2705eb4&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:12.480141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4c9c9-2a56-47f8-8672-e25a7da649a7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:12.480431 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4c9c9-2a56-47f8-8672-e25a7da649a7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:12.480711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4c9c9-2a56-47f8-8672-e25a7da649a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:12.512415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-65e4c9c9-2a56-47f8-8672-e25a7da649a7 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:12.514737 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-65e4c9c9-2a56-47f8-8672-e25a7da649a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:12.532158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:12.588031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317cacb-6894-4533-957c-4fa8dff877cf None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:12.627301 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 364/714] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:12.628654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4c9c9-2a56-47f8-8672-e25a7da649a7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:12.655110 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d68bf-48c8-4fbf-a0e9-f54a3c82f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:12.656036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d68bf-48c8-4fbf-a0e9-f54a3c82f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:12.656458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d68bf-48c8-4fbf-a0e9-f54a3c82f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:12.656843 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d68bf-48c8-4fbf-a0e9-f54a3c82f6d7 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:12.657653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d68bf-48c8-4fbf-a0e9-f54a3c82f6d7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:12.658221 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d68bf-48c8-4fbf-a0e9-f54a3c82f6d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:12.659793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d68bf-48c8-4fbf-a0e9-f54a3c82f6d7 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:12.675767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 351/715] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 10 07:51:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:12.675767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d68bf-48c8-4fbf-a0e9-f54a3c82f6d7 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:12.821764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:12.920187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4c9c9-2a56-47f8-8672-e25a7da649a7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:12.960826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d68bf-48c8-4fbf-a0e9-f54a3c82f6d7 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:13.002492 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3ece8-da5a-4cf7-87e3-ebc5f4369126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:13.003143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3ece8-da5a-4cf7-87e3-ebc5f4369126 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:13.003415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3ece8-da5a-4cf7-87e3-ebc5f4369126 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:13.003690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3ece8-da5a-4cf7-87e3-ebc5f4369126 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:13.004311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3ece8-da5a-4cf7-87e3-ebc5f4369126 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:13.005744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3ece8-da5a-4cf7-87e3-ebc5f4369126 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:13.008949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd31bc-d258-4a15-a145-ee37fb6b5d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:13.010060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd31bc-d258-4a15-a145-ee37fb6b5d30 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:13.010520 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd31bc-d258-4a15-a145-ee37fb6b5d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:13.010955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd31bc-d258-4a15-a145-ee37fb6b5d30 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:13.012056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd31bc-d258-4a15-a145-ee37fb6b5d30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:13.014526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd31bc-d258-4a15-a145-ee37fb6b5d30 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-4ab3ece8-da5a-4cf7-87e3-ebc5f4369126 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:13.015993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:13.017126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:13.018348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 352/716] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Aug 10 07:51:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:13.023678 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3ece8-da5a-4cf7-87e3-ebc5f4369126 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:13.047676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:13.059152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 365/717] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:51:12 2022] POST /identity/v3/users => generated 254 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:51:13.144997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3ece8-da5a-4cf7-87e3-ebc5f4369126 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:13.158523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:13.187236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54748fa7-07b8-46a2-8528-7f87c460e87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:13.187893 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54748fa7-07b8-46a2-8528-7f87c460e87a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:13.188176 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54748fa7-07b8-46a2-8528-7f87c460e87a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:13.188452 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54748fa7-07b8-46a2-8528-7f87c460e87a None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:13.189108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54748fa7-07b8-46a2-8528-7f87c460e87a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:13.189409 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54748fa7-07b8-46a2-8528-7f87c460e87a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:13.190810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54748fa7-07b8-46a2-8528-7f87c460e87a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:13.197067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 353/718] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Aug 10 07:51:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:13.202947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd31bc-d258-4a15-a145-ee37fb6b5d30 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:13.326403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd31bc-d258-4a15-a145-ee37fb6b5d30 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:13.376078 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858b18-737d-4fee-9342-251fd501ce40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:13.376697 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858b18-737d-4fee-9342-251fd501ce40 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:13.376979 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858b18-737d-4fee-9342-251fd501ce40 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:13.377253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858b18-737d-4fee-9342-251fd501ce40 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:13.377903 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858b18-737d-4fee-9342-251fd501ce40 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:13.378206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858b18-737d-4fee-9342-251fd501ce40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:13.379581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858b18-737d-4fee-9342-251fd501ce40 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:13.386354 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 366/719] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Aug 10 07:51:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:14.850891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d054b75-07a9-428e-a6d4-04fcd947c06a None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:14.851596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d054b75-07a9-428e-a6d4-04fcd947c06a None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:14.851596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d054b75-07a9-428e-a6d4-04fcd947c06a None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:14.853055 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 354/720] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:14.858622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f24ce5-f2f3-4481-aa6f-3f353d013c51 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:14.859531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f24ce5-f2f3-4481-aa6f-3f353d013c51 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:14.860059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f24ce5-f2f3-4481-aa6f-3f353d013c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:14.888952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a5f24ce5-f2f3-4481-aa6f-3f353d013c51 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:14.890581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a5f24ce5-f2f3-4481-aa6f-3f353d013c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:14.973384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:14.994333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 367/721] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:15.017571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d054b75-07a9-428e-a6d4-04fcd947c06a None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:15.193550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d054b75-07a9-428e-a6d4-04fcd947c06a None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:15.233782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884e52-6a8c-4fe2-84a9-f71615e38dc6 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:15.234175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884e52-6a8c-4fe2-84a9-f71615e38dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:15.234315 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884e52-6a8c-4fe2-84a9-f71615e38dc6 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:15.235647 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 368/722] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:15.242477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b58dcd-f7e0-4b52-a3c7-d84eee534ca0 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:15.242970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b58dcd-f7e0-4b52-a3c7-d84eee534ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:15.243462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b58dcd-f7e0-4b52-a3c7-d84eee534ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:15.247121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff72505-0803-4061-a65e-6fe2b8e987a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:15.247816 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72505-0803-4061-a65e-6fe2b8e987a4 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:15.248102 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72505-0803-4061-a65e-6fe2b8e987a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:15.248377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72505-0803-4061-a65e-6fe2b8e987a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:15.278337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-86b58dcd-f7e0-4b52-a3c7-d84eee534ca0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:15.279614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff72505-0803-4061-a65e-6fe2b8e987a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:15.285915 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-86b58dcd-f7e0-4b52-a3c7-d84eee534ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-1ff72505-0803-4061-a65e-6fe2b8e987a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:15.296977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:15.298609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:15.300106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:15.300106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:15.300106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:15.300106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:15.300106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:15.300106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:15.300106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:15.300106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:15.300106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:15.300106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:15.300106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:15.300106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:15.310070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 355/723] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:51:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:15.316061 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff72505-0803-4061-a65e-6fe2b8e987a4 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:15.373744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:15.412265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 369/724] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:15.414865 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bead97-48b9-4402-8427-95e0184b1d46 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:15.415571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bead97-48b9-4402-8427-95e0184b1d46 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:15.416419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bead97-48b9-4402-8427-95e0184b1d46 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:15.418657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 370/725] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:15.425391 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11a2c-bdd3-423b-b0f2-34708b244272 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:15.425546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11a2c-bdd3-423b-b0f2-34708b244272 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:15.425777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11a2c-bdd3-423b-b0f2-34708b244272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:15.455850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-22d11a2c-bdd3-423b-b0f2-34708b244272 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:15.458298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-22d11a2c-bdd3-423b-b0f2-34708b244272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:15.470804 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff72505-0803-4061-a65e-6fe2b8e987a4 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:15.514643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dba4f4-f00e-4bf5-828c-5454e4334d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:15.515368 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dba4f4-f00e-4bf5-828c-5454e4334d57 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:15.515713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dba4f4-f00e-4bf5-828c-5454e4334d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:15.516105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dba4f4-f00e-4bf5-828c-5454e4334d57 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:15.516857 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dba4f4-f00e-4bf5-828c-5454e4334d57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:15.517307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dba4f4-f00e-4bf5-828c-5454e4334d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:15.518871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dba4f4-f00e-4bf5-828c-5454e4334d57 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:15.529960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 356/726] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:51:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:15.531434 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dba4f4-f00e-4bf5-828c-5454e4334d57 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:15.563907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 371/727] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:15.565068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d11a2c-bdd3-423b-b0f2-34708b244272 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:15.647138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:15.701957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dba4f4-f00e-4bf5-828c-5454e4334d57 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:15.703855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d11a2c-bdd3-423b-b0f2-34708b244272 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:15.712205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:15.749111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94bb02-9c22-4714-a7b5-ceced4ad0749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:15.749858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94bb02-9c22-4714-a7b5-ceced4ad0749 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:15.750209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94bb02-9c22-4714-a7b5-ceced4ad0749 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:15.750557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94bb02-9c22-4714-a7b5-ceced4ad0749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:15.754289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9893d-4de3-47bd-8600-a771b4400c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:15.755165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9893d-4de3-47bd-8600-a771b4400c81 None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:15.755768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9893d-4de3-47bd-8600-a771b4400c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:15.756270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9893d-4de3-47bd-8600-a771b4400c81 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:15.757113 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9893d-4de3-47bd-8600-a771b4400c81 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:15.758680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9893d-4de3-47bd-8600-a771b4400c81 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:15.763300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94bb02-9c22-4714-a7b5-ceced4ad0749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:15.764876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94bb02-9c22-4714-a7b5-ceced4ad0749 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:15.781483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 357/728] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:51:15 2022] POST /identity/v3/services => generated 240 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:51:15.783013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9893d-4de3-47bd-8600-a771b4400c81 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2e94bb02-9c22-4714-a7b5-ceced4ad0749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:15.784453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:15.785500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:15.787505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:15.787505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:15.787505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:15.787505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 372/729] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:15.792982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94bb02-9c22-4714-a7b5-ceced4ad0749 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:15.988544 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9893d-4de3-47bd-8600-a771b4400c81 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:16.034123 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94bb02-9c22-4714-a7b5-ceced4ad0749 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:16.038800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:16.040266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70392d54-e916-4949-b488-5b9fbfa0a088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:16.040946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392d54-e916-4949-b488-5b9fbfa0a088 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:16.041208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392d54-e916-4949-b488-5b9fbfa0a088 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:16.041477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392d54-e916-4949-b488-5b9fbfa0a088 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:16.060584 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70392d54-e916-4949-b488-5b9fbfa0a088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-70392d54-e916-4949-b488-5b9fbfa0a088 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:16.065835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:16.066826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:16.067681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:16.067681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:16.067681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:16.067681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:16.067681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:16.067681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:16.067681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:16.067681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:16.067681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:16.067681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:16.067681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:16.067681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:16.074432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 358/730] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:51:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:16.074432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce52a8-476c-4cdb-b12a-03f05ae019be None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:16.074432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce52a8-476c-4cdb-b12a-03f05ae019be None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:16.074432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce52a8-476c-4cdb-b12a-03f05ae019be None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:16.075362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 359/731] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:16.077962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce52a8-476c-4cdb-b12a-03f05ae019be None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:16.079661 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b1453-ffc5-47f2-be9b-35308b66cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:16.080452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b1453-ffc5-47f2-be9b-35308b66cd5c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:16.080759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b1453-ffc5-47f2-be9b-35308b66cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:16.081209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b1453-ffc5-47f2-be9b-35308b66cd5c None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:16.082036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b1453-ffc5-47f2-be9b-35308b66cd5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:16.082342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b1453-ffc5-47f2-be9b-35308b66cd5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:16.085714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b1453-ffc5-47f2-be9b-35308b66cd5c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:16.096965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:16.109943 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 373/732] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:16.111021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfbc66-2813-4599-97b7-61366f531b7c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:16.111305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfbc66-2813-4599-97b7-61366f531b7c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:16.111582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfbc66-2813-4599-97b7-61366f531b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:16.139036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-89dfbc66-2813-4599-97b7-61366f531b7c None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:16.140979 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-89dfbc66-2813-4599-97b7-61366f531b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:16.213830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce52a8-476c-4cdb-b12a-03f05ae019be None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:16.216905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 374/733] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:16 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:16.224853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfbc66-2813-4599-97b7-61366f531b7c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:16.264313 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7347df7-7d7d-4ef2-8214-c97e3ccca6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:16.265293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347df7-7d7d-4ef2-8214-c97e3ccca6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:16.265293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347df7-7d7d-4ef2-8214-c97e3ccca6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:16.265651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347df7-7d7d-4ef2-8214-c97e3ccca6b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:16.266450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7347df7-7d7d-4ef2-8214-c97e3ccca6b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:16.266758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7347df7-7d7d-4ef2-8214-c97e3ccca6b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:16.268246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7347df7-7d7d-4ef2-8214-c97e3ccca6b8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:16.283323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 360/734] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:51:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:16.283323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7347df7-7d7d-4ef2-8214-c97e3ccca6b8 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:16.357127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:16.365452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfbc66-2813-4599-97b7-61366f531b7c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:16.375638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:16.404666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7347df7-7d7d-4ef2-8214-c97e3ccca6b8 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:16.412850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125c2c6-a856-42ee-af99-526fe45dc5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:16.413841 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125c2c6-a856-42ee-af99-526fe45dc5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:16.414295 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125c2c6-a856-42ee-af99-526fe45dc5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:16.414750 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125c2c6-a856-42ee-af99-526fe45dc5d5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:16.428087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125c2c6-a856-42ee-af99-526fe45dc5d5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:16.430841 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125c2c6-a856-42ee-af99-526fe45dc5d5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:16.444286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bb147-bf2c-47da-b3ce-948dc419f7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:16.444940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bb147-bf2c-47da-b3ce-948dc419f7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:16.445216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bb147-bf2c-47da-b3ce-948dc419f7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:16.445487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bb147-bf2c-47da-b3ce-948dc419f7a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:16.458348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bb147-bf2c-47da-b3ce-948dc419f7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-323bb147-bf2c-47da-b3ce-948dc419f7a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:16.464128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:16.465238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 361/735] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:51:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:16.471617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bb147-bf2c-47da-b3ce-948dc419f7a7 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2125c2c6-a856-42ee-af99-526fe45dc5d5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:16.566572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:16.567557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:16.568614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:16.568614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:16.568614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:16.568614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:16.568614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:16.568614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:16.568614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:16.568614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:16.568614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:51:16.568614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:16.568614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 375/736] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:51:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:16.569288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f251d-20a4-4fe2-b090-86f8eab85438 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:16.569361 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f251d-20a4-4fe2-b090-86f8eab85438 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:16.570013 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f251d-20a4-4fe2-b090-86f8eab85438 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:16.575232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 376/737] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:16.575232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f251d-20a4-4fe2-b090-86f8eab85438 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:16.590048 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bb147-bf2c-47da-b3ce-948dc419f7a7 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:16.625060 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6f3bd-056b-4271-b0f9-1fa22a3f4e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:16.625706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6f3bd-056b-4271-b0f9-1fa22a3f4e3e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:16.625985 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6f3bd-056b-4271-b0f9-1fa22a3f4e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:16.626258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6f3bd-056b-4271-b0f9-1fa22a3f4e3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:16.628365 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:16.638363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6f3bd-056b-4271-b0f9-1fa22a3f4e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:16.639848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6f3bd-056b-4271-b0f9-1fa22a3f4e3e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-d1f6f3bd-056b-4271-b0f9-1fa22a3f4e3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:16.655337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:16.656357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:16.657230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:16.657230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:16.657230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:16.657230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 362/738] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:16.657466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6f3bd-056b-4271-b0f9-1fa22a3f4e3e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:16.702530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f251d-20a4-4fe2-b090-86f8eab85438 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:16.753768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2d044-8b91-43fc-960d-a24be222f89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:16.754398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2d044-8b91-43fc-960d-a24be222f89a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:16.754681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2d044-8b91-43fc-960d-a24be222f89a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:16.754965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2d044-8b91-43fc-960d-a24be222f89a None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:16.756024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2d044-8b91-43fc-960d-a24be222f89a None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:16.756349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2d044-8b91-43fc-960d-a24be222f89a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:16.757739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2d044-8b91-43fc-960d-a24be222f89a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:16.768903 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 377/739] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:51:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:16.770070 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6de3c0-a8b7-4602-9cca-2c80f3cd7e2f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:16.770426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6de3c0-a8b7-4602-9cca-2c80f3cd7e2f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:16.770714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6de3c0-a8b7-4602-9cca-2c80f3cd7e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:16.787695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6f3bd-056b-4271-b0f9-1fa22a3f4e3e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:16.796426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9c6de3c0-a8b7-4602-9cca-2c80f3cd7e2f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:16.797655 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9c6de3c0-a8b7-4602-9cca-2c80f3cd7e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:16.812399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:16.838777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257953c-12de-4aa3-81ff-e709aac1a92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:16.839462 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257953c-12de-4aa3-81ff-e709aac1a92b None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:16.839784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257953c-12de-4aa3-81ff-e709aac1a92b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:16.840066 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257953c-12de-4aa3-81ff-e709aac1a92b None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:16.840815 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257953c-12de-4aa3-81ff-e709aac1a92b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:16.841127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257953c-12de-4aa3-81ff-e709aac1a92b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:16.843777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257953c-12de-4aa3-81ff-e709aac1a92b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:16.870524 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 363/740] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Aug 10 07:51:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:16.870524 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257953c-12de-4aa3-81ff-e709aac1a92b None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:16.887440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 378/741] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:16 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:51:16.888234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6de3c0-a8b7-4602-9cca-2c80f3cd7e2f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:16.947337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:17.009429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257953c-12de-4aa3-81ff-e709aac1a92b None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:17.010682 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6de3c0-a8b7-4602-9cca-2c80f3cd7e2f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:17.048874 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e5ba-83a0-45aa-9a2d-dd6713d2e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:17.049245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33890-2502-4c7e-880c-35e63bb809b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:17.049819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33890-2502-4c7e-880c-35e63bb809b4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:17.050086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33890-2502-4c7e-880c-35e63bb809b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:17.050360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33890-2502-4c7e-880c-35e63bb809b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:17.051086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e5ba-83a0-45aa-9a2d-dd6713d2e64a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:17.051584 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e5ba-83a0-45aa-9a2d-dd6713d2e64a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:17.052099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e5ba-83a0-45aa-9a2d-dd6713d2e64a None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:17.054046 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0e5ba-83a0-45aa-9a2d-dd6713d2e64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:17.054937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0e5ba-83a0-45aa-9a2d-dd6713d2e64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:17.056595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0e5ba-83a0-45aa-9a2d-dd6713d2e64a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:17.062863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f33890-2502-4c7e-880c-35e63bb809b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:17.064412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f33890-2502-4c7e-880c-35e63bb809b4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:17.075292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 364/742] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:17.075292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e5ba-83a0-45aa-9a2d-dd6713d2e64a None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:17.075644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c1f33890-2502-4c7e-880c-35e63bb809b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:17.084541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:17.085548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:17.086456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:17.086456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:17.086456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:17.086456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 379/743] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:17.086456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33890-2502-4c7e-880c-35e63bb809b4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:17.208901 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e5ba-83a0-45aa-9a2d-dd6713d2e64a None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:17.213001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:17.215790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33890-2502-4c7e-880c-35e63bb809b4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:17.252800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8fa09-918c-440c-aa66-805aba87dba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:17.253953 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8fa09-918c-440c-aa66-805aba87dba7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:17.254236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8fa09-918c-440c-aa66-805aba87dba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:17.254594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8fa09-918c-440c-aa66-805aba87dba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:17.257533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bae3c-6dc3-4265-97c1-381e9c70a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:17.258150 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bae3c-6dc3-4265-97c1-381e9c70a331 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:17.258429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bae3c-6dc3-4265-97c1-381e9c70a331 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:17.258701 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bae3c-6dc3-4265-97c1-381e9c70a331 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:17.259347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bae3c-6dc3-4265-97c1-381e9c70a331 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:17.260824 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bae3c-6dc3-4265-97c1-381e9c70a331 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:17.278620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 380/744] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:51:17 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:51:17.288784 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bae3c-6dc3-4265-97c1-381e9c70a331 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:17.349105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8fa09-918c-440c-aa66-805aba87dba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:17.352894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8fa09-918c-440c-aa66-805aba87dba7 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:17.392007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:17.473907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bae3c-6dc3-4265-97c1-381e9c70a331 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:17.488440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 365/745] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:17 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:51:17.489200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8fa09-918c-440c-aa66-805aba87dba7 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:17.496222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:17.530848 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c48ed-354c-4159-b7c4-df731ff35e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:17.531839 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c48ed-354c-4159-b7c4-df731ff35e5f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:17.532194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c48ed-354c-4159-b7c4-df731ff35e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:17.532464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c48ed-354c-4159-b7c4-df731ff35e5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:17.546920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c48ed-354c-4159-b7c4-df731ff35e5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:17.548418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c48ed-354c-4159-b7c4-df731ff35e5f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-0a5c48ed-354c-4159-b7c4-df731ff35e5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:17.564632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:17.565798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:17.566815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:17.566815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:17.566815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:17.566815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:17.566815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:17.566815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:17.566815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:17.566815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:17.566815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:51:17.566815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:17.566815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 381/746] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 10 07:51:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:17.567382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c48ed-354c-4159-b7c4-df731ff35e5f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:17.648753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8fa09-918c-440c-aa66-805aba87dba7 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:17.704509 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c48ed-354c-4159-b7c4-df731ff35e5f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:17.708929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f5146-67e8-47a8-8e34-763fdb5d1a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:17.710042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f5146-67e8-47a8-8e34-763fdb5d1a98 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:17.710555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f5146-67e8-47a8-8e34-763fdb5d1a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:17.711053 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f5146-67e8-47a8-8e34-763fdb5d1a98 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:17.712298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f5146-67e8-47a8-8e34-763fdb5d1a98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:17.712846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f5146-67e8-47a8-8e34-763fdb5d1a98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:17.715463 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f5146-67e8-47a8-8e34-763fdb5d1a98 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:17.724498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:17.736712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 366/747] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:17.737897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f5146-67e8-47a8-8e34-763fdb5d1a98 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:17.767460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38a4e8-280d-4a99-a092-1076ad57a01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:17.768177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a4e8-280d-4a99-a092-1076ad57a01a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:17.768463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a4e8-280d-4a99-a092-1076ad57a01a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:17.768737 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a4e8-280d-4a99-a092-1076ad57a01a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:17.780989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38a4e8-280d-4a99-a092-1076ad57a01a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:17.782476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38a4e8-280d-4a99-a092-1076ad57a01a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-4f38a4e8-280d-4a99-a092-1076ad57a01a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:17.798658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:17.799641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:17.800554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:17.800554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:17.800554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:17.800554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 382/748] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:17.801211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38a4e8-280d-4a99-a092-1076ad57a01a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:17.824717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:17.878090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f5146-67e8-47a8-8e34-763fdb5d1a98 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:17.923560 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245e769-f8dc-49f9-b894-383c078e3f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:17.924364 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245e769-f8dc-49f9-b894-383c078e3f4c None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:17.924991 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245e769-f8dc-49f9-b894-383c078e3f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:17.925368 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245e769-f8dc-49f9-b894-383c078e3f4c None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:17.926694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245e769-f8dc-49f9-b894-383c078e3f4c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:17.927318 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245e769-f8dc-49f9-b894-383c078e3f4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:17.929992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245e769-f8dc-49f9-b894-383c078e3f4c None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:17.937810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38a4e8-280d-4a99-a092-1076ad57a01a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:17.963800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 367/749] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 10 07:51:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:17.963800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245e769-f8dc-49f9-b894-383c078e3f4c None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:18.015771 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd55a4-c308-460e-9d13-aa823594e37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:18.017123 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd55a4-c308-460e-9d13-aa823594e37f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:18.017626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd55a4-c308-460e-9d13-aa823594e37f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:18.018118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd55a4-c308-460e-9d13-aa823594e37f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:18.038751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd55a4-c308-460e-9d13-aa823594e37f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:18.040647 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd55a4-c308-460e-9d13-aa823594e37f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c5dd55a4-c308-460e-9d13-aa823594e37f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:18.057957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:18.059378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:18.060344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:18.060344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:18.060344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:18.060344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:18.060344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:18.060344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:18.060344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:18.060344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:18.060344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:51:18.060344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:18.063984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 383/750] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Aug 10 07:51:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:18.065335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd55a4-c308-460e-9d13-aa823594e37f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:18.101403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:18.117872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245e769-f8dc-49f9-b894-383c078e3f4c None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:18.150379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:18.166997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edb159-c337-4691-b730-27f8865c3c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:18.167654 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edb159-c337-4691-b730-27f8865c3c47 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:18.168177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edb159-c337-4691-b730-27f8865c3c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:18.168458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edb159-c337-4691-b730-27f8865c3c47 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:18.169475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edb159-c337-4691-b730-27f8865c3c47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:18.169475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edb159-c337-4691-b730-27f8865c3c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:18.170807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edb159-c337-4691-b730-27f8865c3c47 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:18.183214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 368/751] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:18.183915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edb159-c337-4691-b730-27f8865c3c47 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:18.199393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd55a4-c308-460e-9d13-aa823594e37f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:18.237250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80259aba-29cc-486c-883a-e9409c5ab065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:18.237473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80259aba-29cc-486c-883a-e9409c5ab065 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:18.237781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80259aba-29cc-486c-883a-e9409c5ab065 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:18.238059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80259aba-29cc-486c-883a-e9409c5ab065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:18.249629 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80259aba-29cc-486c-883a-e9409c5ab065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:18.251572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80259aba-29cc-486c-883a-e9409c5ab065 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-80259aba-29cc-486c-883a-e9409c5ab065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:18.268149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:18.270206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:18.281490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:18.281490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:18.281490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:18.281490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 384/752] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:18.281490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b06b59-f1a8-4cf9-b742-9ad09a438e3f None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:18.281490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b06b59-f1a8-4cf9-b742-9ad09a438e3f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:18.281490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b06b59-f1a8-4cf9-b742-9ad09a438e3f None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:18.281490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 385/753] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:18.281490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b06b59-f1a8-4cf9-b742-9ad09a438e3f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:18.338770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edb159-c337-4691-b730-27f8865c3c47 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:18.362752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:18.376314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22d216-91ec-4a9f-9d79-8232bd311695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:18.376931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22d216-91ec-4a9f-9d79-8232bd311695 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:18.377217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22d216-91ec-4a9f-9d79-8232bd311695 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:18.377495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22d216-91ec-4a9f-9d79-8232bd311695 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:18.378242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22d216-91ec-4a9f-9d79-8232bd311695 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:18.378554 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22d216-91ec-4a9f-9d79-8232bd311695 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:18.380007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22d216-91ec-4a9f-9d79-8232bd311695 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:18.398072 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b06b59-f1a8-4cf9-b742-9ad09a438e3f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:18.401114 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 369/754] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Aug 10 07:51:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:18.402197 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c8d9-0e89-4a7a-ad9a-824e662e9d74 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:18.402487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c8d9-0e89-4a7a-ad9a-824e662e9d74 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:18.402765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c8d9-0e89-4a7a-ad9a-824e662e9d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:18.423418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-cf03c8d9-0e89-4a7a-ad9a-824e662e9d74 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:18.425301 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-cf03c8d9-0e89-4a7a-ad9a-824e662e9d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:18.438139 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ce339-7137-4903-93a5-d31d54c54c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:18.438778 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce339-7137-4903-93a5-d31d54c54c52 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:18.439063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce339-7137-4903-93a5-d31d54c54c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:18.439337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce339-7137-4903-93a5-d31d54c54c52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:18.447825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ce339-7137-4903-93a5-d31d54c54c52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:18.449293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ce339-7137-4903-93a5-d31d54c54c52 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-a39ce339-7137-4903-93a5-d31d54c54c52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:18.461592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:18.462691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:18.463559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:18.463559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:18.463559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:18.463559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:18.463559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:18.463559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:18.463559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:18.463559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:18.463559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 386/755] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:18.463559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ce339-7137-4903-93a5-d31d54c54c52 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:18.477845 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:18.534624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 370/756] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:18.535955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03c8d9-0e89-4a7a-ad9a-824e662e9d74 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:18.610407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ce339-7137-4903-93a5-d31d54c54c52 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:18.652807 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd6815-f696-4c9e-a12a-031d02d7b438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:18.653424 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd6815-f696-4c9e-a12a-031d02d7b438 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:18.654250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd6815-f696-4c9e-a12a-031d02d7b438 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:18.654534 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd6815-f696-4c9e-a12a-031d02d7b438 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:18.655294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd6815-f696-4c9e-a12a-031d02d7b438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:18.655603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd6815-f696-4c9e-a12a-031d02d7b438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:18.657432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd6815-f696-4c9e-a12a-031d02d7b438 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:18.666113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:18.671575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 387/757] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:18.672603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd6815-f696-4c9e-a12a-031d02d7b438 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:18.696729 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03c8d9-0e89-4a7a-ad9a-824e662e9d74 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:18.740562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0bf3f-c833-4903-84d4-8ba1b6fe2104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:18.741213 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0bf3f-c833-4903-84d4-8ba1b6fe2104 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:18.741502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0bf3f-c833-4903-84d4-8ba1b6fe2104 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:18.741778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0bf3f-c833-4903-84d4-8ba1b6fe2104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:18.783857 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd6815-f696-4c9e-a12a-031d02d7b438 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:18.797487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:18.826738 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d7edf-b1f0-408a-8757-222b7606fb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:18.827356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d7edf-b1f0-408a-8757-222b7606fb20 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:18.827642 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d7edf-b1f0-408a-8757-222b7606fb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:18.827956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d7edf-b1f0-408a-8757-222b7606fb20 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:18.828658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d7edf-b1f0-408a-8757-222b7606fb20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:18.828968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d7edf-b1f0-408a-8757-222b7606fb20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:18.830408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d7edf-b1f0-408a-8757-222b7606fb20 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:18.838723 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0bf3f-c833-4903-84d4-8ba1b6fe2104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:18.840484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0bf3f-c833-4903-84d4-8ba1b6fe2104 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:18.844265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 388/758] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:18.845379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d7edf-b1f0-408a-8757-222b7606fb20 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:18.919306 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:18.971503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d7edf-b1f0-408a-8757-222b7606fb20 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:18.984843 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 371/759] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:51:18.984843 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0bf3f-c833-4903-84d4-8ba1b6fe2104 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:19.027283 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b416cf-3301-42b1-8346-c257c1048ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:19.028145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b416cf-3301-42b1-8346-c257c1048ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:19.028573 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b416cf-3301-42b1-8346-c257c1048ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:19.028957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b416cf-3301-42b1-8346-c257c1048ba5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:19.029666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b416cf-3301-42b1-8346-c257c1048ba5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:19.031516 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b416cf-3301-42b1-8346-c257c1048ba5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-41b416cf-3301-42b1-8346-c257c1048ba5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:19.046198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:19.047224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:19.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 389/760] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:18 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:19.049629 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b416cf-3301-42b1-8346-c257c1048ba5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:19.076255 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:19.111284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0bf3f-c833-4903-84d4-8ba1b6fe2104 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:19.153518 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae0ceb-f97e-45b2-bb5b-6716b6e83c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:19.154158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0ceb-f97e-45b2-bb5b-6716b6e83c41 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:19.154554 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0ceb-f97e-45b2-bb5b-6716b6e83c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:19.154818 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0ceb-f97e-45b2-bb5b-6716b6e83c41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:19.162145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae0ceb-f97e-45b2-bb5b-6716b6e83c41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:19.163605 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae0ceb-f97e-45b2-bb5b-6716b6e83c41 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:19.165354 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b416cf-3301-42b1-8346-c257c1048ba5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-fcae0ceb-f97e-45b2-bb5b-6716b6e83c41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:19.176423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:19.177948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:19.179139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:19.179139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:19.179139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:19.179139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:19.179139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:19.179139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:19.179139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:19.179139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:19.179139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 372/761] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:19.180548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae0ceb-f97e-45b2-bb5b-6716b6e83c41 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:19.197872 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:19.212960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06c59f-12f0-4abd-a6a6-d21724d28e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:19.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06c59f-12f0-4abd-a6a6-d21724d28e8f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:19.213913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06c59f-12f0-4abd-a6a6-d21724d28e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:19.214138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06c59f-12f0-4abd-a6a6-d21724d28e8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:19.214841 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06c59f-12f0-4abd-a6a6-d21724d28e8f None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=867485ce37eb41359a8e53b2b78061f6) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:19.215140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06c59f-12f0-4abd-a6a6-d21724d28e8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:19.216600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06c59f-12f0-4abd-a6a6-d21724d28e8f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:19.226614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 390/762] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:19 2022] GET /identity/v3/role_assignments?user.id=867485ce37eb41359a8e53b2b78061f6&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:19.227530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06c59f-12f0-4abd-a6a6-d21724d28e8f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:19.370006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae0ceb-f97e-45b2-bb5b-6716b6e83c41 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:19.377060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06c59f-12f0-4abd-a6a6-d21724d28e8f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:19.414534 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:19.426665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adeabb6-ce82-41f5-8970-9129a084f922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:19.428086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeabb6-ce82-41f5-8970-9129a084f922 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:19.428981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeabb6-ce82-41f5-8970-9129a084f922 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:19.429545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeabb6-ce82-41f5-8970-9129a084f922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:19.429696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6408a12-cc39-4c6c-ba9e-83a38d7b7b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:19.430368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408a12-cc39-4c6c-ba9e-83a38d7b7b3a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:19.430973 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408a12-cc39-4c6c-ba9e-83a38d7b7b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:19.431358 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408a12-cc39-4c6c-ba9e-83a38d7b7b3a None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:19.432161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6408a12-cc39-4c6c-ba9e-83a38d7b7b3a None admin] RBAC: Adding query filter params (name=network) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:19.432582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6408a12-cc39-4c6c-ba9e-83a38d7b7b3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:19.434386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6408a12-cc39-4c6c-ba9e-83a38d7b7b3a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:19.448108 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 391/763] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 10 07:51:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:19.449022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6408a12-cc39-4c6c-ba9e-83a38d7b7b3a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:19.455497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adeabb6-ce82-41f5-8970-9129a084f922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:19.457808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adeabb6-ce82-41f5-8970-9129a084f922 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-7adeabb6-ce82-41f5-8970-9129a084f922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:19.475135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:19.476330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:19.477435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:19.477435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:19.477435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:19.477435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 373/764] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:19.477435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc9187-f555-4621-9cf9-70c48f440bb6 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:19.477774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc9187-f555-4621-9cf9-70c48f440bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:19.477980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc9187-f555-4621-9cf9-70c48f440bb6 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:19.479241 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 374/765] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:19.480040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc9187-f555-4621-9cf9-70c48f440bb6 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:19.515603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:19.586349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6408a12-cc39-4c6c-ba9e-83a38d7b7b3a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:19.622935 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc9187-f555-4621-9cf9-70c48f440bb6 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:19.644212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d5aab-cd2a-44c9-9d52-58522c1e2ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:19.645182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d5aab-cd2a-44c9-9d52-58522c1e2ace None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:19.645760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d5aab-cd2a-44c9-9d52-58522c1e2ace None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:19.646282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d5aab-cd2a-44c9-9d52-58522c1e2ace None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:19.647478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d5aab-cd2a-44c9-9d52-58522c1e2ace None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:19.648019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d5aab-cd2a-44c9-9d52-58522c1e2ace None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:19.652867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d5aab-cd2a-44c9-9d52-58522c1e2ace None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:19.676513 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 392/766] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:19.678521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d5aab-cd2a-44c9-9d52-58522c1e2ace None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:19.689315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a18364-62f2-42d8-bf0c-474e4489a3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:19.690025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a18364-62f2-42d8-bf0c-474e4489a3af None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:19.690374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a18364-62f2-42d8-bf0c-474e4489a3af None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:19.690725 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a18364-62f2-42d8-bf0c-474e4489a3af None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:19.691445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a18364-62f2-42d8-bf0c-474e4489a3af None admin] RBAC: Adding query filter params (type=network) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:19.691851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a18364-62f2-42d8-bf0c-474e4489a3af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:19.693868 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a18364-62f2-42d8-bf0c-474e4489a3af None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:19.702210 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 375/767] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 10 07:51:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:19.704774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926a31-0b2e-4f05-9059-0c0dea19db3b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:19.705264 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926a31-0b2e-4f05-9059-0c0dea19db3b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:19.705739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926a31-0b2e-4f05-9059-0c0dea19db3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:19.742567 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-2b926a31-0b2e-4f05-9059-0c0dea19db3b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:19.743946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2b926a31-0b2e-4f05-9059-0c0dea19db3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:19.805407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:19.834173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d5aab-cd2a-44c9-9d52-58522c1e2ace None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:19.838901 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 376/768] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:19.840018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b926a31-0b2e-4f05-9059-0c0dea19db3b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:19.861938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:19.871787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5d7f1-3ef3-4080-a2bf-0c152db62727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:19.872618 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5d7f1-3ef3-4080-a2bf-0c152db62727 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:19.872896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5d7f1-3ef3-4080-a2bf-0c152db62727 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:19.873221 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5d7f1-3ef3-4080-a2bf-0c152db62727 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:19.873946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5d7f1-3ef3-4080-a2bf-0c152db62727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:19.874247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5d7f1-3ef3-4080-a2bf-0c152db62727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:19.875644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5d7f1-3ef3-4080-a2bf-0c152db62727 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:19.892347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 393/769] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:19.892347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5d7f1-3ef3-4080-a2bf-0c152db62727 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:19.965918 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b926a31-0b2e-4f05-9059-0c0dea19db3b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:20.013287 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaa1d9-635b-4739-8bf9-4995f3103799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:20.014070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa1d9-635b-4739-8bf9-4995f3103799 None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:20.014407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa1d9-635b-4739-8bf9-4995f3103799 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:20.014752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa1d9-635b-4739-8bf9-4995f3103799 None admin] PATH_INFO: `/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/6c8e7a0b9eb14983ac117690e2705eb4/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:20.016775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaa1d9-635b-4739-8bf9-4995f3103799 None admin] RBAC: Authorizing `identity:create_grant(project_id=bad7eba8964f4acf9c6c1397df7cd1dd, user_id=6c8e7a0b9eb14983ac117690e2705eb4, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:20.018437 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaa1d9-635b-4739-8bf9-4995f3103799 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:20.028060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5d7f1-3ef3-4080-a2bf-0c152db62727 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:20.039881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 377/770] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:51:19 2022] PUT /identity/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/6c8e7a0b9eb14983ac117690e2705eb4/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:51:20.045602 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaa1d9-635b-4739-8bf9-4995f3103799 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:20.090928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1eef7-c6f6-40b2-838c-15332079d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:20.091768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1eef7-c6f6-40b2-838c-15332079d67d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:20.092106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1eef7-c6f6-40b2-838c-15332079d67d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:20.092440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1eef7-c6f6-40b2-838c-15332079d67d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:20.093240 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1eef7-c6f6-40b2-838c-15332079d67d None admin] RBAC: Adding query filter params (interface=public, service_id=efc2d161858f432f88921cf5803f9521, region_id=RegionOne) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:20.093556 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1eef7-c6f6-40b2-838c-15332079d67d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:20.095028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1eef7-c6f6-40b2-838c-15332079d67d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:20.107716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 394/771] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 10 07:51:19 2022] GET /identity/v3/endpoints?service_id=efc2d161858f432f88921cf5803f9521&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:20.109689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1eef7-c6f6-40b2-838c-15332079d67d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:20.122176 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:20.171448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:20.248936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaa1d9-635b-4739-8bf9-4995f3103799 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:20.268760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1eef7-c6f6-40b2-838c-15332079d67d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:20.289948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb00a00-1998-421f-863d-5ad4a8ee0ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:20.290722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb00a00-1998-421f-863d-5ad4a8ee0ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:20.290996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb00a00-1998-421f-863d-5ad4a8ee0ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:20.291279 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb00a00-1998-421f-863d-5ad4a8ee0ac5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:20.291913 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb00a00-1998-421f-863d-5ad4a8ee0ac5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:20.293866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb00a00-1998-421f-863d-5ad4a8ee0ac5 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-bcb00a00-1998-421f-863d-5ad4a8ee0ac5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:20.303981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:20.305875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:20.308136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 378/772] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Aug 10 07:51:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:20.310380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb00a00-1998-421f-863d-5ad4a8ee0ac5 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:20.338068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df36c4-ac10-4518-a513-512e445a6e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:20.339715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df36c4-ac10-4518-a513-512e445a6e57 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:20.340497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df36c4-ac10-4518-a513-512e445a6e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:20.341165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df36c4-ac10-4518-a513-512e445a6e57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:20.352362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df36c4-ac10-4518-a513-512e445a6e57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:20.354318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df36c4-ac10-4518-a513-512e445a6e57 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e0df36c4-ac10-4518-a513-512e445a6e57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:20.368367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:20.369557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:20.370543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:20.370543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:20.370543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:20.370543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:20.370543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:20.370543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:20.370543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:20.370543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:20.374165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 395/773] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:20.380050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df36c4-ac10-4518-a513-512e445a6e57 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:20.455383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:20.462377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb00a00-1998-421f-863d-5ad4a8ee0ac5 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:20.527464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b7a9a-c857-4adc-946a-b82324a1dcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:20.528172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b7a9a-c857-4adc-946a-b82324a1dcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:20.528482 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b7a9a-c857-4adc-946a-b82324a1dcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:20.528764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b7a9a-c857-4adc-946a-b82324a1dcd3 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:20.529391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b7a9a-c857-4adc-946a-b82324a1dcd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:20.531052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b7a9a-c857-4adc-946a-b82324a1dcd3 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:20.538620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 379/774] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 10 07:51:20 2022] GET /identity/v3/services => generated 772 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:20.539542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b7a9a-c857-4adc-946a-b82324a1dcd3 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:20.560128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:20.577737 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df36c4-ac10-4518-a513-512e445a6e57 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:20.657489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d4ce5-e7ea-47fa-9974-176095bc26ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:20.658307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4ce5-e7ea-47fa-9974-176095bc26ab None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:20.658865 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4ce5-e7ea-47fa-9974-176095bc26ab None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:20.661934 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4ce5-e7ea-47fa-9974-176095bc26ab None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:20.662754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d4ce5-e7ea-47fa-9974-176095bc26ab None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:20.663227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d4ce5-e7ea-47fa-9974-176095bc26ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:20.664846 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d4ce5-e7ea-47fa-9974-176095bc26ab None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:20.685409 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 396/775] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Aug 10 07:51:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:20.687079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d4ce5-e7ea-47fa-9974-176095bc26ab None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:20.736739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b7a9a-c857-4adc-946a-b82324a1dcd3 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:20.778344 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588bd6a-2c91-4115-a757-15a470933d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:20.779016 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588bd6a-2c91-4115-a757-15a470933d1c None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:20.779306 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588bd6a-2c91-4115-a757-15a470933d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:20.779582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588bd6a-2c91-4115-a757-15a470933d1c None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:20.780318 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588bd6a-2c91-4115-a757-15a470933d1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:20.780623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588bd6a-2c91-4115-a757-15a470933d1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:20.782176 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588bd6a-2c91-4115-a757-15a470933d1c None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:20.797140 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 380/776] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:20.803942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588bd6a-2c91-4115-a757-15a470933d1c None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:20.821077 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d4ce5-e7ea-47fa-9974-176095bc26ab None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:20.840167 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:20.870390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086aba03-ef7b-468b-9d1a-e8c18d374e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:20.871210 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aba03-ef7b-468b-9d1a-e8c18d374e6c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:20.871566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aba03-ef7b-468b-9d1a-e8c18d374e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:20.871947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aba03-ef7b-468b-9d1a-e8c18d374e6c None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:20.872685 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086aba03-ef7b-468b-9d1a-e8c18d374e6c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:20.873058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086aba03-ef7b-468b-9d1a-e8c18d374e6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:20.874644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086aba03-ef7b-468b-9d1a-e8c18d374e6c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:20.887045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 397/777] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Aug 10 07:51:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:20.888576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086aba03-ef7b-468b-9d1a-e8c18d374e6c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:20.932761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588bd6a-2c91-4115-a757-15a470933d1c None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:20.936453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:20.981374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3140c-8a5f-4438-a4ae-2c164ec3c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:20.982095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3140c-8a5f-4438-a4ae-2c164ec3c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:20.982449 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3140c-8a5f-4438-a4ae-2c164ec3c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:20.982796 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3140c-8a5f-4438-a4ae-2c164ec3c6c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:20.983616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3140c-8a5f-4438-a4ae-2c164ec3c6c7 None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=15690a9236a74f518837f7d47d9797b1) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:20.984024 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3140c-8a5f-4438-a4ae-2c164ec3c6c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:20.991862 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3140c-8a5f-4438-a4ae-2c164ec3c6c7 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:20.993512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 381/778] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:20 2022] GET /identity/v3/role_assignments?user.id=15690a9236a74f518837f7d47d9797b1&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:21.106250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086aba03-ef7b-468b-9d1a-e8c18d374e6c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:21.162769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715af8bf-c24a-4edb-a5ef-e41d7f68ad80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:21.163645 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715af8bf-c24a-4edb-a5ef-e41d7f68ad80 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:21.164125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715af8bf-c24a-4edb-a5ef-e41d7f68ad80 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:21.164561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715af8bf-c24a-4edb-a5ef-e41d7f68ad80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:21.165568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715af8bf-c24a-4edb-a5ef-e41d7f68ad80 None admin] RBAC: Adding query filter params (interface=public, service_id=e1b7194548ce4d5792d581d5ebbcea7f, region_id=RegionOne) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:21.166072 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715af8bf-c24a-4edb-a5ef-e41d7f68ad80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:21.167590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715af8bf-c24a-4edb-a5ef-e41d7f68ad80 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:21.176465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 398/779] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 10 07:51:20 2022] GET /identity/v3/endpoints?service_id=e1b7194548ce4d5792d581d5ebbcea7f&interface=public®ion_id=RegionOne => generated 194 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:21.183546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3140c-8a5f-4438-a4ae-2c164ec3c6c7 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:21.324294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:21.337077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3140c-8a5f-4438-a4ae-2c164ec3c6c7 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:21.373748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda46b06-7515-407b-88d1-b3923570d45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:21.374368 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda46b06-7515-407b-88d1-b3923570d45d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:21.374650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda46b06-7515-407b-88d1-b3923570d45d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:21.374925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda46b06-7515-407b-88d1-b3923570d45d None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:21.375540 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda46b06-7515-407b-88d1-b3923570d45d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:21.377011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda46b06-7515-407b-88d1-b3923570d45d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:21.383515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 382/780] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 10 07:51:21 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:21.712486 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a81e4-d5c8-461b-92d1-cc7e41aa07fe None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:21.713101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a81e4-d5c8-461b-92d1-cc7e41aa07fe None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:21.713636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a81e4-d5c8-461b-92d1-cc7e41aa07fe None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:21.715511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 399/781] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:21.720736 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e784-316b-4ee4-b0e5-df2820f54eb9 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:21.721031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e784-316b-4ee4-b0e5-df2820f54eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:21.721310 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e784-316b-4ee4-b0e5-df2820f54eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:21.740367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e703e784-316b-4ee4-b0e5-df2820f54eb9 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:21.741580 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e703e784-316b-4ee4-b0e5-df2820f54eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:21.836746 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 383/782] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:51:21.874150 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a81e4-d5c8-461b-92d1-cc7e41aa07fe None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:21.975355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:21.992178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a81e4-d5c8-461b-92d1-cc7e41aa07fe None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:22.029501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627accc-f6a2-4fe6-a8b5-5ba73e624e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:22.030157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627accc-f6a2-4fe6-a8b5-5ba73e624e3d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:22.030442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627accc-f6a2-4fe6-a8b5-5ba73e624e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:22.030717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627accc-f6a2-4fe6-a8b5-5ba73e624e3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:22.042689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627accc-f6a2-4fe6-a8b5-5ba73e624e3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2627accc-f6a2-4fe6-a8b5-5ba73e624e3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:22.047490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:22.048455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:22.049264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:22.049264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:22.049264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:22.049264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:22.049264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:22.049264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:22.049264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:22.049264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:22.049264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:22.049264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:22.049264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:22.049264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:22.049264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 400/783] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:51:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:22.055278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703e784-316b-4ee4-b0e5-df2820f54eb9 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:22.170708 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:22.194385 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703e784-316b-4ee4-b0e5-df2820f54eb9 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:22.241247 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e24a6-5a90-4d5b-8c53-3a53dada9ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:22.241787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e24a6-5a90-4d5b-8c53-3a53dada9ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:22.242071 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e24a6-5a90-4d5b-8c53-3a53dada9ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:22.242346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e24a6-5a90-4d5b-8c53-3a53dada9ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:22.243030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e24a6-5a90-4d5b-8c53-3a53dada9ec3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:22.243333 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e24a6-5a90-4d5b-8c53-3a53dada9ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:22.244777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e24a6-5a90-4d5b-8c53-3a53dada9ec3 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:22.257369 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 384/784] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:51:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:22.262789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627accc-f6a2-4fe6-a8b5-5ba73e624e3d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:22.378640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a71a84-80a9-420f-8f85-4f8ecb0e023f None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:22.379151 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a71a84-80a9-420f-8f85-4f8ecb0e023f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:22.379225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a71a84-80a9-420f-8f85-4f8ecb0e023f None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:22.380866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 385/785] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:22.391758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8be71-6e80-49b3-baad-370d28ac9092 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:22.392052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8be71-6e80-49b3-baad-370d28ac9092 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:22.392319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8be71-6e80-49b3-baad-370d28ac9092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:22.412432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627accc-f6a2-4fe6-a8b5-5ba73e624e3d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:22.417996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-05d8be71-6e80-49b3-baad-370d28ac9092 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:22.424166 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-05d8be71-6e80-49b3-baad-370d28ac9092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:22.485595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bda86-7c2a-409e-8ced-621c9eb9a51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:22.487142 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bda86-7c2a-409e-8ced-621c9eb9a51d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:22.487421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bda86-7c2a-409e-8ced-621c9eb9a51d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:22.487693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bda86-7c2a-409e-8ced-621c9eb9a51d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:22.509745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bda86-7c2a-409e-8ced-621c9eb9a51d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:22.512624 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bda86-7c2a-409e-8ced-621c9eb9a51d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:22.526305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-942bda86-7c2a-409e-8ced-621c9eb9a51d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:22.544615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:22.545620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:22.546506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:22.546506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:22.546506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:22.548161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 401/786] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:22.559965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bda86-7c2a-409e-8ced-621c9eb9a51d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:22.560477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 386/787] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:22.601314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8be71-6e80-49b3-baad-370d28ac9092 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:22.754566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bda86-7c2a-409e-8ced-621c9eb9a51d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:22.759308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:22.791864 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8be71-6e80-49b3-baad-370d28ac9092 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:22.833587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdad77-81d0-401e-b4a4-779b437c6e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:22.834372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdad77-81d0-401e-b4a4-779b437c6e73 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:22.834660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdad77-81d0-401e-b4a4-779b437c6e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:22.834935 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdad77-81d0-401e-b4a4-779b437c6e73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:22.847655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdad77-81d0-401e-b4a4-779b437c6e73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-8ebdad77-81d0-401e-b4a4-779b437c6e73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:22.853085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:22.854372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:22.855379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:22.855379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:22.855379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:22.855379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:22.855379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:22.855379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:22.855379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:22.855379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:22.855379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:22.855379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:22.855379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:22.855379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:22.855379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 387/788] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:51:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:22.859996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925dc7b-c534-4225-83be-204b51548fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:22.861187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925dc7b-c534-4225-83be-204b51548fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:22.861787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925dc7b-c534-4225-83be-204b51548fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:22.863550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdad77-81d0-401e-b4a4-779b437c6e73 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:22.865823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925dc7b-c534-4225-83be-204b51548fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:22.867076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925dc7b-c534-4225-83be-204b51548fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:22.867627 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925dc7b-c534-4225-83be-204b51548fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:22.870056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925dc7b-c534-4225-83be-204b51548fc4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:22.897886 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 402/789] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:22.903350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925dc7b-c534-4225-83be-204b51548fc4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:23.030401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:23.084188 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdad77-81d0-401e-b4a4-779b437c6e73 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:23.111201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925dc7b-c534-4225-83be-204b51548fc4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:23.160613 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a205f9-7810-45eb-8d25-857dbe273dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:23.161233 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a205f9-7810-45eb-8d25-857dbe273dfa None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:23.161516 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a205f9-7810-45eb-8d25-857dbe273dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:23.162317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a205f9-7810-45eb-8d25-857dbe273dfa None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:23.163004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a205f9-7810-45eb-8d25-857dbe273dfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:23.163306 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a205f9-7810-45eb-8d25-857dbe273dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:23.164730 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a205f9-7810-45eb-8d25-857dbe273dfa None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:23.166523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:23.186346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 388/790] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:51:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:23.187051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c65db-a56f-4957-8d52-735c9ba0f528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:23.187703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c65db-a56f-4957-8d52-735c9ba0f528 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:23.188088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c65db-a56f-4957-8d52-735c9ba0f528 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:23.188371 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c65db-a56f-4957-8d52-735c9ba0f528 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:23.195038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a205f9-7810-45eb-8d25-857dbe273dfa None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:23.200702 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c65db-a56f-4957-8d52-735c9ba0f528 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:23.202167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c65db-a56f-4957-8d52-735c9ba0f528 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-229c65db-a56f-4957-8d52-735c9ba0f528 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:23.239191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:23.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:23.243165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:23.243165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:23.243165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:23.243165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:23.243165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:23.243165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:23.243165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:23.243165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:23.243165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:51:23.243165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:23.255015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 403/791] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:51:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:23.260931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c65db-a56f-4957-8d52-735c9ba0f528 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:23.308756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a205f9-7810-45eb-8d25-857dbe273dfa None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:23.344363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adf3a3-48eb-4214-8621-54e4a6ec8f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:23.345207 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adf3a3-48eb-4214-8621-54e4a6ec8f9c None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:23.345323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adf3a3-48eb-4214-8621-54e4a6ec8f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:23.345568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adf3a3-48eb-4214-8621-54e4a6ec8f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:23.370397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adf3a3-48eb-4214-8621-54e4a6ec8f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:23.371588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adf3a3-48eb-4214-8621-54e4a6ec8f9c None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-a9adf3a3-48eb-4214-8621-54e4a6ec8f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:23.386719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:23.388334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:23.389319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:23.389319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:23.389319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:23.389319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 389/792] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:23.389640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae77d6-2e5b-480e-9a82-053fe3cec4cc None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:23.390520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae77d6-2e5b-480e-9a82-053fe3cec4cc None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:23.390520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae77d6-2e5b-480e-9a82-053fe3cec4cc None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:23.391535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 390/793] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:23.405219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e3e8-4579-485b-b02c-73b2c044bca0 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:23.405507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e3e8-4579-485b-b02c-73b2c044bca0 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:23.405782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e3e8-4579-485b-b02c-73b2c044bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:23.428000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c65db-a56f-4957-8d52-735c9ba0f528 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:23.434845 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-4783e3e8-4579-485b-b02c-73b2c044bca0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:23.436918 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4783e3e8-4579-485b-b02c-73b2c044bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:23.448374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:23.478632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47986ea-92c7-4fed-80eb-bf629da8a010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:23.479859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47986ea-92c7-4fed-80eb-bf629da8a010 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:23.480300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47986ea-92c7-4fed-80eb-bf629da8a010 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:23.480817 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47986ea-92c7-4fed-80eb-bf629da8a010 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:23.481904 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47986ea-92c7-4fed-80eb-bf629da8a010 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:23.482386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47986ea-92c7-4fed-80eb-bf629da8a010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:23.484310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47986ea-92c7-4fed-80eb-bf629da8a010 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:23.494998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:23.514305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 404/794] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Aug 10 07:51:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:23.515474 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47986ea-92c7-4fed-80eb-bf629da8a010 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:23.526452 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 391/795] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:23.531776 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e3e8-4579-485b-b02c-73b2c044bca0 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:23.644683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47986ea-92c7-4fed-80eb-bf629da8a010 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:23.670267 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e3e8-4579-485b-b02c-73b2c044bca0 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:23.684953 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d78e1d-c508-4933-9066-3ac6d9fbed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:23.685569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d78e1d-c508-4933-9066-3ac6d9fbed5f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:23.685852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d78e1d-c508-4933-9066-3ac6d9fbed5f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:23.686130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d78e1d-c508-4933-9066-3ac6d9fbed5f None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:23.686782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d78e1d-c508-4933-9066-3ac6d9fbed5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:23.687087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d78e1d-c508-4933-9066-3ac6d9fbed5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:23.688508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d78e1d-c508-4933-9066-3ac6d9fbed5f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:23.700911 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 405/796] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:23.701916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d78e1d-c508-4933-9066-3ac6d9fbed5f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:23.714571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f615fb-c9e2-4b54-b981-bb4f6956b6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:23.715542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f615fb-c9e2-4b54-b981-bb4f6956b6ef None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:23.715542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f615fb-c9e2-4b54-b981-bb4f6956b6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:23.715798 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f615fb-c9e2-4b54-b981-bb4f6956b6ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:23.727512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f615fb-c9e2-4b54-b981-bb4f6956b6ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:23.729490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f615fb-c9e2-4b54-b981-bb4f6956b6ef None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:23.743258 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-31f615fb-c9e2-4b54-b981-bb4f6956b6ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:23.746745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:23.747679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:23.754278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:23.754278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:23.754278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:23.754278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 392/797] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:23.754278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ade1da-7edb-41cf-8532-af854426f380 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:23.754278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ade1da-7edb-41cf-8532-af854426f380 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:23.754278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ade1da-7edb-41cf-8532-af854426f380 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:23.756356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 393/798] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:23.757219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ade1da-7edb-41cf-8532-af854426f380 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:23.790418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:23.830118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d78e1d-c508-4933-9066-3ac6d9fbed5f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:23.866735 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37105a72-0135-480f-a474-dd5d626737e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:23.867465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37105a72-0135-480f-a474-dd5d626737e3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:23.867651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37105a72-0135-480f-a474-dd5d626737e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:23.867943 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ade1da-7edb-41cf-8532-af854426f380 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:23.868051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37105a72-0135-480f-a474-dd5d626737e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:23.868538 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37105a72-0135-480f-a474-dd5d626737e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:23.870098 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37105a72-0135-480f-a474-dd5d626737e3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-37105a72-0135-480f-a474-dd5d626737e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:23.885710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:23.887016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:23.888565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 406/799] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:23 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:23.889395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37105a72-0135-480f-a474-dd5d626737e3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:23.917314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5946d3d-0271-4cff-9ddf-5418d4852e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:23.917904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5946d3d-0271-4cff-9ddf-5418d4852e14 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:23.918204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5946d3d-0271-4cff-9ddf-5418d4852e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:23.918480 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5946d3d-0271-4cff-9ddf-5418d4852e14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:23.927034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5946d3d-0271-4cff-9ddf-5418d4852e14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:23.929216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5946d3d-0271-4cff-9ddf-5418d4852e14 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-a5946d3d-0271-4cff-9ddf-5418d4852e14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:23.944529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:23.946205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:23.947395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:23.947395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:23.947395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:23.947395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:23.947395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:23.947395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:23.947395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:23.947395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:23.947395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:51:23.947395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:23.947959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 394/800] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 10 07:51:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:23.950190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7435b-92b2-491e-abc6-c7c5dd688d98 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:23.950745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7435b-92b2-491e-abc6-c7c5dd688d98 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:23.951303 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7435b-92b2-491e-abc6-c7c5dd688d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:23.980264 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-71c7435b-92b2-491e-abc6-c7c5dd688d98 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:23.982316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-71c7435b-92b2-491e-abc6-c7c5dd688d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:24.017408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:24.022056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37105a72-0135-480f-a474-dd5d626737e3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:24.060096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf2c7e-7493-478f-b690-4822675cb09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:24.060786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf2c7e-7493-478f-b690-4822675cb09d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:24.061147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf2c7e-7493-478f-b690-4822675cb09d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:24.061421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf2c7e-7493-478f-b690-4822675cb09d None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:24.062067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf2c7e-7493-478f-b690-4822675cb09d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:24.062375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf2c7e-7493-478f-b690-4822675cb09d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:24.063761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf2c7e-7493-478f-b690-4822675cb09d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:24.067766 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 395/801] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:24.076701 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7435b-92b2-491e-abc6-c7c5dd688d98 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:24.081913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 407/802] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:24.082861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf2c7e-7493-478f-b690-4822675cb09d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:24.103561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:24.191457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7435b-92b2-491e-abc6-c7c5dd688d98 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:24.204535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf2c7e-7493-478f-b690-4822675cb09d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:24.227717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b5756-efff-4ce7-b994-0774ebdaedaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:24.228423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b5756-efff-4ce7-b994-0774ebdaedaa None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:24.228710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b5756-efff-4ce7-b994-0774ebdaedaa None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:24.228987 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b5756-efff-4ce7-b994-0774ebdaedaa None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:24.229628 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b5756-efff-4ce7-b994-0774ebdaedaa None admin] RBAC: Adding query filter params (name=network) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:24.229931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b5756-efff-4ce7-b994-0774ebdaedaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:24.231306 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b5756-efff-4ce7-b994-0774ebdaedaa None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:24.240400 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 396/803] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 10 07:51:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:24.240400 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b5756-efff-4ce7-b994-0774ebdaedaa None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:24.240680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38119307-12d1-48bb-b180-2d9d2ee6c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:24.241204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38119307-12d1-48bb-b180-2d9d2ee6c384 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:24.241487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38119307-12d1-48bb-b180-2d9d2ee6c384 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:24.241765 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38119307-12d1-48bb-b180-2d9d2ee6c384 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:24.242498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38119307-12d1-48bb-b180-2d9d2ee6c384 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:24.242809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38119307-12d1-48bb-b180-2d9d2ee6c384 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:24.244275 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38119307-12d1-48bb-b180-2d9d2ee6c384 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:24.262686 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 408/804] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 10 07:51:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:24.263366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38119307-12d1-48bb-b180-2d9d2ee6c384 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:24.282869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:24.330532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:24.346849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b5756-efff-4ce7-b994-0774ebdaedaa None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:24.376658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38119307-12d1-48bb-b180-2d9d2ee6c384 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:24.381411 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df1add-5a59-45a4-8cc8-fbd291770904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:24.382046 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df1add-5a59-45a4-8cc8-fbd291770904 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:24.382328 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df1add-5a59-45a4-8cc8-fbd291770904 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:24.382599 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df1add-5a59-45a4-8cc8-fbd291770904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:24.389726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df1add-5a59-45a4-8cc8-fbd291770904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:24.391187 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df1add-5a59-45a4-8cc8-fbd291770904 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-15df1add-5a59-45a4-8cc8-fbd291770904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:24.402917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:24.403921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:24.404810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:24.404810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:24.404810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:24.404810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:24.404810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:24.404810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:24.404810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:24.404810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:24.404810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 397/805] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:24.405283 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843417-ed3b-4ae7-ac17-00171713e21d None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:24.405520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843417-ed3b-4ae7-ac17-00171713e21d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:24.405802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843417-ed3b-4ae7-ac17-00171713e21d None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:24.407951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 398/806] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:24.407951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843417-ed3b-4ae7-ac17-00171713e21d None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:24.422055 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4438a78-8eb9-41e9-bb31-c731ed25c390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:24.422695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4438a78-8eb9-41e9-bb31-c731ed25c390 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:24.422975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4438a78-8eb9-41e9-bb31-c731ed25c390 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:24.423244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4438a78-8eb9-41e9-bb31-c731ed25c390 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:24.436758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4438a78-8eb9-41e9-bb31-c731ed25c390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-d4438a78-8eb9-41e9-bb31-c731ed25c390 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:24.441725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:24.443895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:24.444814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:24.444814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:24.444814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:24.444814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:24.444814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:24.444814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:24.444814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:24.444814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:24.444814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:24.444814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:24.444814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:24.444814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:24.447921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 409/807] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:51:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:24.449295 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4438a78-8eb9-41e9-bb31-c731ed25c390 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:24.535641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843417-ed3b-4ae7-ac17-00171713e21d None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:24.552696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:24.575069 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812f34f-d393-4d52-a4bb-4f2e2ef6821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:24.576127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f34f-d393-4d52-a4bb-4f2e2ef6821b None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:24.576610 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f34f-d393-4d52-a4bb-4f2e2ef6821b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:24.577080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f34f-d393-4d52-a4bb-4f2e2ef6821b None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:24.578236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812f34f-d393-4d52-a4bb-4f2e2ef6821b None admin] RBAC: Adding query filter params (type=network) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:24.578784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812f34f-d393-4d52-a4bb-4f2e2ef6821b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:24.581268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812f34f-d393-4d52-a4bb-4f2e2ef6821b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:24.585876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4438a78-8eb9-41e9-bb31-c731ed25c390 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:24.587686 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 399/808] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 10 07:51:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:24.589117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339c134-ceea-406b-aee9-54fc597ffc20 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:24.589411 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339c134-ceea-406b-aee9-54fc597ffc20 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:24.589681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339c134-ceea-406b-aee9-54fc597ffc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:24.607500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-1339c134-ceea-406b-aee9-54fc597ffc20 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:24.608751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1339c134-ceea-406b-aee9-54fc597ffc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:24.610884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:24.628851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef2024-124b-40b2-82d0-565e5d82a766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:24.629461 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef2024-124b-40b2-82d0-565e5d82a766 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:24.629741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef2024-124b-40b2-82d0-565e5d82a766 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:24.630011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef2024-124b-40b2-82d0-565e5d82a766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:24.689867 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 400/809] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:24.690722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339c134-ceea-406b-aee9-54fc597ffc20 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:24.709521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef2024-124b-40b2-82d0-565e5d82a766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:24.711955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef2024-124b-40b2-82d0-565e5d82a766 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:24.820639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:24.823337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339c134-ceea-406b-aee9-54fc597ffc20 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:24.845978 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 410/810] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:51:24.846996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef2024-124b-40b2-82d0-565e5d82a766 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:24.861670 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8cb61-6ddb-4eac-b333-98c2dbb265cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:24.862290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8cb61-6ddb-4eac-b333-98c2dbb265cb None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:24.862570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8cb61-6ddb-4eac-b333-98c2dbb265cb None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:24.862846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8cb61-6ddb-4eac-b333-98c2dbb265cb None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:24.863818 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8cb61-6ddb-4eac-b333-98c2dbb265cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:24.864127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8cb61-6ddb-4eac-b333-98c2dbb265cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:24.866454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8cb61-6ddb-4eac-b333-98c2dbb265cb None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:24.875825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:24.882955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 401/811] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:24.884619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8cb61-6ddb-4eac-b333-98c2dbb265cb None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:24.973247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef2024-124b-40b2-82d0-565e5d82a766 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:25.002059 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8cb61-6ddb-4eac-b333-98c2dbb265cb None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:25.009652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260b3b9-2087-488f-8c10-e73d957af959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:25.010267 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260b3b9-2087-488f-8c10-e73d957af959 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:25.010549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260b3b9-2087-488f-8c10-e73d957af959 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:25.010822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260b3b9-2087-488f-8c10-e73d957af959 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:25.011493 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260b3b9-2087-488f-8c10-e73d957af959 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:25.011833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260b3b9-2087-488f-8c10-e73d957af959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:25.013209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260b3b9-2087-488f-8c10-e73d957af959 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:25.022884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 411/812] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:51:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:25.023771 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260b3b9-2087-488f-8c10-e73d957af959 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:25.049443 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71d6be-e32c-4521-a9c2-468fd7fa11ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:25.050051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71d6be-e32c-4521-a9c2-468fd7fa11ce None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:25.050331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71d6be-e32c-4521-a9c2-468fd7fa11ce None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:25.050606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71d6be-e32c-4521-a9c2-468fd7fa11ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:25.051273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71d6be-e32c-4521-a9c2-468fd7fa11ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:25.052718 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71d6be-e32c-4521-a9c2-468fd7fa11ce None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:25.070514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:25.088164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 402/813] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 07:51:24 2022] POST /identity/v3/endpoints => generated 337 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:51:25.089130 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71d6be-e32c-4521-a9c2-468fd7fa11ce None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:25.152253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260b3b9-2087-488f-8c10-e73d957af959 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:25.204342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7bc72-15c9-4b9f-a5c4-a63d00426bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:25.205052 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7bc72-15c9-4b9f-a5c4-a63d00426bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:25.205334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7bc72-15c9-4b9f-a5c4-a63d00426bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:25.205606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7bc72-15c9-4b9f-a5c4-a63d00426bf2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:25.206203 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7bc72-15c9-4b9f-a5c4-a63d00426bf2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:25.206763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:25.207646 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7bc72-15c9-4b9f-a5c4-a63d00426bf2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-1aa7bc72-15c9-4b9f-a5c4-a63d00426bf2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:25.224709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:25.226652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:25.229047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 412/814] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Aug 10 07:51:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:25.230665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7bc72-15c9-4b9f-a5c4-a63d00426bf2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:25.290485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71d6be-e32c-4521-a9c2-468fd7fa11ce None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:25.340976 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e7d7-7570-4d6d-8a2b-8fa007971d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:25.341639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e7d7-7570-4d6d-8a2b-8fa007971d72 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:25.341915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e7d7-7570-4d6d-8a2b-8fa007971d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:25.342182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e7d7-7570-4d6d-8a2b-8fa007971d72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:25.363618 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187e7d7-7570-4d6d-8a2b-8fa007971d72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:25.365684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187e7d7-7570-4d6d-8a2b-8fa007971d72 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:25.381254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:25.384365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7bc72-15c9-4b9f-a5c4-a63d00426bf2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-7187e7d7-7570-4d6d-8a2b-8fa007971d72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:25.387590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:25.388614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:25.389497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:25.389497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:25.389497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:25.389497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 403/815] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:25.389719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e7d7-7570-4d6d-8a2b-8fa007971d72 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:25.426284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f061f96-b456-4bdd-aca6-cca8459bdeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:25.427086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f061f96-b456-4bdd-aca6-cca8459bdeec None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:25.427947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f061f96-b456-4bdd-aca6-cca8459bdeec None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:25.428225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f061f96-b456-4bdd-aca6-cca8459bdeec None admin] PATH_INFO: `/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/867485ce37eb41359a8e53b2b78061f6/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:25.430471 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f061f96-b456-4bdd-aca6-cca8459bdeec None admin] RBAC: Authorizing `identity:create_grant(project_id=bad7eba8964f4acf9c6c1397df7cd1dd, user_id=867485ce37eb41359a8e53b2b78061f6, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:25.431983 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f061f96-b456-4bdd-aca6-cca8459bdeec None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:25.447340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 413/816] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:51:25 2022] PUT /identity/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/867485ce37eb41359a8e53b2b78061f6/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:51:25.448959 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f061f96-b456-4bdd-aca6-cca8459bdeec None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:25.548278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e7d7-7570-4d6d-8a2b-8fa007971d72 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:25.558575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:25.605803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dea3ef-5599-4a3b-85a2-7ffebd5fd18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:25.607150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dea3ef-5599-4a3b-85a2-7ffebd5fd18f None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:25.607391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dea3ef-5599-4a3b-85a2-7ffebd5fd18f None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:25.607824 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dea3ef-5599-4a3b-85a2-7ffebd5fd18f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:25.621736 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dea3ef-5599-4a3b-85a2-7ffebd5fd18f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:25.623408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dea3ef-5599-4a3b-85a2-7ffebd5fd18f None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:25.625449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f061f96-b456-4bdd-aca6-cca8459bdeec None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-84dea3ef-5599-4a3b-85a2-7ffebd5fd18f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:25.643379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:25.645091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:25.646631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:25.646631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:25.646631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:25.646631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 404/817] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:25.646631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dea3ef-5599-4a3b-85a2-7ffebd5fd18f None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:25.681193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c047f6-c418-466e-bb42-fbde8dc8cee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:25.682031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c047f6-c418-466e-bb42-fbde8dc8cee4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:25.682316 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c047f6-c418-466e-bb42-fbde8dc8cee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:25.682648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c047f6-c418-466e-bb42-fbde8dc8cee4 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:25.683406 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c047f6-c418-466e-bb42-fbde8dc8cee4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:25.683716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c047f6-c418-466e-bb42-fbde8dc8cee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:25.685187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c047f6-c418-466e-bb42-fbde8dc8cee4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:25.690673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 414/818] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Aug 10 07:51:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:25.691505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c047f6-c418-466e-bb42-fbde8dc8cee4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:25.728813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:25.768376 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dea3ef-5599-4a3b-85a2-7ffebd5fd18f None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:25.808682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ead8e1-629b-4214-a15c-fe47cbca7919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:25.809219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ead8e1-629b-4214-a15c-fe47cbca7919 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:25.809501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ead8e1-629b-4214-a15c-fe47cbca7919 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:25.809777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ead8e1-629b-4214-a15c-fe47cbca7919 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:25.810466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ead8e1-629b-4214-a15c-fe47cbca7919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:25.810770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ead8e1-629b-4214-a15c-fe47cbca7919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:25.812250 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ead8e1-629b-4214-a15c-fe47cbca7919 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:25.821423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c047f6-c418-466e-bb42-fbde8dc8cee4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:25.825775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 405/819] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:25.826658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ead8e1-629b-4214-a15c-fe47cbca7919 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:25.848895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:25.862665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674b140-6a99-42b1-a2d6-158ac470ed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:25.863542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674b140-6a99-42b1-a2d6-158ac470ed63 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:25.864040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674b140-6a99-42b1-a2d6-158ac470ed63 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:25.864455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674b140-6a99-42b1-a2d6-158ac470ed63 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:25.865852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674b140-6a99-42b1-a2d6-158ac470ed63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:25.866311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674b140-6a99-42b1-a2d6-158ac470ed63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:25.867887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674b140-6a99-42b1-a2d6-158ac470ed63 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:25.886812 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 415/820] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:25.888572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674b140-6a99-42b1-a2d6-158ac470ed63 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:25.978022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ead8e1-629b-4214-a15c-fe47cbca7919 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:26.029686 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c36a7-7cc2-45f1-aad0-ed3057089460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:26.030338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c36a7-7cc2-45f1-aad0-ed3057089460 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:26.030904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c36a7-7cc2-45f1-aad0-ed3057089460 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:26.031018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c36a7-7cc2-45f1-aad0-ed3057089460 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:26.031594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c36a7-7cc2-45f1-aad0-ed3057089460 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:26.031927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c36a7-7cc2-45f1-aad0-ed3057089460 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:26.033319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c36a7-7cc2-45f1-aad0-ed3057089460 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:26.034515 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:26.044137 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 406/821] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Aug 10 07:51:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:26.045822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c36a7-7cc2-45f1-aad0-ed3057089460 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:26.063245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674b140-6a99-42b1-a2d6-158ac470ed63 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:26.103189 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fea2c1-b8fd-4828-afe7-73826bcd1977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:26.103996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fea2c1-b8fd-4828-afe7-73826bcd1977 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:26.104281 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fea2c1-b8fd-4828-afe7-73826bcd1977 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:26.104555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fea2c1-b8fd-4828-afe7-73826bcd1977 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:26.112282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fea2c1-b8fd-4828-afe7-73826bcd1977 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:26.113987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fea2c1-b8fd-4828-afe7-73826bcd1977 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-00fea2c1-b8fd-4828-afe7-73826bcd1977 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:26.129231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:26.130173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:26.136931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:26.136931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:26.136931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:26.136931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:26.136931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:26.136931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:26.136931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:26.136931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:26.136931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 416/822] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:26.136931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fea2c1-b8fd-4828-afe7-73826bcd1977 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:26.149396 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:26.174943 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c36a7-7cc2-45f1-aad0-ed3057089460 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:26.219448 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a948197-9710-41f4-8063-d5a946de97df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:26.220595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a948197-9710-41f4-8063-d5a946de97df None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:26.221040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a948197-9710-41f4-8063-d5a946de97df None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:26.221484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a948197-9710-41f4-8063-d5a946de97df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:26.234725 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a948197-9710-41f4-8063-d5a946de97df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:26.236341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a948197-9710-41f4-8063-d5a946de97df None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-9a948197-9710-41f4-8063-d5a946de97df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:26.250280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:26.251278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:26.252638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:26.252638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:26.252638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:26.252638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:26.252638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:26.252638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:26.252638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:26.252638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:26.252638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:51:26.252638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:26.252638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 407/823] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Aug 10 07:51:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:26.252638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a948197-9710-41f4-8063-d5a946de97df None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:26.274133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fea2c1-b8fd-4828-afe7-73826bcd1977 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:26.315649 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9aaf1-bd13-4c60-b16c-4a06de63ebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:26.316358 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9aaf1-bd13-4c60-b16c-4a06de63ebb1 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:26.316721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9aaf1-bd13-4c60-b16c-4a06de63ebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:26.317063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9aaf1-bd13-4c60-b16c-4a06de63ebb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:26.317854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9aaf1-bd13-4c60-b16c-4a06de63ebb1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:26.319336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9aaf1-bd13-4c60-b16c-4a06de63ebb1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:26.339465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:26.351923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 417/824] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 07:51:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:51:26.353964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9aaf1-bd13-4c60-b16c-4a06de63ebb1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:26.384504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a948197-9710-41f4-8063-d5a946de97df None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:26.441406 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c7e5a-71e7-4d89-b849-fdde719fa140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:26.442069 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c7e5a-71e7-4d89-b849-fdde719fa140 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:26.442351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c7e5a-71e7-4d89-b849-fdde719fa140 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:26.442631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c7e5a-71e7-4d89-b849-fdde719fa140 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:26.444114 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c7e5a-71e7-4d89-b849-fdde719fa140 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:26.444570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c7e5a-71e7-4d89-b849-fdde719fa140 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:26.446085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c7e5a-71e7-4d89-b849-fdde719fa140 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:26.458334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:26.471920 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 408/825] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:26.473869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c7e5a-71e7-4d89-b849-fdde719fa140 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:26.524395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9aaf1-bd13-4c60-b16c-4a06de63ebb1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:26.571553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779797a3-9381-4d38-8e59-b18e3afb75dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:26.572115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779797a3-9381-4d38-8e59-b18e3afb75dd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:26.572398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779797a3-9381-4d38-8e59-b18e3afb75dd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:26.572669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779797a3-9381-4d38-8e59-b18e3afb75dd None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:26.573476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779797a3-9381-4d38-8e59-b18e3afb75dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:26.573783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779797a3-9381-4d38-8e59-b18e3afb75dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:26.575221 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779797a3-9381-4d38-8e59-b18e3afb75dd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:26.597851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 418/826] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Aug 10 07:51:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:26.603044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779797a3-9381-4d38-8e59-b18e3afb75dd None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:26.622506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c7e5a-71e7-4d89-b849-fdde719fa140 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:26.667628 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d75b1a-8532-4135-bdb6-fd7014658fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:26.668280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d75b1a-8532-4135-bdb6-fd7014658fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:26.668561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d75b1a-8532-4135-bdb6-fd7014658fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:26.668835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d75b1a-8532-4135-bdb6-fd7014658fb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:26.669573 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d75b1a-8532-4135-bdb6-fd7014658fb8 None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=6c8e7a0b9eb14983ac117690e2705eb4) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:26.669881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d75b1a-8532-4135-bdb6-fd7014658fb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:26.671949 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d75b1a-8532-4135-bdb6-fd7014658fb8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:26.683783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 409/827] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:26 2022] GET /identity/v3/role_assignments?user.id=6c8e7a0b9eb14983ac117690e2705eb4&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:26.696954 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:26.750796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779797a3-9381-4d38-8e59-b18e3afb75dd None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:26.794180 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa3504-d59f-484e-9912-96a1170a7dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:26.795100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa3504-d59f-484e-9912-96a1170a7dba None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:26.795525 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa3504-d59f-484e-9912-96a1170a7dba None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:26.795962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa3504-d59f-484e-9912-96a1170a7dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:26.808918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa3504-d59f-484e-9912-96a1170a7dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:26.810719 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa3504-d59f-484e-9912-96a1170a7dba None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-98fa3504-d59f-484e-9912-96a1170a7dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:26.828789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:26.829936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:26.831050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:26.831050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:26.831050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:26.832969 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 419/828] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:26.839133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d75b1a-8532-4135-bdb6-fd7014658fb8 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:26.923917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:26.977806 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d75b1a-8532-4135-bdb6-fd7014658fb8 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:27.014980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd8ba4-6a24-40c3-ad9d-db78237ab3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:27.015915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd8ba4-6a24-40c3-ad9d-db78237ab3cf None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:27.016362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd8ba4-6a24-40c3-ad9d-db78237ab3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:27.016779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd8ba4-6a24-40c3-ad9d-db78237ab3cf None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:27.017576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd8ba4-6a24-40c3-ad9d-db78237ab3cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:27.018022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd8ba4-6a24-40c3-ad9d-db78237ab3cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:27.019592 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd8ba4-6a24-40c3-ad9d-db78237ab3cf None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:27.033869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 410/829] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:27.039403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa3504-d59f-484e-9912-96a1170a7dba None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:27.151086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa3504-d59f-484e-9912-96a1170a7dba None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:27.162785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:27.190167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d76d42-d167-4728-ace1-d43576a773fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:27.190806 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d76d42-d167-4728-ace1-d43576a773fc None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:27.191084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d76d42-d167-4728-ace1-d43576a773fc None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:27.191419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d76d42-d167-4728-ace1-d43576a773fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:27.199455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d76d42-d167-4728-ace1-d43576a773fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:27.200946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d76d42-d167-4728-ace1-d43576a773fc None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-47d76d42-d167-4728-ace1-d43576a773fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:27.213568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:27.214748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:27.215963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:27.215963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:27.215963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:27.215963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:27.215963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:27.215963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:27.215963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:27.215963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:27.215963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 420/830] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:27.222416 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd8ba4-6a24-40c3-ad9d-db78237ab3cf None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:27.332439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd8ba4-6a24-40c3-ad9d-db78237ab3cf None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:27.364161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:27.376768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec5844-19c2-4562-b21f-e578a2b38420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:27.377437 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec5844-19c2-4562-b21f-e578a2b38420 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:27.377724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec5844-19c2-4562-b21f-e578a2b38420 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:27.377997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec5844-19c2-4562-b21f-e578a2b38420 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:27.378703 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec5844-19c2-4562-b21f-e578a2b38420 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:27.379004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec5844-19c2-4562-b21f-e578a2b38420 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:27.380592 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec5844-19c2-4562-b21f-e578a2b38420 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:27.397948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 411/831] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:27.403934 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d76d42-d167-4728-ace1-d43576a773fc None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:27.540766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d76d42-d167-4728-ace1-d43576a773fc None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:27.580261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b507a02-3f7e-4fda-9623-9a55b515a866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:27.580927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b507a02-3f7e-4fda-9623-9a55b515a866 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:27.581206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b507a02-3f7e-4fda-9623-9a55b515a866 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:27.581477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b507a02-3f7e-4fda-9623-9a55b515a866 None admin] PATH_INFO: `/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/15690a9236a74f518837f7d47d9797b1/roles/6a4c16cbe590427c8b82f03b71c9a2c0` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:27.598515 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b507a02-3f7e-4fda-9623-9a55b515a866 None admin] RBAC: Authorizing `identity:create_grant(project_id=bad7eba8964f4acf9c6c1397df7cd1dd, user_id=15690a9236a74f518837f7d47d9797b1, role_id=6a4c16cbe590427c8b82f03b71c9a2c0)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:27.600092 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b507a02-3f7e-4fda-9623-9a55b515a866 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:27.618644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 421/832] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:51:27 2022] PUT /identity/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/15690a9236a74f518837f7d47d9797b1/roles/6a4c16cbe590427c8b82f03b71c9a2c0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:51:27.925030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32834e20-fc4d-4522-86c9-b3a9a3abf810 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:27.925563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32834e20-fc4d-4522-86c9-b3a9a3abf810 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:27.925563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32834e20-fc4d-4522-86c9-b3a9a3abf810 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:27.927249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 412/833] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:27.933644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93da3b-85b2-4489-96a0-495c1a8d9269 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:27.933932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93da3b-85b2-4489-96a0-495c1a8d9269 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:27.934209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93da3b-85b2-4489-96a0-495c1a8d9269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:27.952888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3d93da3b-85b2-4489-96a0-495c1a8d9269 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:27.954827 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3d93da3b-85b2-4489-96a0-495c1a8d9269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:27.971237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:28.042956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 422/834] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:28.069572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32834e20-fc4d-4522-86c9-b3a9a3abf810 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:28.185151 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32834e20-fc4d-4522-86c9-b3a9a3abf810 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:28.222328 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c0cd-6c12-48ad-9ff3-9ffbd6a6f483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:28.223064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c0cd-6c12-48ad-9ff3-9ffbd6a6f483 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:28.223417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c0cd-6c12-48ad-9ff3-9ffbd6a6f483 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:28.223781 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c0cd-6c12-48ad-9ff3-9ffbd6a6f483 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:28.234925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599c0cd-6c12-48ad-9ff3-9ffbd6a6f483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-d599c0cd-6c12-48ad-9ff3-9ffbd6a6f483 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:28.240149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:28.242274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:28.244375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:28.244375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:28.244375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:28.244375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:28.244375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:28.244375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:28.244375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:28.244375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:28.244375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:28.244375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:28.244375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:28.244375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:28.244375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 413/835] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:51:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:28.251770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93da3b-85b2-4489-96a0-495c1a8d9269 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:28.371104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93da3b-85b2-4489-96a0-495c1a8d9269 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:28.409939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765cd7f-7808-4e52-b5e6-14dbc2891f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:28.410553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765cd7f-7808-4e52-b5e6-14dbc2891f96 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:28.410809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765cd7f-7808-4e52-b5e6-14dbc2891f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:28.411087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765cd7f-7808-4e52-b5e6-14dbc2891f96 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:28.412343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765cd7f-7808-4e52-b5e6-14dbc2891f96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:28.412643 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765cd7f-7808-4e52-b5e6-14dbc2891f96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:28.414073 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765cd7f-7808-4e52-b5e6-14dbc2891f96 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:28.423291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 423/836] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:51:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:28.429018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c0cd-6c12-48ad-9ff3-9ffbd6a6f483 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:28.477886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:28.540003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c0cd-6c12-48ad-9ff3-9ffbd6a6f483 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:28.577071 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f579292-d181-43a4-afa7-7fe1d5eca8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:28.577996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f579292-d181-43a4-afa7-7fe1d5eca8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:28.578425 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f579292-d181-43a4-afa7-7fe1d5eca8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:28.578841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f579292-d181-43a4-afa7-7fe1d5eca8a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:28.590436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f579292-d181-43a4-afa7-7fe1d5eca8a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:28.592182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f579292-d181-43a4-afa7-7fe1d5eca8a1 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-5f579292-d181-43a4-afa7-7fe1d5eca8a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:28.608568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:28.609657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:28.610658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:28.610658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:28.610658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:28.612358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 414/837] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:28.618226 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765cd7f-7808-4e52-b5e6-14dbc2891f96 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:28.637304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:28.727025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765cd7f-7808-4e52-b5e6-14dbc2891f96 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:28.762550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d94765-0fcd-44f0-a009-9ab2f4b3ec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:28.763390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d94765-0fcd-44f0-a009-9ab2f4b3ec87 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:28.763837 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d94765-0fcd-44f0-a009-9ab2f4b3ec87 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:28.764278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d94765-0fcd-44f0-a009-9ab2f4b3ec87 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:28.765060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d94765-0fcd-44f0-a009-9ab2f4b3ec87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:28.765511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d94765-0fcd-44f0-a009-9ab2f4b3ec87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:28.767016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d94765-0fcd-44f0-a009-9ab2f4b3ec87 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:28.779896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 424/838] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:28.785240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f579292-d181-43a4-afa7-7fe1d5eca8a1 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:28.888292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:28.897669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f579292-d181-43a4-afa7-7fe1d5eca8a1 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:28.935927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490250c-e237-4f6b-bcac-6345c08dfb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:28.936974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490250c-e237-4f6b-bcac-6345c08dfb52 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:28.937472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490250c-e237-4f6b-bcac-6345c08dfb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:28.937965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490250c-e237-4f6b-bcac-6345c08dfb52 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:28.952300 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490250c-e237-4f6b-bcac-6345c08dfb52 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:28.953752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490250c-e237-4f6b-bcac-6345c08dfb52 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-4490250c-e237-4f6b-bcac-6345c08dfb52 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:28.965810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:28.966782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:28.967713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:28.967713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:28.967713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:28.967713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:28.967713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:28.967713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:28.967713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:28.967713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:28.967713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:51:28.967713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:28.967713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 415/839] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:51:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:28.976851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d94765-0fcd-44f0-a009-9ab2f4b3ec87 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:29.027360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b5fae-6b75-4005-850c-bfe82e5daab0 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:29.027964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b5fae-6b75-4005-850c-bfe82e5daab0 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:29.028472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b5fae-6b75-4005-850c-bfe82e5daab0 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:29.030317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 416/840] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:29.037150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34745da4-e718-41a4-b322-ea3c090dd3e6 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:29.037718 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34745da4-e718-41a4-b322-ea3c090dd3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:29.038198 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34745da4-e718-41a4-b322-ea3c090dd3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:29.057187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:29.060759 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-34745da4-e718-41a4-b322-ea3c090dd3e6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:29.061962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-34745da4-e718-41a4-b322-ea3c090dd3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:29.095066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d94765-0fcd-44f0-a009-9ab2f4b3ec87 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:29.135705 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50903191-2a0a-4c3f-bbcc-9c78d7bf46ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:29.136755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50903191-2a0a-4c3f-bbcc-9c78d7bf46ef None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:29.137231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50903191-2a0a-4c3f-bbcc-9c78d7bf46ef None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:29.137503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50903191-2a0a-4c3f-bbcc-9c78d7bf46ef None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:29.138269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50903191-2a0a-4c3f-bbcc-9c78d7bf46ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:29.138574 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50903191-2a0a-4c3f-bbcc-9c78d7bf46ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:29.140063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50903191-2a0a-4c3f-bbcc-9c78d7bf46ef None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:29.141305 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 417/841] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:51:29.142898 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97461bf2-d46c-49df-845d-155eadc7fd3b None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:29.143189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97461bf2-d46c-49df-845d-155eadc7fd3b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:29.143466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97461bf2-d46c-49df-845d-155eadc7fd3b None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:29.144752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 418/842] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:29.158901 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5bde4-d636-4dea-b4d5-781464f6208f None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:29.159172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5bde4-d636-4dea-b4d5-781464f6208f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:29.159458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5bde4-d636-4dea-b4d5-781464f6208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:29.174985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 425/843] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Aug 10 07:51:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:29.176963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50903191-2a0a-4c3f-bbcc-9c78d7bf46ef None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:29.183265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b9f5bde4-d636-4dea-b4d5-781464f6208f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:29.184891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b9f5bde4-d636-4dea-b4d5-781464f6208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:29.260897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 419/844] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:29.262140 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5bde4-d636-4dea-b4d5-781464f6208f None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:29.292284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:29.299678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50903191-2a0a-4c3f-bbcc-9c78d7bf46ef None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:29.336718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:29.343475 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a35a-84d6-41d6-9ab9-6d04913d0201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:29.344133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a35a-84d6-41d6-9ab9-6d04913d0201 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:29.344411 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a35a-84d6-41d6-9ab9-6d04913d0201 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:29.344757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a35a-84d6-41d6-9ab9-6d04913d0201 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:29.345269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84a35a-84d6-41d6-9ab9-6d04913d0201 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:29.346643 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84a35a-84d6-41d6-9ab9-6d04913d0201 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-1d84a35a-84d6-41d6-9ab9-6d04913d0201 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:29.356193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:29.357177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:29.358039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 426/845] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Aug 10 07:51:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:29.358820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a35a-84d6-41d6-9ab9-6d04913d0201 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:29.401810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5bde4-d636-4dea-b4d5-781464f6208f None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:29.437774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29115a26-5875-4ebc-adec-74c00a139d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:29.438387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29115a26-5875-4ebc-adec-74c00a139d5a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:29.438673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29115a26-5875-4ebc-adec-74c00a139d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:29.438949 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29115a26-5875-4ebc-adec-74c00a139d5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:29.474725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a35a-84d6-41d6-9ab9-6d04913d0201 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:29.513075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29115a26-5875-4ebc-adec-74c00a139d5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:29.514540 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29115a26-5875-4ebc-adec-74c00a139d5a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:29.516092 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6f872-127f-433f-b29f-f396ff8b5816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:29.517008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6f872-127f-433f-b29f-f396ff8b5816 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:29.517559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6f872-127f-433f-b29f-f396ff8b5816 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:29.517830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6f872-127f-433f-b29f-f396ff8b5816 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:29.518419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6f872-127f-433f-b29f-f396ff8b5816 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:29.519823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6f872-127f-433f-b29f-f396ff8b5816 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-bbf6f872-127f-433f-b29f-f396ff8b5816 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:29.529590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:29.530742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:51:29.531634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:29.532853 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:29.532928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 427/846] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:51:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:29.532928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6f872-127f-433f-b29f-f396ff8b5816 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:29.607014 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:29.666866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 420/847] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:51:29.666866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29115a26-5875-4ebc-adec-74c00a139d5a None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:29.687573 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6f872-127f-433f-b29f-f396ff8b5816 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:29.736558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d710a20-52b5-42f0-b3a7-a1f4ad296fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:29.737427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d710a20-52b5-42f0-b3a7-a1f4ad296fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:29.737721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d710a20-52b5-42f0-b3a7-a1f4ad296fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:29.737964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d710a20-52b5-42f0-b3a7-a1f4ad296fb7 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:29.738611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d710a20-52b5-42f0-b3a7-a1f4ad296fb7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:29.738915 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d710a20-52b5-42f0-b3a7-a1f4ad296fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:29.740823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d710a20-52b5-42f0-b3a7-a1f4ad296fb7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:29.746464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 428/848] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 10 07:51:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:29.747295 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d710a20-52b5-42f0-b3a7-a1f4ad296fb7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:29.818342 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29115a26-5875-4ebc-adec-74c00a139d5a None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:29.836404 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:29.861673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd28d67-09f1-4a6a-a1db-961652471ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:29.862190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28d67-09f1-4a6a-a1db-961652471ead None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:29.862788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28d67-09f1-4a6a-a1db-961652471ead None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:29.863074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28d67-09f1-4a6a-a1db-961652471ead None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:29.863749 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd28d67-09f1-4a6a-a1db-961652471ead None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:29.864057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd28d67-09f1-4a6a-a1db-961652471ead None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:29.865893 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd28d67-09f1-4a6a-a1db-961652471ead None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:29.877603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 421/849] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:51:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:29.877603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd28d67-09f1-4a6a-a1db-961652471ead None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:29.890926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d710a20-52b5-42f0-b3a7-a1f4ad296fb7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:29.941864 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:29.969864 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d6f1-f4e3-4197-8380-ed1c311c6f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:29.970943 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d6f1-f4e3-4197-8380-ed1c311c6f54 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:29.971480 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d6f1-f4e3-4197-8380-ed1c311c6f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:29.972012 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d6f1-f4e3-4197-8380-ed1c311c6f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:29.989269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5d6f1-f4e3-4197-8380-ed1c311c6f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:29.990769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5d6f1-f4e3-4197-8380-ed1c311c6f54 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-1dd5d6f1-f4e3-4197-8380-ed1c311c6f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:30.010134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:30.011292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:30.012248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:30.012248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:30.012248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:30.012248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 429/850] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:30.012248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d6f1-f4e3-4197-8380-ed1c311c6f54 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:30.038181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd28d67-09f1-4a6a-a1db-961652471ead None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:30.075127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4dc02-5373-40c0-8292-112fb5e89223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:30.075764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4dc02-5373-40c0-8292-112fb5e89223 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:30.076056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4dc02-5373-40c0-8292-112fb5e89223 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:30.076331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4dc02-5373-40c0-8292-112fb5e89223 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:30.076970 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4dc02-5373-40c0-8292-112fb5e89223 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:30.077274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4dc02-5373-40c0-8292-112fb5e89223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:30.078633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4dc02-5373-40c0-8292-112fb5e89223 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:30.084028 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 422/851] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 10 07:51:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:30.084787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4dc02-5373-40c0-8292-112fb5e89223 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:30.142133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:30.153341 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d6f1-f4e3-4197-8380-ed1c311c6f54 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:30.194884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5e7ac-90a9-4f47-ac80-67fe20a3bc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:30.195504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e7ac-90a9-4f47-ac80-67fe20a3bc8b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:30.195841 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e7ac-90a9-4f47-ac80-67fe20a3bc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:30.196111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e7ac-90a9-4f47-ac80-67fe20a3bc8b None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:30.196759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5e7ac-90a9-4f47-ac80-67fe20a3bc8b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:30.197059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5e7ac-90a9-4f47-ac80-67fe20a3bc8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:30.198480 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5e7ac-90a9-4f47-ac80-67fe20a3bc8b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:30.203978 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 430/852] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:51:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:30.210282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c913b0-aa08-42b6-9eff-0af246c40dc6 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:30.211276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c913b0-aa08-42b6-9eff-0af246c40dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:30.211832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c913b0-aa08-42b6-9eff-0af246c40dc6 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:30.214754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 431/853] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:30.220343 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4dc02-5373-40c0-8292-112fb5e89223 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:30.221020 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd1134-644d-484d-ad7b-1797cdc1e7b5 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:30.221526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd1134-644d-484d-ad7b-1797cdc1e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:30.221994 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd1134-644d-484d-ad7b-1797cdc1e7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:30.248918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-55cd1134-644d-484d-ad7b-1797cdc1e7b5 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:30.251076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-55cd1134-644d-484d-ad7b-1797cdc1e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:30.272584 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc907e0-07cb-4ca5-9ece-d7be1fd91b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:30.273216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc907e0-07cb-4ca5-9ece-d7be1fd91b19 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:30.273497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc907e0-07cb-4ca5-9ece-d7be1fd91b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:30.274168 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc907e0-07cb-4ca5-9ece-d7be1fd91b19 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:30.274858 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc907e0-07cb-4ca5-9ece-d7be1fd91b19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:30.275174 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc907e0-07cb-4ca5-9ece-d7be1fd91b19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:30.277082 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc907e0-07cb-4ca5-9ece-d7be1fd91b19 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:30.294239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 423/854] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:30.301848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc907e0-07cb-4ca5-9ece-d7be1fd91b19 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:30.307262 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:30.375883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 432/855] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:51:30.413846 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd1134-644d-484d-ad7b-1797cdc1e7b5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:30.446134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc907e0-07cb-4ca5-9ece-d7be1fd91b19 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:30.448912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:30.492770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306c5c0-5718-4887-bc2d-d143c0eda04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:30.493496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c5c0-5718-4887-bc2d-d143c0eda04e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:30.493785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c5c0-5718-4887-bc2d-d143c0eda04e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:30.494063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c5c0-5718-4887-bc2d-d143c0eda04e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:30.505213 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306c5c0-5718-4887-bc2d-d143c0eda04e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:30.506696 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306c5c0-5718-4887-bc2d-d143c0eda04e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-9306c5c0-5718-4887-bc2d-d143c0eda04e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:30.522497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:30.523454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:30.524984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:30.524984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:30.524984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:30.524984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:30.524984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:30.524984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:30.524984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:30.524984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:30.528700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 424/856] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:30.529667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306c5c0-5718-4887-bc2d-d143c0eda04e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:30.585069 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd1134-644d-484d-ad7b-1797cdc1e7b5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:30.635469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b5b69-7e3a-43f1-b0c8-45487b6cedfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:30.636777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b5b69-7e3a-43f1-b0c8-45487b6cedfa None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:30.637064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b5b69-7e3a-43f1-b0c8-45487b6cedfa None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:30.637340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b5b69-7e3a-43f1-b0c8-45487b6cedfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:30.653494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b5b69-7e3a-43f1-b0c8-45487b6cedfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:30.663345 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306c5c0-5718-4887-bc2d-d143c0eda04e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-ec3b5b69-7e3a-43f1-b0c8-45487b6cedfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:30.663654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:30.664796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:30.665669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:30.665669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:30.665669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:30.665669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:30.665669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:30.665669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:30.665669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:30.665669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:30.665669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:30.665669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:30.665669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:51:30.665669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:30.665669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 433/857] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:51:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:30.670911 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b5b69-7e3a-43f1-b0c8-45487b6cedfa None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:30.710298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75538875-114a-417e-84b7-4671634ade3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:30.710933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75538875-114a-417e-84b7-4671634ade3a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:30.711214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75538875-114a-417e-84b7-4671634ade3a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:30.711499 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75538875-114a-417e-84b7-4671634ade3a None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:30.712247 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75538875-114a-417e-84b7-4671634ade3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:30.712559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75538875-114a-417e-84b7-4671634ade3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:30.714460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75538875-114a-417e-84b7-4671634ade3a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:30.720522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:30.734634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 425/858] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:30.735706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75538875-114a-417e-84b7-4671634ade3a None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:30.767178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:30.814792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b5b69-7e3a-43f1-b0c8-45487b6cedfa None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:30.853821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee108b-5e60-46fc-a695-a7f8b54bde49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:30.854628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee108b-5e60-46fc-a695-a7f8b54bde49 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:30.854926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee108b-5e60-46fc-a695-a7f8b54bde49 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:30.855360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee108b-5e60-46fc-a695-a7f8b54bde49 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:30.856715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee108b-5e60-46fc-a695-a7f8b54bde49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:30.857214 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee108b-5e60-46fc-a695-a7f8b54bde49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:30.859546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee108b-5e60-46fc-a695-a7f8b54bde49 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:30.877639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 434/859] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:51:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:30.879396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee108b-5e60-46fc-a695-a7f8b54bde49 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:30.882784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75538875-114a-417e-84b7-4671634ade3a None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:30.930658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c078f0-359d-4a3f-9b24-042fea77c7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:30.931597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c078f0-359d-4a3f-9b24-042fea77c7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:30.932184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c078f0-359d-4a3f-9b24-042fea77c7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:30.932756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c078f0-359d-4a3f-9b24-042fea77c7f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:30.933787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c078f0-359d-4a3f-9b24-042fea77c7f2 None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=867485ce37eb41359a8e53b2b78061f6) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:30.934307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c078f0-359d-4a3f-9b24-042fea77c7f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:30.936000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c078f0-359d-4a3f-9b24-042fea77c7f2 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:30.952230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 426/860] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:30 2022] GET /identity/v3/role_assignments?user.id=867485ce37eb41359a8e53b2b78061f6&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:31.018388 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:31.030284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee108b-5e60-46fc-a695-a7f8b54bde49 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:31.070151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0c763-f8df-40f8-977b-68d528d113db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:31.070802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0c763-f8df-40f8-977b-68d528d113db None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:31.071077 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0c763-f8df-40f8-977b-68d528d113db None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:31.071343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0c763-f8df-40f8-977b-68d528d113db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:31.084551 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0c763-f8df-40f8-977b-68d528d113db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:31.086028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0c763-f8df-40f8-977b-68d528d113db None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-5ca0c763-f8df-40f8-977b-68d528d113db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:31.102393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:31.103777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:31.104752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:31.104752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:31.104752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:31.104752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 435/861] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:31.111071 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c078f0-359d-4a3f-9b24-042fea77c7f2 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:31.238829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:31.257627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c078f0-359d-4a3f-9b24-042fea77c7f2 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:31.302694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb389b-4e83-4e67-a754-719247b83cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:31.303963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb389b-4e83-4e67-a754-719247b83cea None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:31.304501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb389b-4e83-4e67-a754-719247b83cea None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:31.305090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb389b-4e83-4e67-a754-719247b83cea None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:31.306148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb389b-4e83-4e67-a754-719247b83cea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:31.306619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb389b-4e83-4e67-a754-719247b83cea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:31.308180 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb389b-4e83-4e67-a754-719247b83cea None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:31.327761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 427/862] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:31.330163 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0c763-f8df-40f8-977b-68d528d113db None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:31.458944 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0c763-f8df-40f8-977b-68d528d113db None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:31.500798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028c98a-4a44-4b4e-bbba-e8f9096f9052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:31.501852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028c98a-4a44-4b4e-bbba-e8f9096f9052 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:31.502318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028c98a-4a44-4b4e-bbba-e8f9096f9052 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:31.502764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028c98a-4a44-4b4e-bbba-e8f9096f9052 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:31.513711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028c98a-4a44-4b4e-bbba-e8f9096f9052 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:31.516233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028c98a-4a44-4b4e-bbba-e8f9096f9052 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-f028c98a-4a44-4b4e-bbba-e8f9096f9052 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:31.529679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:31.530726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:31.531657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:31.531657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:31.531657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:31.531657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:31.531657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:31.531657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:31.531657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:31.531657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:31.531657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:51:31.531657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:31.531657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 436/863] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Aug 10 07:51:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:31.539142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb389b-4e83-4e67-a754-719247b83cea None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:31.659079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb389b-4e83-4e67-a754-719247b83cea None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:31.697611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46339ae-2a33-4a39-9719-3135d87d5f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:31.698634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46339ae-2a33-4a39-9719-3135d87d5f5b None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:31.699141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46339ae-2a33-4a39-9719-3135d87d5f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:31.699623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46339ae-2a33-4a39-9719-3135d87d5f5b None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:31.700605 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46339ae-2a33-4a39-9719-3135d87d5f5b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:31.701119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46339ae-2a33-4a39-9719-3135d87d5f5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:31.702775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46339ae-2a33-4a39-9719-3135d87d5f5b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:31.722637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 428/864] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Aug 10 07:51:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:31.728853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028c98a-4a44-4b4e-bbba-e8f9096f9052 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:31.741027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:31.863236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028c98a-4a44-4b4e-bbba-e8f9096f9052 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:31.922879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37313543-59a5-4732-a22c-c0b3d718b634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:31.923808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37313543-59a5-4732-a22c-c0b3d718b634 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:31.924302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37313543-59a5-4732-a22c-c0b3d718b634 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:31.924799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37313543-59a5-4732-a22c-c0b3d718b634 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:31.997153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37313543-59a5-4732-a22c-c0b3d718b634 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:31.998960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37313543-59a5-4732-a22c-c0b3d718b634 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:32.001170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:32.105706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 437/865] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:51:32.113994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46339ae-2a33-4a39-9719-3135d87d5f5b None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:32.120440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:32.290515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46339ae-2a33-4a39-9719-3135d87d5f5b None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:32.315924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a4ccf-09ef-4c80-88c5-79b0c0544c91 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:32.316299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a4ccf-09ef-4c80-88c5-79b0c0544c91 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:32.316581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a4ccf-09ef-4c80-88c5-79b0c0544c91 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:32.318874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 438/866] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:32.324431 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2588c-45a2-41a7-b187-e75e9b87e4d6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:32.324723 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2588c-45a2-41a7-b187-e75e9b87e4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:32.325005 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2588c-45a2-41a7-b187-e75e9b87e4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:32.345819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8ee2588c-45a2-41a7-b187-e75e9b87e4d6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:32.347039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8ee2588c-45a2-41a7-b187-e75e9b87e4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:32.350438 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da5436-4d47-4e9e-89ba-64cff4c1a878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:32.351717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da5436-4d47-4e9e-89ba-64cff4c1a878 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:32.352208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da5436-4d47-4e9e-89ba-64cff4c1a878 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:32.352685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da5436-4d47-4e9e-89ba-64cff4c1a878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:32.373524 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da5436-4d47-4e9e-89ba-64cff4c1a878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:32.376030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da5436-4d47-4e9e-89ba-64cff4c1a878 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-f2da5436-4d47-4e9e-89ba-64cff4c1a878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:32.403006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:32.404052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:32.404930 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:32.404930 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:32.404930 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:32.405638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 429/867] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:32.414312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da5436-4d47-4e9e-89ba-64cff4c1a878 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:32.455835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 439/868] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:51:32.479600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2588c-45a2-41a7-b187-e75e9b87e4d6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:32.489226 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:32.520347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:32.537790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da5436-4d47-4e9e-89ba-64cff4c1a878 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:32.576733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf8f9f-7aba-4a9e-8f02-42ad165aaf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:32.577447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf8f9f-7aba-4a9e-8f02-42ad165aaf97 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:32.577650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf8f9f-7aba-4a9e-8f02-42ad165aaf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:32.577954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf8f9f-7aba-4a9e-8f02-42ad165aaf97 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:32.578542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf8f9f-7aba-4a9e-8f02-42ad165aaf97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:32.578840 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf8f9f-7aba-4a9e-8f02-42ad165aaf97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:32.580249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf8f9f-7aba-4a9e-8f02-42ad165aaf97 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:32.593320 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 430/869] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:32.594707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259634-229d-4bdd-9a26-15ced19ab834 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:32.594893 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259634-229d-4bdd-9a26-15ced19ab834 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:32.595139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259634-229d-4bdd-9a26-15ced19ab834 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:32.596539 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 431/870] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:32.601294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de259634-229d-4bdd-9a26-15ced19ab834 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:32.608660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2588c-45a2-41a7-b187-e75e9b87e4d6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:32.646709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330874a-3c40-4fe7-a1be-2ae991eaf8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:32.647271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330874a-3c40-4fe7-a1be-2ae991eaf8b8 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:32.647530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330874a-3c40-4fe7-a1be-2ae991eaf8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:32.647837 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330874a-3c40-4fe7-a1be-2ae991eaf8b8 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:32.648510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330874a-3c40-4fe7-a1be-2ae991eaf8b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:32.649891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330874a-3c40-4fe7-a1be-2ae991eaf8b8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:32.675286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 440/871] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:51:32 2022] POST /identity/v3/services => generated 269 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:51:32.678207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52704710-32c2-40b4-b4c5-7434f24ee90f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:32.678963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52704710-32c2-40b4-b4c5-7434f24ee90f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:32.679420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52704710-32c2-40b4-b4c5-7434f24ee90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:32.709335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-52704710-32c2-40b4-b4c5-7434f24ee90f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:32.711236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-52704710-32c2-40b4-b4c5-7434f24ee90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:32.788165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de259634-229d-4bdd-9a26-15ced19ab834 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:32.805582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:32.850338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bc8f7-0670-45c8-92cb-4e633105eb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:32.851282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bc8f7-0670-45c8-92cb-4e633105eb18 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:32.851568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bc8f7-0670-45c8-92cb-4e633105eb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:32.851897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bc8f7-0670-45c8-92cb-4e633105eb18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:32.860119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bc8f7-0670-45c8-92cb-4e633105eb18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:32.860579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 441/872] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:32 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:32.862240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bc8f7-0670-45c8-92cb-4e633105eb18 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:32.877928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52704710-32c2-40b4-b4c5-7434f24ee90f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-f61bc8f7-0670-45c8-92cb-4e633105eb18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:32.892354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:32.893484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:32.894565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:32.894565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:32.894565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:32.894565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:32.894565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:32.894565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:32.894565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:32.894565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:32.894565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 432/873] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:32.900931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bc8f7-0670-45c8-92cb-4e633105eb18 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:32.918517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:33.016231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52704710-32c2-40b4-b4c5-7434f24ee90f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:33.055573 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d8607-27f4-4d27-af8c-f9588cbca248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:33.056567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d8607-27f4-4d27-af8c-f9588cbca248 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:33.056567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d8607-27f4-4d27-af8c-f9588cbca248 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:33.056867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d8607-27f4-4d27-af8c-f9588cbca248 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:33.057500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d8607-27f4-4d27-af8c-f9588cbca248 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:33.058884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d8607-27f4-4d27-af8c-f9588cbca248 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:33.079922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 442/874] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:51:32 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:51:33.097869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bc8f7-0670-45c8-92cb-4e633105eb18 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:33.160269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99172286-c490-4278-afe2-6d435fd3f487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:33.163118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99172286-c490-4278-afe2-6d435fd3f487 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:33.163927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99172286-c490-4278-afe2-6d435fd3f487 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:33.164772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99172286-c490-4278-afe2-6d435fd3f487 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:33.166316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99172286-c490-4278-afe2-6d435fd3f487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:33.167110 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99172286-c490-4278-afe2-6d435fd3f487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:33.169874 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99172286-c490-4278-afe2-6d435fd3f487 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:33.187541 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 433/875] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:33.194298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d8607-27f4-4d27-af8c-f9588cbca248 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:33.209370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4143a-a854-4c99-ba0d-604a088c7ca2 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:33.210025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4143a-a854-4c99-ba0d-604a088c7ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:33.210571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4143a-a854-4c99-ba0d-604a088c7ca2 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:33.212620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 434/876] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:51:33.220590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95019d64-82c5-4a46-b30d-ea85215331f2 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:33.221221 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95019d64-82c5-4a46-b30d-ea85215331f2 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:33.221741 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95019d64-82c5-4a46-b30d-ea85215331f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:33.242600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-95019d64-82c5-4a46-b30d-ea85215331f2 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:33.244475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-95019d64-82c5-4a46-b30d-ea85215331f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:33.278851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:33.307246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:33.341697 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 435/877] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:51:33.345743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d8607-27f4-4d27-af8c-f9588cbca248 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:33.366256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95019d64-82c5-4a46-b30d-ea85215331f2 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:33.421880 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e24efa-e41f-456f-8af6-7f6f65b2a3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:33.422842 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e24efa-e41f-456f-8af6-7f6f65b2a3aa None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:33.423228 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e24efa-e41f-456f-8af6-7f6f65b2a3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:33.424033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e24efa-e41f-456f-8af6-7f6f65b2a3aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:33.424788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e24efa-e41f-456f-8af6-7f6f65b2a3aa None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=15690a9236a74f518837f7d47d9797b1) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:33.425102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e24efa-e41f-456f-8af6-7f6f65b2a3aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:33.426899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e24efa-e41f-456f-8af6-7f6f65b2a3aa None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:33.439216 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 443/878] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:33 2022] GET /identity/v3/role_assignments?user.id=15690a9236a74f518837f7d47d9797b1&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:33.510832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95019d64-82c5-4a46-b30d-ea85215331f2 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:33.552548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6f963-0c28-4c97-9225-4de56014cd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:33.553525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f963-0c28-4c97-9225-4de56014cd0c None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:33.554228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f963-0c28-4c97-9225-4de56014cd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:33.554710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f963-0c28-4c97-9225-4de56014cd0c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:33.555491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6f963-0c28-4c97-9225-4de56014cd0c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:33.557106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6f963-0c28-4c97-9225-4de56014cd0c None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-d1b6f963-0c28-4c97-9225-4de56014cd0c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:33.567297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:33.569008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:33.569839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:33.572439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 436/879] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 10 07:51:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:33.581416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e24efa-e41f-456f-8af6-7f6f65b2a3aa None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:33.711026 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e24efa-e41f-456f-8af6-7f6f65b2a3aa None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:33.770504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96d867-e0a6-466f-8019-894406ea71cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:33.771926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96d867-e0a6-466f-8019-894406ea71cf None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:33.772566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96d867-e0a6-466f-8019-894406ea71cf None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:33.773164 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96d867-e0a6-466f-8019-894406ea71cf None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:33.774312 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96d867-e0a6-466f-8019-894406ea71cf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:33.774945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96d867-e0a6-466f-8019-894406ea71cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:33.777807 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96d867-e0a6-466f-8019-894406ea71cf None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:33.784035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 444/880] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Aug 10 07:51:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:33.793034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6f963-0c28-4c97-9225-4de56014cd0c None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:33.835092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:33.937577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6f963-0c28-4c97-9225-4de56014cd0c None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:33.973638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd490c9-20b9-4c35-8ccb-57c3acf05ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:33.974680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd490c9-20b9-4c35-8ccb-57c3acf05ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:33.974964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd490c9-20b9-4c35-8ccb-57c3acf05ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:33.975237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd490c9-20b9-4c35-8ccb-57c3acf05ed7 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:33.975915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd490c9-20b9-4c35-8ccb-57c3acf05ed7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:33.976218 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd490c9-20b9-4c35-8ccb-57c3acf05ed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:33.977668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd490c9-20b9-4c35-8ccb-57c3acf05ed7 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:33.983224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 437/881] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Aug 10 07:51:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:35.087998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c839-84d8-4785-b4ab-05b59669cfb3 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:35.088818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c839-84d8-4785-b4ab-05b59669cfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:35.088960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c839-84d8-4785-b4ab-05b59669cfb3 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:35.091475 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 445/882] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:35.098704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e32294-2210-4d70-bd05-12004cae98ae None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:35.099825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e32294-2210-4d70-bd05-12004cae98ae None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:35.099933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e32294-2210-4d70-bd05-12004cae98ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:35.118868 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b8e32294-2210-4d70-bd05-12004cae98ae None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:35.120111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b8e32294-2210-4d70-bd05-12004cae98ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:35.207849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 438/883] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:35.226948 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0c839-84d8-4785-b4ab-05b59669cfb3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:35.242667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:35.364708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0c839-84d8-4785-b4ab-05b59669cfb3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:35.405249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7a967-db8b-4b36-a270-e19cd9d43bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:35.406275 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7a967-db8b-4b36-a270-e19cd9d43bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:35.406749 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7a967-db8b-4b36-a270-e19cd9d43bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:35.407191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7a967-db8b-4b36-a270-e19cd9d43bb0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:35.408116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7a967-db8b-4b36-a270-e19cd9d43bb0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:35.409527 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7a967-db8b-4b36-a270-e19cd9d43bb0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-71c7a967-db8b-4b36-a270-e19cd9d43bb0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:35.419503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:35.420519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:35.421394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 446/884] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Aug 10 07:51:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:35.427902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e32294-2210-4d70-bd05-12004cae98ae None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:35.446227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:35.534581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e32294-2210-4d70-bd05-12004cae98ae None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:35.570491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329feaf-c21f-4602-ae0f-8f64b5988a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:35.571117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329feaf-c21f-4602-ae0f-8f64b5988a23 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:35.571399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329feaf-c21f-4602-ae0f-8f64b5988a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:35.571673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329feaf-c21f-4602-ae0f-8f64b5988a23 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:35.572354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329feaf-c21f-4602-ae0f-8f64b5988a23 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:35.572660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329feaf-c21f-4602-ae0f-8f64b5988a23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:35.574042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329feaf-c21f-4602-ae0f-8f64b5988a23 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:35.583844 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 439/885] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 10 07:51:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:35.585931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7a967-db8b-4b36-a270-e19cd9d43bb0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:35.665329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:35.691043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7a967-db8b-4b36-a270-e19cd9d43bb0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:35.726486 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0a105-4032-4c02-a6f6-a7a7cca3dd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:35.727214 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0a105-4032-4c02-a6f6-a7a7cca3dd38 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:35.727498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0a105-4032-4c02-a6f6-a7a7cca3dd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:35.727864 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0a105-4032-4c02-a6f6-a7a7cca3dd38 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:35.728503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0a105-4032-4c02-a6f6-a7a7cca3dd38 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:35.728804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0a105-4032-4c02-a6f6-a7a7cca3dd38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:35.730174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0a105-4032-4c02-a6f6-a7a7cca3dd38 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:35.739984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 447/886] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 10 07:51:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:35.741958 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329feaf-c21f-4602-ae0f-8f64b5988a23 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:35.838965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:35.852167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853a8f6-6250-4610-9700-1df2ae92a041 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:35.852815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853a8f6-6250-4610-9700-1df2ae92a041 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:35.853421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853a8f6-6250-4610-9700-1df2ae92a041 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:35.855323 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 448/887] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:51:35.861462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140dddc-726b-4511-9297-867597d615cc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:35.862080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140dddc-726b-4511-9297-867597d615cc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:35.862593 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140dddc-726b-4511-9297-867597d615cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:35.865340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329feaf-c21f-4602-ae0f-8f64b5988a23 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:35.884458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9140dddc-726b-4511-9297-867597d615cc None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:35.886022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9140dddc-726b-4511-9297-867597d615cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:35.902372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5a589-ce2a-47ab-a49e-124ecd07aed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:35.903003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5a589-ce2a-47ab-a49e-124ecd07aed3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:35.903288 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5a589-ce2a-47ab-a49e-124ecd07aed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:35.903564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5a589-ce2a-47ab-a49e-124ecd07aed3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:35.904334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5a589-ce2a-47ab-a49e-124ecd07aed3 None admin] RBAC: Adding query filter params (interface=public, service_id=c1893199c9fa4cb6a583326bfe524a32, region_id=RegionOne) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:35.904640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5a589-ce2a-47ab-a49e-124ecd07aed3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:35.906031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5a589-ce2a-47ab-a49e-124ecd07aed3 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:35.919408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 440/888] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 10 07:51:35 2022] GET /identity/v3/endpoints?service_id=c1893199c9fa4cb6a583326bfe524a32&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:35.920890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5a589-ce2a-47ab-a49e-124ecd07aed3 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:36.016165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 449/889] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:51:36.031315 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140dddc-726b-4511-9297-867597d615cc None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:36.032684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5a589-ce2a-47ab-a49e-124ecd07aed3 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:36.083311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40360a-0c83-404c-b657-244bdeca678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:36.084130 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40360a-0c83-404c-b657-244bdeca678e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:36.084511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40360a-0c83-404c-b657-244bdeca678e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:36.084878 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40360a-0c83-404c-b657-244bdeca678e None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:36.085593 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40360a-0c83-404c-b657-244bdeca678e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:36.087055 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40360a-0c83-404c-b657-244bdeca678e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:36.097595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 441/890] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 10 07:51:35 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:51:36.124843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:36.168596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140dddc-726b-4511-9297-867597d615cc None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:36.178613 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afa9fb-7d01-40bb-afa2-69a8504fe54a None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:36.179886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afa9fb-7d01-40bb-afa2-69a8504fe54a None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:36.180384 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afa9fb-7d01-40bb-afa2-69a8504fe54a None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:36.182326 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 442/891] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:51:36.188210 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bb406-f62d-4c57-8ce3-fa60064f9a83 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:36.188839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bb406-f62d-4c57-8ce3-fa60064f9a83 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:36.189348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bb406-f62d-4c57-8ce3-fa60064f9a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:36.214834 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-0b8bb406-f62d-4c57-8ce3-fa60064f9a83 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:36.216932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0b8bb406-f62d-4c57-8ce3-fa60064f9a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:36.219601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:36.230756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20d7ee-72d1-4957-9761-efc1c6f89bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:36.230756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20d7ee-72d1-4957-9761-efc1c6f89bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:36.230756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20d7ee-72d1-4957-9761-efc1c6f89bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:36.230756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20d7ee-72d1-4957-9761-efc1c6f89bc8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:36.231353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20d7ee-72d1-4957-9761-efc1c6f89bc8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:36.231353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20d7ee-72d1-4957-9761-efc1c6f89bc8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-bf20d7ee-72d1-4957-9761-efc1c6f89bc8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:36.239834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:36.241813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:51:36.243571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:36.246733 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 450/892] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:51:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:36.258989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20d7ee-72d1-4957-9761-efc1c6f89bc8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:36.347122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 443/893] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:51:36.371045 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bb406-f62d-4c57-8ce3-fa60064f9a83 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:36.407170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20d7ee-72d1-4957-9761-efc1c6f89bc8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:36.444953 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:36.452784 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e5a10-737b-4fbc-b068-93049595f3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:36.454462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e5a10-737b-4fbc-b068-93049595f3cd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:36.454745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e5a10-737b-4fbc-b068-93049595f3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:36.455016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e5a10-737b-4fbc-b068-93049595f3cd None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:36.455673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e5a10-737b-4fbc-b068-93049595f3cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:36.456018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e5a10-737b-4fbc-b068-93049595f3cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:36.457422 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e5a10-737b-4fbc-b068-93049595f3cd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:36.467910 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 451/894] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:51:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:36.469241 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0b727-65b2-40ac-b591-156f38f5acc7 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:36.469529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0b727-65b2-40ac-b591-156f38f5acc7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:36.469808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0b727-65b2-40ac-b591-156f38f5acc7 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:36.471777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 452/895] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:36.471777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0b727-65b2-40ac-b591-156f38f5acc7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:36.500501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bb406-f62d-4c57-8ce3-fa60064f9a83 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:36.537659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d7b7b-863c-437c-812e-898b2def570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:36.538276 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d7b7b-863c-437c-812e-898b2def570b None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:36.538555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d7b7b-863c-437c-812e-898b2def570b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:36.538824 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d7b7b-863c-437c-812e-898b2def570b None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:36.540000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d7b7b-863c-437c-812e-898b2def570b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:36.540957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d7b7b-863c-437c-812e-898b2def570b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:36.551459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:36.560178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 444/896] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:51:36 2022] POST /identity/v3/services => generated 241 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:51:36.561483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e30d8-6fde-491f-a577-f375439322cd None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:36.562094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e30d8-6fde-491f-a577-f375439322cd None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:36.562425 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e30d8-6fde-491f-a577-f375439322cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:36.586066 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-368e30d8-6fde-491f-a577-f375439322cd None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:36.587468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-368e30d8-6fde-491f-a577-f375439322cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:36.610936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0b727-65b2-40ac-b591-156f38f5acc7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:36.652835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710cf25-5092-4780-8f40-b2c116974576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:36.653719 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710cf25-5092-4780-8f40-b2c116974576 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:36.654170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710cf25-5092-4780-8f40-b2c116974576 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:36.654587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710cf25-5092-4780-8f40-b2c116974576 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:36.655400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710cf25-5092-4780-8f40-b2c116974576 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:36.656174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710cf25-5092-4780-8f40-b2c116974576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:36.657749 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710cf25-5092-4780-8f40-b2c116974576 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:36.669694 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 453/897] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:51:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:36.675162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710cf25-5092-4780-8f40-b2c116974576 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:36.700226 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 445/898] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:36.732640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e30d8-6fde-491f-a577-f375439322cd None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:36.759968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:36.824046 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710cf25-5092-4780-8f40-b2c116974576 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:36.868131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc94a75-38ed-40a0-8599-7111c8fc9b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:36.869150 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc94a75-38ed-40a0-8599-7111c8fc9b5c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:36.869632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc94a75-38ed-40a0-8599-7111c8fc9b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:36.870104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc94a75-38ed-40a0-8599-7111c8fc9b5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:36.871025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc94a75-38ed-40a0-8599-7111c8fc9b5c None admin] RBAC: Adding query filter params (interface=public, service_id=581c4d777a4e467cbf7667132a173cd7, region_id=RegionOne) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:36.871555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc94a75-38ed-40a0-8599-7111c8fc9b5c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:36.873320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc94a75-38ed-40a0-8599-7111c8fc9b5c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:36.880901 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 454/899] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 10 07:51:36 2022] GET /identity/v3/endpoints?service_id=581c4d777a4e467cbf7667132a173cd7&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:36.887712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc94a75-38ed-40a0-8599-7111c8fc9b5c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:36.898268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e30d8-6fde-491f-a577-f375439322cd None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:36.960472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:36.983090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc189b4-65b8-4149-aa33-87bc5a9b212a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:36.984475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc189b4-65b8-4149-aa33-87bc5a9b212a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:36.985018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc189b4-65b8-4149-aa33-87bc5a9b212a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:36.987045 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc189b4-65b8-4149-aa33-87bc5a9b212a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:37.008479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc189b4-65b8-4149-aa33-87bc5a9b212a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-0cc189b4-65b8-4149-aa33-87bc5a9b212a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:37.013353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:37.014408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:37.015992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:37.015992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:37.015992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:37.015992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:37.015992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:37.015992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:37.015992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:37.015992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:37.015992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:37.015992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:37.015992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:51:37.015992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:37.019617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 446/900] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Aug 10 07:51:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:37.021558 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc189b4-65b8-4149-aa33-87bc5a9b212a None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:37.053367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc94a75-38ed-40a0-8599-7111c8fc9b5c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:37.080057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:37.106598 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b89c51-d0ab-4d1d-a100-428e7483ba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:37.107587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b89c51-d0ab-4d1d-a100-428e7483ba50 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:37.108127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b89c51-d0ab-4d1d-a100-428e7483ba50 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:37.108598 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b89c51-d0ab-4d1d-a100-428e7483ba50 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:37.109407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b89c51-d0ab-4d1d-a100-428e7483ba50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:37.110992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b89c51-d0ab-4d1d-a100-428e7483ba50 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:37.119872 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 455/901] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 10 07:51:36 2022] GET /identity/v3/services => generated 1497 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 07:51:37.189507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc189b4-65b8-4149-aa33-87bc5a9b212a None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:37.233217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a58e6-71cd-4ed8-ad71-2121f24ff36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:37.233851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a58e6-71cd-4ed8-ad71-2121f24ff36e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:37.234136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a58e6-71cd-4ed8-ad71-2121f24ff36e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:37.234450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a58e6-71cd-4ed8-ad71-2121f24ff36e None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:37.235103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a58e6-71cd-4ed8-ad71-2121f24ff36e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:37.235407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a58e6-71cd-4ed8-ad71-2121f24ff36e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:37.236975 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a58e6-71cd-4ed8-ad71-2121f24ff36e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:37.247213 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 447/902] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Aug 10 07:51:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:37.253190 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b89c51-d0ab-4d1d-a100-428e7483ba50 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:37.376325 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b89c51-d0ab-4d1d-a100-428e7483ba50 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:37.422715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc8e64-a78d-425b-94ec-4b6300265bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:37.423373 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc8e64-a78d-425b-94ec-4b6300265bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:37.423654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc8e64-a78d-425b-94ec-4b6300265bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:37.423958 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc8e64-a78d-425b-94ec-4b6300265bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:37.436835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc8e64-a78d-425b-94ec-4b6300265bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:37.438309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc8e64-a78d-425b-94ec-4b6300265bd7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-43bc8e64-a78d-425b-94ec-4b6300265bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:37.455379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:37.456375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:37.457229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:37.457229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:37.457229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:37.457229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 456/903] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:37.463503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a58e6-71cd-4ed8-ad71-2121f24ff36e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:37.520598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:37.575394 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a58e6-71cd-4ed8-ad71-2121f24ff36e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:37.612034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32a918-3eb4-45dc-a7eb-9633cc7a11d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:37.612645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32a918-3eb4-45dc-a7eb-9633cc7a11d4 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:37.612926 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32a918-3eb4-45dc-a7eb-9633cc7a11d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:37.613199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32a918-3eb4-45dc-a7eb-9633cc7a11d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:37.613851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32a918-3eb4-45dc-a7eb-9633cc7a11d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:37.614151 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32a918-3eb4-45dc-a7eb-9633cc7a11d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:37.616102 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32a918-3eb4-45dc-a7eb-9633cc7a11d4 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:37.629259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 448/904] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:37.635112 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc8e64-a78d-425b-94ec-4b6300265bd7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:37.674796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:37.744858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc8e64-a78d-425b-94ec-4b6300265bd7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:37.780856 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050baa3-e87a-4abd-a074-812dd455532d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:37.781860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050baa3-e87a-4abd-a074-812dd455532d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:37.782349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050baa3-e87a-4abd-a074-812dd455532d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:37.782814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050baa3-e87a-4abd-a074-812dd455532d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:37.791140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050baa3-e87a-4abd-a074-812dd455532d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:37.792900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050baa3-e87a-4abd-a074-812dd455532d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-8050baa3-e87a-4abd-a074-812dd455532d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:37.805456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:37.806383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:37.807290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:37.807290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:37.807290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:37.807290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:37.807290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:37.807290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:37.807290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:37.807290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:37.807290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:51:37.807290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:37.809816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 457/905] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Aug 10 07:51:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:37.819780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32a918-3eb4-45dc-a7eb-9633cc7a11d4 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:37.927785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32a918-3eb4-45dc-a7eb-9633cc7a11d4 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:37.948275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:37.969137 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4fe7-6703-4721-b764-12a5068a33cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:37.969802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4fe7-6703-4721-b764-12a5068a33cc None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:37.970088 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4fe7-6703-4721-b764-12a5068a33cc None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:37.970364 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4fe7-6703-4721-b764-12a5068a33cc None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:37.971107 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d4fe7-6703-4721-b764-12a5068a33cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:37.971421 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d4fe7-6703-4721-b764-12a5068a33cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:37.972977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d4fe7-6703-4721-b764-12a5068a33cc None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:37.993847 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 449/906] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Aug 10 07:51:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:37.999656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050baa3-e87a-4abd-a074-812dd455532d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:38.111745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:38.117988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050baa3-e87a-4abd-a074-812dd455532d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:38.154327 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16a25e-a2dd-4fa8-a750-e40d73cd07c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:38.154937 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16a25e-a2dd-4fa8-a750-e40d73cd07c3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:38.155213 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16a25e-a2dd-4fa8-a750-e40d73cd07c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:38.155482 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16a25e-a2dd-4fa8-a750-e40d73cd07c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:38.229710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16a25e-a2dd-4fa8-a750-e40d73cd07c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:38.231176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16a25e-a2dd-4fa8-a750-e40d73cd07c3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:38.330366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:38.338091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 458/907] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:37 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:51:38.344386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4fe7-6703-4721-b764-12a5068a33cc None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:38.454633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4fe7-6703-4721-b764-12a5068a33cc None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:38.492078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfc01d-a5db-4db1-9294-ba3032a3bbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:38.493208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfc01d-a5db-4db1-9294-ba3032a3bbbc None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:38.493696 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfc01d-a5db-4db1-9294-ba3032a3bbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:38.494192 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfc01d-a5db-4db1-9294-ba3032a3bbbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:38.506294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfc01d-a5db-4db1-9294-ba3032a3bbbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:38.508204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfc01d-a5db-4db1-9294-ba3032a3bbbc None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-19dfc01d-a5db-4db1-9294-ba3032a3bbbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:38.524907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:38.525904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:38.526808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:38.526808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:38.526808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:38.529085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 450/908] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:38.535400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16a25e-a2dd-4fa8-a750-e40d73cd07c3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:38.605357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbbbe6-036d-4bc8-bfb7-666ab3e35462 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:38.606244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbbbe6-036d-4bc8-bfb7-666ab3e35462 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:38.607257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbbbe6-036d-4bc8-bfb7-666ab3e35462 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:38.609771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 451/909] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:38.617449 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a91248-39a9-4212-90c2-786f16c7c210 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:38.617760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a91248-39a9-4212-90c2-786f16c7c210 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:38.618006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a91248-39a9-4212-90c2-786f16c7c210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:38.636971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-c7a91248-39a9-4212-90c2-786f16c7c210 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:38.638163 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-c7a91248-39a9-4212-90c2-786f16c7c210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:38.660200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:38.667583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16a25e-a2dd-4fa8-a750-e40d73cd07c3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:38.712720 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1f2e5-0a26-406d-98df-8fb94224e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:38.713441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1f2e5-0a26-406d-98df-8fb94224e36a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:38.713751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1f2e5-0a26-406d-98df-8fb94224e36a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:38.714028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1f2e5-0a26-406d-98df-8fb94224e36a None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:38.714794 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1f2e5-0a26-406d-98df-8fb94224e36a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:38.715203 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1f2e5-0a26-406d-98df-8fb94224e36a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:38.716646 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1f2e5-0a26-406d-98df-8fb94224e36a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:38.727628 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 452/910] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:38.734212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 459/911] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:38.740909 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a91248-39a9-4212-90c2-786f16c7c210 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:38.747792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1f2e5-0a26-406d-98df-8fb94224e36a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:38.826461 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:38.854174 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a91248-39a9-4212-90c2-786f16c7c210 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:38.888288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1f2e5-0a26-406d-98df-8fb94224e36a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:38.903073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22080d-5c48-49d6-a6e1-3599409a208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:38.903717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22080d-5c48-49d6-a6e1-3599409a208d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:38.904041 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22080d-5c48-49d6-a6e1-3599409a208d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:38.904314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22080d-5c48-49d6-a6e1-3599409a208d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:38.915348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22080d-5c48-49d6-a6e1-3599409a208d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:38.916979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22080d-5c48-49d6-a6e1-3599409a208d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:38.927681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9121d15-c74b-40f8-8f2d-b6d55b1e697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:38.928350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9121d15-c74b-40f8-8f2d-b6d55b1e697e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:38.928923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9121d15-c74b-40f8-8f2d-b6d55b1e697e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-da22080d-5c48-49d6-a6e1-3599409a208d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:38.929022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:38.929876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:38.930829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:38.930829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:38.930829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:38.930829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:38.930829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:38.930829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:38.930829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:38.930829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:38.931247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9121d15-c74b-40f8-8f2d-b6d55b1e697e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:38.931247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9121d15-c74b-40f8-8f2d-b6d55b1e697e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:38.931381 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 453/912] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:38.931973 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faf00e-3361-4bdf-990a-b59d762323ff None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:38.932088 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faf00e-3361-4bdf-990a-b59d762323ff None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:38.932322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faf00e-3361-4bdf-990a-b59d762323ff None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:38.933705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 454/913] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:38.936122 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9121d15-c74b-40f8-8f2d-b6d55b1e697e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:38.937037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faf00e-3361-4bdf-990a-b59d762323ff None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e9121d15-c74b-40f8-8f2d-b6d55b1e697e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:38.946550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:38.947757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:51:38.948859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:38.952586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 460/914] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Aug 10 07:51:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:38.954023 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a58e8-e604-4980-b0c1-1d4501d8a85c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:38.954185 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a58e8-e604-4980-b0c1-1d4501d8a85c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:38.954463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a58e8-e604-4980-b0c1-1d4501d8a85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:38.955992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:38.974505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-016a58e8-e604-4980-b0c1-1d4501d8a85c None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:38.975749 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-016a58e8-e604-4980-b0c1-1d4501d8a85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:39.055063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 461/915] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:39.056095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a58e8-e604-4980-b0c1-1d4501d8a85c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:39.081332 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faf00e-3361-4bdf-990a-b59d762323ff None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:39.118458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1cf54-0c56-4580-85a6-fb54f80258f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:39.119077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1cf54-0c56-4580-85a6-fb54f80258f0 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:39.119364 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1cf54-0c56-4580-85a6-fb54f80258f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:39.119639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1cf54-0c56-4580-85a6-fb54f80258f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:39.120484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1cf54-0c56-4580-85a6-fb54f80258f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:39.120795 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1cf54-0c56-4580-85a6-fb54f80258f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:39.122219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1cf54-0c56-4580-85a6-fb54f80258f0 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:39.126882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:39.144604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 455/916] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:39.144604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1cf54-0c56-4580-85a6-fb54f80258f0 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:39.203889 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a58e8-e604-4980-b0c1-1d4501d8a85c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:39.226707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:39.242351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecde50-8b1a-4341-be17-efa8726cd69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:39.243021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecde50-8b1a-4341-be17-efa8726cd69a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:39.243465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecde50-8b1a-4341-be17-efa8726cd69a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:39.243752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecde50-8b1a-4341-be17-efa8726cd69a None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:39.244425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecde50-8b1a-4341-be17-efa8726cd69a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:39.244713 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecde50-8b1a-4341-be17-efa8726cd69a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:39.246099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecde50-8b1a-4341-be17-efa8726cd69a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:39.252275 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 462/917] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 10 07:51:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:39.253208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecde50-8b1a-4341-be17-efa8726cd69a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:39.268087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1cf54-0c56-4580-85a6-fb54f80258f0 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:39.313423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d08668-dc32-4cfd-b05c-ec958e506345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:39.314059 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d08668-dc32-4cfd-b05c-ec958e506345 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:39.314341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d08668-dc32-4cfd-b05c-ec958e506345 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:39.314617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d08668-dc32-4cfd-b05c-ec958e506345 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:39.315208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d08668-dc32-4cfd-b05c-ec958e506345 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:39.316620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d08668-dc32-4cfd-b05c-ec958e506345 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-08d08668-dc32-4cfd-b05c-ec958e506345 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:39.326415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:39.327424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:39.328319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 456/918] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 10 07:51:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:39.329419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d08668-dc32-4cfd-b05c-ec958e506345 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:39.367498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecde50-8b1a-4341-be17-efa8726cd69a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:39.382464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:39.403618 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339909b3-22e3-4f5e-9f58-87300a1df6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:39.404172 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339909b3-22e3-4f5e-9f58-87300a1df6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:39.404459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339909b3-22e3-4f5e-9f58-87300a1df6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:39.404940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339909b3-22e3-4f5e-9f58-87300a1df6e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:39.406060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339909b3-22e3-4f5e-9f58-87300a1df6e0 None admin] RBAC: Adding query filter params (role.id=bfd0f20224c5406491b85c14c4641a29, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=15690a9236a74f518837f7d47d9797b1) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:39.406060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339909b3-22e3-4f5e-9f58-87300a1df6e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:39.407154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339909b3-22e3-4f5e-9f58-87300a1df6e0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:39.423762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 463/919] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:39 2022] GET /identity/v3/role_assignments?user.id=15690a9236a74f518837f7d47d9797b1&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=bfd0f20224c5406491b85c14c4641a29 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:39.423762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb43545-9215-457f-af39-7aabaeb5e1b1 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:39.423762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb43545-9215-457f-af39-7aabaeb5e1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:39.423762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb43545-9215-457f-af39-7aabaeb5e1b1 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:39.423762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 464/920] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:39.423762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb43545-9215-457f-af39-7aabaeb5e1b1 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:39.446037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d08668-dc32-4cfd-b05c-ec958e506345 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:39.484211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1e2bf-b724-4996-87f9-9802fbd43196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:39.484837 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e2bf-b724-4996-87f9-9802fbd43196 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:39.485115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e2bf-b724-4996-87f9-9802fbd43196 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:39.485385 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e2bf-b724-4996-87f9-9802fbd43196 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:39.486039 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1e2bf-b724-4996-87f9-9802fbd43196 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:39.486343 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1e2bf-b724-4996-87f9-9802fbd43196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:39.487763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1e2bf-b724-4996-87f9-9802fbd43196 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:39.494656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:39.508797 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 457/921] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 10 07:51:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:39.510505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a942d-a73d-4aca-bd5a-9cdbf9230b5d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:39.511002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a942d-a73d-4aca-bd5a-9cdbf9230b5d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:39.511477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a942d-a73d-4aca-bd5a-9cdbf9230b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:39.531612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-ab9a942d-a73d-4aca-bd5a-9cdbf9230b5d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:39.532886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ab9a942d-a73d-4aca-bd5a-9cdbf9230b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:39.549656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb43545-9215-457f-af39-7aabaeb5e1b1 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:39.601575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d004b8-0493-4455-825f-00414130ebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:39.602288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d004b8-0493-4455-825f-00414130ebf8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:39.602559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d004b8-0493-4455-825f-00414130ebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:39.602927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d004b8-0493-4455-825f-00414130ebf8 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:39.603771 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d004b8-0493-4455-825f-00414130ebf8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:39.604216 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d004b8-0493-4455-825f-00414130ebf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:39.605597 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d004b8-0493-4455-825f-00414130ebf8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:39.611835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 458/922] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:39.612552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a942d-a73d-4aca-bd5a-9cdbf9230b5d None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:39.615936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 465/923] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Aug 10 07:51:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:39.625074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d004b8-0493-4455-825f-00414130ebf8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:39.675763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:39.724565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a942d-a73d-4aca-bd5a-9cdbf9230b5d None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:39.742723 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d004b8-0493-4455-825f-00414130ebf8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:39.752852 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:39.761570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e87a1-6b11-4e3b-a717-f8f3394463ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:39.762199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e87a1-6b11-4e3b-a717-f8f3394463ad None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:39.762456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e87a1-6b11-4e3b-a717-f8f3394463ad None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:39.762727 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e87a1-6b11-4e3b-a717-f8f3394463ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:39.763391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e87a1-6b11-4e3b-a717-f8f3394463ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:39.764783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e87a1-6b11-4e3b-a717-f8f3394463ad None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:39.783816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef49ae-30c4-4cd4-9de1-cbb9d1610714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:39.784736 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef49ae-30c4-4cd4-9de1-cbb9d1610714 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:39.785196 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef49ae-30c4-4cd4-9de1-cbb9d1610714 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:39.785305 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 459/924] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 07:51:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:51:39.785708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef49ae-30c4-4cd4-9de1-cbb9d1610714 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:39.786815 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e87a1-6b11-4e3b-a717-f8f3394463ad None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:39.787187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef49ae-30c4-4cd4-9de1-cbb9d1610714 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:39.787500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef49ae-30c4-4cd4-9de1-cbb9d1610714 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:39.788961 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef49ae-30c4-4cd4-9de1-cbb9d1610714 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:39.801635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 466/925] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Aug 10 07:51:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:39.810032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef49ae-30c4-4cd4-9de1-cbb9d1610714 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:39.963498 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e87a1-6b11-4e3b-a717-f8f3394463ad None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:39.994146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef49ae-30c4-4cd4-9de1-cbb9d1610714 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:40.008285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:40.013561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8628bd6-77d9-42ea-b780-16e45da1defe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:40.014215 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8628bd6-77d9-42ea-b780-16e45da1defe None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:40.014528 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8628bd6-77d9-42ea-b780-16e45da1defe None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:40.014771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8628bd6-77d9-42ea-b780-16e45da1defe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:40.015371 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8628bd6-77d9-42ea-b780-16e45da1defe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:40.016857 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8628bd6-77d9-42ea-b780-16e45da1defe None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-c8628bd6-77d9-42ea-b780-16e45da1defe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:40.028129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:40.030026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:40.031050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 460/926] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:51:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:40.037307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8628bd6-77d9-42ea-b780-16e45da1defe None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:40.051613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb54756-ec9c-4c9d-88a0-1c819d7a3326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:40.052978 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb54756-ec9c-4c9d-88a0-1c819d7a3326 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:40.053419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb54756-ec9c-4c9d-88a0-1c819d7a3326 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:40.054349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb54756-ec9c-4c9d-88a0-1c819d7a3326 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:40.055229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb54756-ec9c-4c9d-88a0-1c819d7a3326 None admin] RBAC: Adding query filter params (interface=public, service_id=09163c86345b4a9fb9bd913b09db338f, region_id=RegionOne) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:40.056155 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb54756-ec9c-4c9d-88a0-1c819d7a3326 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:40.059237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb54756-ec9c-4c9d-88a0-1c819d7a3326 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:40.071287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 467/927] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 10 07:51:39 2022] GET /identity/v3/endpoints?service_id=09163c86345b4a9fb9bd913b09db338f&interface=public®ion_id=RegionOne => generated 194 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:40.076718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb54756-ec9c-4c9d-88a0-1c819d7a3326 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:40.100710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:40.169412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8628bd6-77d9-42ea-b780-16e45da1defe None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:40.219778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc95a3c-ad7e-472d-a426-dc33634f6ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:40.220488 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc95a3c-ad7e-472d-a426-dc33634f6ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:40.220874 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc95a3c-ad7e-472d-a426-dc33634f6ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:40.221253 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc95a3c-ad7e-472d-a426-dc33634f6ad2 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:40.222000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc95a3c-ad7e-472d-a426-dc33634f6ad2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:40.222405 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc95a3c-ad7e-472d-a426-dc33634f6ad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:40.224132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc95a3c-ad7e-472d-a426-dc33634f6ad2 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:40.224438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb54756-ec9c-4c9d-88a0-1c819d7a3326 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:40.234737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 461/928] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:51:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:40.236308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc95a3c-ad7e-472d-a426-dc33634f6ad2 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:40.272499 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ec66a-eefb-453c-86ae-48a26c6ec18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:40.273596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ec66a-eefb-453c-86ae-48a26c6ec18e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:40.274030 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ec66a-eefb-453c-86ae-48a26c6ec18e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:40.274741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ec66a-eefb-453c-86ae-48a26c6ec18e None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:40.275563 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ec66a-eefb-453c-86ae-48a26c6ec18e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:40.277669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ec66a-eefb-453c-86ae-48a26c6ec18e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:40.285267 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 468/929] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 10 07:51:40 2022] GET /identity/v3/services => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:51:40.407453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc95a3c-ad7e-472d-a426-dc33634f6ad2 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:40.428234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:40.466194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb11bb0-201d-43ec-9b42-5efda3931fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:40.467643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb11bb0-201d-43ec-9b42-5efda3931fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:40.468160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb11bb0-201d-43ec-9b42-5efda3931fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:40.468631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb11bb0-201d-43ec-9b42-5efda3931fc6 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:40.469476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb11bb0-201d-43ec-9b42-5efda3931fc6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:40.470028 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb11bb0-201d-43ec-9b42-5efda3931fc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:40.471614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb11bb0-201d-43ec-9b42-5efda3931fc6 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:40.478456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 462/930] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 10 07:51:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:40.484372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ec66a-eefb-453c-86ae-48a26c6ec18e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:40.523287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:40.596844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ec66a-eefb-453c-86ae-48a26c6ec18e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:40.636862 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c34aeb-85a4-440c-890c-30695be19642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:40.637477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c34aeb-85a4-440c-890c-30695be19642 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:40.637747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c34aeb-85a4-440c-890c-30695be19642 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:40.638009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c34aeb-85a4-440c-890c-30695be19642 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:40.638686 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c34aeb-85a4-440c-890c-30695be19642 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:40.640100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c34aeb-85a4-440c-890c-30695be19642 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:40.668521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 469/931] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 07:51:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:51:41.476258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236928af-a5a6-4a25-93f3-1fa0104bae83 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:41.476783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236928af-a5a6-4a25-93f3-1fa0104bae83 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:41.476783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236928af-a5a6-4a25-93f3-1fa0104bae83 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:41.478424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 463/932] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:41.483711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ed30-0dc9-4004-bb01-5564b65fd476 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:41.484030 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ed30-0dc9-4004-bb01-5564b65fd476 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:41.484311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ed30-0dc9-4004-bb01-5564b65fd476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:41.504477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-46b6ed30-0dc9-4004-bb01-5564b65fd476 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:41.506265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-46b6ed30-0dc9-4004-bb01-5564b65fd476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:41.585617 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 470/933] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:41.607723 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236928af-a5a6-4a25-93f3-1fa0104bae83 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:41.728010 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236928af-a5a6-4a25-93f3-1fa0104bae83 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:41.777125 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0330bd5-d95d-4c5b-8d4e-a29ba8ed6861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:41.777770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0330bd5-d95d-4c5b-8d4e-a29ba8ed6861 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:41.778056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0330bd5-d95d-4c5b-8d4e-a29ba8ed6861 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:41.778330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0330bd5-d95d-4c5b-8d4e-a29ba8ed6861 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:41.790345 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0330bd5-d95d-4c5b-8d4e-a29ba8ed6861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-a0330bd5-d95d-4c5b-8d4e-a29ba8ed6861 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:41.795105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:41.796081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:41.797075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:41.797075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:41.797075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:41.797075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:41.797075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:41.797075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:41.797075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:41.797075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:41.797075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:41.797075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:41.797075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:51:41.797075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:41.797075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 464/934] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Aug 10 07:51:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:41.803099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6ed30-0dc9-4004-bb01-5564b65fd476 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:41.836321 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:41.920869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6ed30-0dc9-4004-bb01-5564b65fd476 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:41.959066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9c58-d0b0-43cc-a6b0-1987fd48830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:41.959689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9c58-d0b0-43cc-a6b0-1987fd48830d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:41.960002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9c58-d0b0-43cc-a6b0-1987fd48830d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:41.960276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9c58-d0b0-43cc-a6b0-1987fd48830d None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:41.960957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf9c58-d0b0-43cc-a6b0-1987fd48830d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:41.961262 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf9c58-d0b0-43cc-a6b0-1987fd48830d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:41.962668 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf9c58-d0b0-43cc-a6b0-1987fd48830d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:41.972270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 471/935] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Aug 10 07:51:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:41.979312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0330bd5-d95d-4c5b-8d4e-a29ba8ed6861 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:42.029034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:42.063446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc9664-8a63-4c8a-8973-76af781f540b None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:42.063783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc9664-8a63-4c8a-8973-76af781f540b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:42.064031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc9664-8a63-4c8a-8973-76af781f540b None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:42.065852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 472/936] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:42.071359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153729c-1fc4-4066-8abd-7783569de8ee None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:42.071642 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153729c-1fc4-4066-8abd-7783569de8ee None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:42.071935 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153729c-1fc4-4066-8abd-7783569de8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:42.092524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1153729c-1fc4-4066-8abd-7783569de8ee None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:42.094205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1153729c-1fc4-4066-8abd-7783569de8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:42.106216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0330bd5-d95d-4c5b-8d4e-a29ba8ed6861 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:42.142785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d03cd-c559-4d4b-bb04-88b10ec9b2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:42.143362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d03cd-c559-4d4b-bb04-88b10ec9b2aa None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:42.143647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d03cd-c559-4d4b-bb04-88b10ec9b2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:42.143966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d03cd-c559-4d4b-bb04-88b10ec9b2aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:42.154932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d03cd-c559-4d4b-bb04-88b10ec9b2aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:42.156510 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d03cd-c559-4d4b-bb04-88b10ec9b2aa None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:42.171052 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 473/937] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-614d03cd-c559-4d4b-bb04-88b10ec9b2aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:42.172726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:42.173630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:42.174496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:42.174496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:42.174496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:42.174496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 465/938] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:42.184962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153729c-1fc4-4066-8abd-7783569de8ee None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:42.193631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d03cd-c559-4d4b-bb04-88b10ec9b2aa None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:42.200120 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:42.284228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:42.295374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153729c-1fc4-4066-8abd-7783569de8ee None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:42.301444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d03cd-c559-4d4b-bb04-88b10ec9b2aa None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:42.335420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf54721-cf02-4f30-aaae-59142fc8eabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:42.336176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf54721-cf02-4f30-aaae-59142fc8eabf None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:42.336534 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf54721-cf02-4f30-aaae-59142fc8eabf None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:42.336903 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf54721-cf02-4f30-aaae-59142fc8eabf None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:42.337633 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf54721-cf02-4f30-aaae-59142fc8eabf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:42.338009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf54721-cf02-4f30-aaae-59142fc8eabf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:42.339596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf54721-cf02-4f30-aaae-59142fc8eabf None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:42.341645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953081c-89e3-475e-97f5-d386b64037eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:42.342565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953081c-89e3-475e-97f5-d386b64037eb None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:42.342852 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953081c-89e3-475e-97f5-d386b64037eb None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:42.343135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953081c-89e3-475e-97f5-d386b64037eb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:42.343743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953081c-89e3-475e-97f5-d386b64037eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:42.345162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953081c-89e3-475e-97f5-d386b64037eb None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-9953081c-89e3-475e-97f5-d386b64037eb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:42.354476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:42.355503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:51:42.356399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:42.360433 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 474/939] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:42.360433 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf54721-cf02-4f30-aaae-59142fc8eabf None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:42.360843 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 466/940] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:42.361629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953081c-89e3-475e-97f5-d386b64037eb None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:42.442429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:42.479416 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953081c-89e3-475e-97f5-d386b64037eb None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:42.483996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf54721-cf02-4f30-aaae-59142fc8eabf None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:42.515840 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46ecc6-8feb-475b-ac5c-192d20d47ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:42.516633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46ecc6-8feb-475b-ac5c-192d20d47ace None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:42.517062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46ecc6-8feb-475b-ac5c-192d20d47ace None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:42.517365 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46ecc6-8feb-475b-ac5c-192d20d47ace None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:42.518406 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46ecc6-8feb-475b-ac5c-192d20d47ace None admin] RBAC: Adding query filter params (name=compute) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:42.518406 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46ecc6-8feb-475b-ac5c-192d20d47ace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:42.519974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46ecc6-8feb-475b-ac5c-192d20d47ace None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:42.524415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23c58c-b800-4a86-bcea-d5bbef97e777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:42.525582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23c58c-b800-4a86-bcea-d5bbef97e777 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:42.526014 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23c58c-b800-4a86-bcea-d5bbef97e777 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:42.526500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23c58c-b800-4a86-bcea-d5bbef97e777 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:42.531044 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 467/941] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 10 07:51:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:42.532033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46ecc6-8feb-475b-ac5c-192d20d47ace None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:42.537167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23c58c-b800-4a86-bcea-d5bbef97e777 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:42.538918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23c58c-b800-4a86-bcea-d5bbef97e777 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:42.548651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-bd23c58c-b800-4a86-bcea-d5bbef97e777 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:42.553310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:42.554566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:42.555533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:42.555533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:42.555533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:42.555533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:42.555533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:42.555533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:42.555533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:42.555533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:42.555533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:51:42.555533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:42.556104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 475/942] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Aug 10 07:51:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:42.560366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32dd56-b9c1-4244-93b6-3007ab92075e None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:42.560366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32dd56-b9c1-4244-93b6-3007ab92075e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:42.560366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32dd56-b9c1-4244-93b6-3007ab92075e None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:42.563844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 476/943] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:42.564504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32dd56-b9c1-4244-93b6-3007ab92075e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:42.642372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46ecc6-8feb-475b-ac5c-192d20d47ace None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:42.676114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32dd56-b9c1-4244-93b6-3007ab92075e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:42.679051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead814f-c924-4ff6-bf9c-0fd5fc6c7660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:42.679665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead814f-c924-4ff6-bf9c-0fd5fc6c7660 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:42.679974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead814f-c924-4ff6-bf9c-0fd5fc6c7660 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:42.680246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead814f-c924-4ff6-bf9c-0fd5fc6c7660 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:42.680885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead814f-c924-4ff6-bf9c-0fd5fc6c7660 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:42.681186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead814f-c924-4ff6-bf9c-0fd5fc6c7660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:42.682559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead814f-c924-4ff6-bf9c-0fd5fc6c7660 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:42.695771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 468/944] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 10 07:51:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:42.695771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b194a5b-e7b4-4ed4-98e4-8d55bd168663 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:42.695771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b194a5b-e7b4-4ed4-98e4-8d55bd168663 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:42.695771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b194a5b-e7b4-4ed4-98e4-8d55bd168663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:42.710411 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:42.713740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-3b194a5b-e7b4-4ed4-98e4-8d55bd168663 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:42.714974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-3b194a5b-e7b4-4ed4-98e4-8d55bd168663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:42.726718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3197a-191f-4301-bb67-610bd0f83b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:42.727410 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3197a-191f-4301-bb67-610bd0f83b50 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:42.727832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3197a-191f-4301-bb67-610bd0f83b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:42.728168 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3197a-191f-4301-bb67-610bd0f83b50 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:42.728924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3197a-191f-4301-bb67-610bd0f83b50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:42.729235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3197a-191f-4301-bb67-610bd0f83b50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:42.730715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3197a-191f-4301-bb67-610bd0f83b50 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:42.755866 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 477/945] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Aug 10 07:51:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:42.757901 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3197a-191f-4301-bb67-610bd0f83b50 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:42.814226 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 469/946] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:42.837211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b194a5b-e7b4-4ed4-98e4-8d55bd168663 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:42.845946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:42.880732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3197a-191f-4301-bb67-610bd0f83b50 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:42.932866 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f7d70-6191-47f0-a48f-bc99e42d256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:42.933868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f7d70-6191-47f0-a48f-bc99e42d256b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:42.934336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f7d70-6191-47f0-a48f-bc99e42d256b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:42.934794 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f7d70-6191-47f0-a48f-bc99e42d256b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:42.952895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f7d70-6191-47f0-a48f-bc99e42d256b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:42.955419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f7d70-6191-47f0-a48f-bc99e42d256b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-6c7f7d70-6191-47f0-a48f-bc99e42d256b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:42.980582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:42.982651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:42.984623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:42.984623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:42.984623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:42.984623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 478/947] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:42.985164 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32619a1-d205-4159-ae89-2a8c26157ada None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:42.985634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32619a1-d205-4159-ae89-2a8c26157ada None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:42.986071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32619a1-d205-4159-ae89-2a8c26157ada None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:42.988502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 479/948] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:42.989962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32619a1-d205-4159-ae89-2a8c26157ada None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:43.004988 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b194a5b-e7b4-4ed4-98e4-8d55bd168663 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:43.051127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:43.055407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7d584-8646-419b-8e63-50711c521eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:43.056214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7d584-8646-419b-8e63-50711c521eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:43.056482 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7d584-8646-419b-8e63-50711c521eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:43.056753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7d584-8646-419b-8e63-50711c521eb4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:43.057339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7d584-8646-419b-8e63-50711c521eb4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:43.058706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7d584-8646-419b-8e63-50711c521eb4 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-64c7d584-8646-419b-8e63-50711c521eb4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:43.068235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:43.069232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:43.070131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 470/949] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 10 07:51:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:43.070919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e65b9-7b46-42b0-8407-b62cd8de8eae None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:43.070919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e65b9-7b46-42b0-8407-b62cd8de8eae None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:43.071144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e65b9-7b46-42b0-8407-b62cd8de8eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:43.090787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b42e65b9-7b46-42b0-8407-b62cd8de8eae None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:43.092189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b42e65b9-7b46-42b0-8407-b62cd8de8eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:43.127897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32619a1-d205-4159-ae89-2a8c26157ada None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:43.160184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:43.163461 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfa732-2d47-458c-86e0-25c621cf7b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:43.164146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfa732-2d47-458c-86e0-25c621cf7b97 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:43.164427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfa732-2d47-458c-86e0-25c621cf7b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:43.164697 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfa732-2d47-458c-86e0-25c621cf7b97 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:43.165371 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfa732-2d47-458c-86e0-25c621cf7b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:43.165633 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfa732-2d47-458c-86e0-25c621cf7b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:43.167005 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfa732-2d47-458c-86e0-25c621cf7b97 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:43.167282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 471/950] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:43.168435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e65b9-7b46-42b0-8407-b62cd8de8eae None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:43.188148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 480/951] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:43.189433 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfa732-2d47-458c-86e0-25c621cf7b97 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:43.284641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e65b9-7b46-42b0-8407-b62cd8de8eae None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:43.294909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:43.300518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfa732-2d47-458c-86e0-25c621cf7b97 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:43.327722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88541b3-5e76-4a82-a318-3c88d399eaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:43.328583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88541b3-5e76-4a82-a318-3c88d399eaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:43.328879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88541b3-5e76-4a82-a318-3c88d399eaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:43.329159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88541b3-5e76-4a82-a318-3c88d399eaf2 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:43.329841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88541b3-5e76-4a82-a318-3c88d399eaf2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:43.330190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88541b3-5e76-4a82-a318-3c88d399eaf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:43.331537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88541b3-5e76-4a82-a318-3c88d399eaf2 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:43.338471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 472/952] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Aug 10 07:51:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:43.339296 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88541b3-5e76-4a82-a318-3c88d399eaf2 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:43.355697 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db27b6-51a3-48c6-8010-cdca71952720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:43.356840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db27b6-51a3-48c6-8010-cdca71952720 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:43.357136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db27b6-51a3-48c6-8010-cdca71952720 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:43.357410 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db27b6-51a3-48c6-8010-cdca71952720 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:43.364951 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db27b6-51a3-48c6-8010-cdca71952720 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:43.366413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db27b6-51a3-48c6-8010-cdca71952720 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-a3db27b6-51a3-48c6-8010-cdca71952720 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:43.378788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:43.380670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:43.381991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:43.381991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:43.381991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:43.381991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:43.381991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:43.381991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:43.381991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:43.381991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:43.381991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 481/953] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:43.381991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db27b6-51a3-48c6-8010-cdca71952720 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:43.421938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:43.484134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88541b3-5e76-4a82-a318-3c88d399eaf2 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:43.531424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f0c4a-5194-445d-ab08-a28608f3b426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:43.532074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f0c4a-5194-445d-ab08-a28608f3b426 None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:43.532362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f0c4a-5194-445d-ab08-a28608f3b426 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:43.532635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f0c4a-5194-445d-ab08-a28608f3b426 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:43.533286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f0c4a-5194-445d-ab08-a28608f3b426 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:43.534731 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f0c4a-5194-445d-ab08-a28608f3b426 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:43.537508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: WARNING keystone.server.flask.common [None req-f32f0c4a-5194-445d-ab08-a28608f3b426 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 07:51:43.545499 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db27b6-51a3-48c6-8010-cdca71952720 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:43.559230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.sql.core [None req-f32f0c4a-5194-445d-ab08-a28608f3b426 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 07:51:43.559230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 07:51:43.559230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [parameters: {'id': '7e30adaa72f14462aadcfc76d1a48b6e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 07:51:43.559230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80195) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 07:51:43.576270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-f32f0c4a-5194-445d-ab08-a28608f3b426 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7e30adaa72f14462aadcfc76d1a48b6e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7e30adaa72f14462aadcfc76d1a48b6e. Aug 10 07:51:43.576270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:43.576270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 07:51:43.576270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 07:51:43.576270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 07:51:43.576270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 07:51:43.576270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 07:51:43.576270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 07:51:43.576270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 07:51:43.576270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application conn.query(q) Aug 10 07:51:43.576270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 07:51:43.576270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 07:51:43.576270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application result.read() Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 10 07:51:43.577275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application next(self.gen) Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application yield resource Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application next(self.gen) Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise self.value Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application session.commit() Aug 10 07:51:43.578377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self.session.flush() Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application compat.raise_( Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 07:51:43.579378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 07:51:43.581011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application conn.query(q) Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application result.read() Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 07:51:43.582938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [parameters: {'id': '7e30adaa72f14462aadcfc76d1a48b6e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:43.584850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:43.585860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:43.587648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:43.587648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 10 07:51:43.587648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 10 07:51:43.587648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:43.587648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:43.587648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 10 07:51:43.587648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 10 07:51:43.587648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7e30adaa72f14462aadcfc76d1a48b6e. Aug 10 07:51:43.587648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:43.587648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 473/954] 10.222.0.30 () {60 vars in 1140 bytes} [Wed Aug 10 07:51:43 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:43.587648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f0c4a-5194-445d-ab08-a28608f3b426 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:43.599875 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3425b95-3de2-45b9-9e31-c5675ab07804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:43.600836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3425b95-3de2-45b9-9e31-c5675ab07804 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:43.601330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3425b95-3de2-45b9-9e31-c5675ab07804 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:43.601875 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3425b95-3de2-45b9-9e31-c5675ab07804 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:43.603071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3425b95-3de2-45b9-9e31-c5675ab07804 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:43.603411 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3425b95-3de2-45b9-9e31-c5675ab07804 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:43.604847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3425b95-3de2-45b9-9e31-c5675ab07804 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:43.613451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 482/955] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Aug 10 07:51:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:43.619153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3425b95-3de2-45b9-9e31-c5675ab07804 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:43.649105 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:43.713037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f0c4a-5194-445d-ab08-a28608f3b426 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:43.741907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:43.751156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3425b95-3de2-45b9-9e31-c5675ab07804 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:43.758369 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69158df-6567-4d79-980f-81eabded9840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:43.759214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69158df-6567-4d79-980f-81eabded9840 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:43.759505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69158df-6567-4d79-980f-81eabded9840 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:43.759802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69158df-6567-4d79-980f-81eabded9840 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:43.760532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69158df-6567-4d79-980f-81eabded9840 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:43.760842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69158df-6567-4d79-980f-81eabded9840 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:43.762504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69158df-6567-4d79-980f-81eabded9840 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:43.778886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 474/956] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:43.780324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69158df-6567-4d79-980f-81eabded9840 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:43.794643 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e81e0-b0ec-4a1b-af59-a952fd3560ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:43.804981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e81e0-b0ec-4a1b-af59-a952fd3560ed None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:43.804981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e81e0-b0ec-4a1b-af59-a952fd3560ed None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:43.804981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e81e0-b0ec-4a1b-af59-a952fd3560ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:43.804981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e81e0-b0ec-4a1b-af59-a952fd3560ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:43.806251 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e81e0-b0ec-4a1b-af59-a952fd3560ed None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-ef1e81e0-b0ec-4a1b-af59-a952fd3560ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:43.818514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:43.819464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:43.820440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:43.820440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:43.820440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:43.820440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:43.820440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:43.820440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:43.820440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:43.820440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:43.820440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 483/957] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:43.820440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e81e0-b0ec-4a1b-af59-a952fd3560ed None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:43.925310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:43.930963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69158df-6567-4d79-980f-81eabded9840 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:43.952575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e81e0-b0ec-4a1b-af59-a952fd3560ed None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:43.977093 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817df91-3172-40b7-bb64-a1641665a459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:43.977826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817df91-3172-40b7-bb64-a1641665a459 None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:43.978242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817df91-3172-40b7-bb64-a1641665a459 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:43.978807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817df91-3172-40b7-bb64-a1641665a459 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:43.979962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817df91-3172-40b7-bb64-a1641665a459 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:43.981655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817df91-3172-40b7-bb64-a1641665a459 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:43.993754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b93af-a18a-4909-9a05-40c10d61f5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:43.994427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b93af-a18a-4909-9a05-40c10d61f5ef None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:43.994811 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b93af-a18a-4909-9a05-40c10d61f5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:43.995088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b93af-a18a-4909-9a05-40c10d61f5ef None admin] PATH_INFO: `/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/15690a9236a74f518837f7d47d9797b1/roles/bfd0f20224c5406491b85c14c4641a29` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:43.997833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b93af-a18a-4909-9a05-40c10d61f5ef None admin] RBAC: Authorizing `identity:create_grant(project_id=bad7eba8964f4acf9c6c1397df7cd1dd, user_id=15690a9236a74f518837f7d47d9797b1, role_id=bfd0f20224c5406491b85c14c4641a29)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:43.999795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b93af-a18a-4909-9a05-40c10d61f5ef None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:44.018722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 475/958] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 07:51:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:51:44.018722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817df91-3172-40b7-bb64-a1641665a459 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:44.021864 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 484/959] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:51:43 2022] PUT /identity/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/15690a9236a74f518837f7d47d9797b1/roles/bfd0f20224c5406491b85c14c4641a29 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:51:44.063617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:44.187760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817df91-3172-40b7-bb64-a1641665a459 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:44.244570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63d5c4-b2fd-43a8-b9ca-856ed05d19f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:44.245212 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63d5c4-b2fd-43a8-b9ca-856ed05d19f8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:44.245553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63d5c4-b2fd-43a8-b9ca-856ed05d19f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:44.245762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63d5c4-b2fd-43a8-b9ca-856ed05d19f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:44.246511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63d5c4-b2fd-43a8-b9ca-856ed05d19f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:44.246771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63d5c4-b2fd-43a8-b9ca-856ed05d19f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:44.248291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63d5c4-b2fd-43a8-b9ca-856ed05d19f8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:44.269444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 476/960] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 10 07:51:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:44.890223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72c53-ae60-42a9-b5c7-4db9cfe624d6 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:44.890991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72c53-ae60-42a9-b5c7-4db9cfe624d6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:44.890991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72c53-ae60-42a9-b5c7-4db9cfe624d6 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:44.892541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 485/961] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:44.898941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86722e50-1c51-4749-984d-3c380d27b476 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:44.899690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86722e50-1c51-4749-984d-3c380d27b476 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:44.899690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86722e50-1c51-4749-984d-3c380d27b476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:44.919412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-86722e50-1c51-4749-984d-3c380d27b476 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:44.921025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-86722e50-1c51-4749-984d-3c380d27b476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:44.999779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 477/962] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:51:45.022843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea72c53-ae60-42a9-b5c7-4db9cfe624d6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:45.154120 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea72c53-ae60-42a9-b5c7-4db9cfe624d6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:45.189720 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424169c-420e-499a-8bf8-67a0c8103b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:45.190344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424169c-420e-499a-8bf8-67a0c8103b48 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:45.190629 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424169c-420e-499a-8bf8-67a0c8103b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:45.190903 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424169c-420e-499a-8bf8-67a0c8103b48 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:45.191573 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424169c-420e-499a-8bf8-67a0c8103b48 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:45.193534 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424169c-420e-499a-8bf8-67a0c8103b48 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:45.211837 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 486/963] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:51:45 2022] POST /identity/v3/services => generated 242 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:51:46.370674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91bdd7-0fbb-468e-9233-d6c127071784 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:46.371453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91bdd7-0fbb-468e-9233-d6c127071784 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:46.371453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91bdd7-0fbb-468e-9233-d6c127071784 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:46.372902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 478/964] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:46.379193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a7244-8994-4a79-b0ec-8a4fab5150d8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:46.379779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a7244-8994-4a79-b0ec-8a4fab5150d8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:46.379897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a7244-8994-4a79-b0ec-8a4fab5150d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:46.386531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:46.400755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-698a7244-8994-4a79-b0ec-8a4fab5150d8 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:46.402014 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-698a7244-8994-4a79-b0ec-8a4fab5150d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:46.443611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76931e47-0358-4df0-9857-9f19060c3c1f None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:46.443937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76931e47-0358-4df0-9857-9f19060c3c1f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:46.444225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76931e47-0358-4df0-9857-9f19060c3c1f None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:46.445958 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 479/965] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:51:46.451841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e6cb-d9d7-442d-a22a-cb27da6498bd None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:46.452131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e6cb-d9d7-442d-a22a-cb27da6498bd None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:46.452410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e6cb-d9d7-442d-a22a-cb27da6498bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:46.471685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d2d4e6cb-d9d7-442d-a22a-cb27da6498bd None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:46.473013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d2d4e6cb-d9d7-442d-a22a-cb27da6498bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:46.493090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:46.506587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 487/966] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:46.546480 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a7244-8994-4a79-b0ec-8a4fab5150d8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:46.560655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 480/967] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:46.600427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4e6cb-d9d7-442d-a22a-cb27da6498bd None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:46.705693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a7244-8994-4a79-b0ec-8a4fab5150d8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:46.720873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4e6cb-d9d7-442d-a22a-cb27da6498bd None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:46.756136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:46.760036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adc0a7-4ecd-4fbf-9d33-c0e96ea6a6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:46.760973 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adc0a7-4ecd-4fbf-9d33-c0e96ea6a6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:46.761440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adc0a7-4ecd-4fbf-9d33-c0e96ea6a6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:46.761895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adc0a7-4ecd-4fbf-9d33-c0e96ea6a6b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:46.762671 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adc0a7-4ecd-4fbf-9d33-c0e96ea6a6b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:46.764323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adc0a7-4ecd-4fbf-9d33-c0e96ea6a6b0 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:46.768174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4ea64-3aab-41f1-9321-9c617c92e388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:46.769138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4ea64-3aab-41f1-9321-9c617c92e388 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:46.769648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4ea64-3aab-41f1-9321-9c617c92e388 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:46.770134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4ea64-3aab-41f1-9321-9c617c92e388 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-42adc0a7-4ecd-4fbf-9d33-c0e96ea6a6b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:46.776034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:46.777100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:46.777964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:46.780995 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 481/968] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 10 07:51:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:46.791200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adc0a7-4ecd-4fbf-9d33-c0e96ea6a6b0 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:46.795898 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4ea64-3aab-41f1-9321-9c617c92e388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-29b4ea64-3aab-41f1-9321-9c617c92e388 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:46.802133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:46.804158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:46.805766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:46.805766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:46.805766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:46.805766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:46.805766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:46.805766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:46.805766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:46.805766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:46.805766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:46.805766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:46.805766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:51:46.805766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:46.807867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 488/969] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Aug 10 07:51:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:46.810529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4ea64-3aab-41f1-9321-9c617c92e388 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:46.835093 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:46.948173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4ea64-3aab-41f1-9321-9c617c92e388 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:46.985094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adc0a7-4ecd-4fbf-9d33-c0e96ea6a6b0 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:47.021498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591347e-0095-4840-859d-01e8fd7106e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:47.022139 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591347e-0095-4840-859d-01e8fd7106e4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:47.022429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591347e-0095-4840-859d-01e8fd7106e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:47.022877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591347e-0095-4840-859d-01e8fd7106e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:47.023415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591347e-0095-4840-859d-01e8fd7106e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:47.023723 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591347e-0095-4840-859d-01e8fd7106e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:47.025241 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591347e-0095-4840-859d-01e8fd7106e4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:47.041917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 489/970] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Aug 10 07:51:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:47.043210 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1481341-4228-4101-ac17-bb7a115bb660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:47.043929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1481341-4228-4101-ac17-bb7a115bb660 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:47.044214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1481341-4228-4101-ac17-bb7a115bb660 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:47.044488 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1481341-4228-4101-ac17-bb7a115bb660 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:47.045146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1481341-4228-4101-ac17-bb7a115bb660 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:47.045447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1481341-4228-4101-ac17-bb7a115bb660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:47.045819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591347e-0095-4840-859d-01e8fd7106e4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:47.046801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1481341-4228-4101-ac17-bb7a115bb660 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:47.055509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 482/971] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Aug 10 07:51:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:47.061619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1481341-4228-4101-ac17-bb7a115bb660 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:47.142848 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:47.193828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:47.217824 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1481341-4228-4101-ac17-bb7a115bb660 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:47.218367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591347e-0095-4840-859d-01e8fd7106e4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:47.259254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51c33f-e7d4-4adc-9d6d-5433ea97fccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:47.259611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe247c32-57ed-4a7d-8296-2079a08197d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:47.259919 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c33f-e7d4-4adc-9d6d-5433ea97fccd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:47.260203 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c33f-e7d4-4adc-9d6d-5433ea97fccd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:47.260370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe247c32-57ed-4a7d-8296-2079a08197d8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:47.260552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c33f-e7d4-4adc-9d6d-5433ea97fccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:47.260632 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe247c32-57ed-4a7d-8296-2079a08197d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:47.260965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe247c32-57ed-4a7d-8296-2079a08197d8 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:47.261595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe247c32-57ed-4a7d-8296-2079a08197d8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:47.261900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe247c32-57ed-4a7d-8296-2079a08197d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:47.263337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe247c32-57ed-4a7d-8296-2079a08197d8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:47.282373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 483/972] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Aug 10 07:51:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:47.282572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51c33f-e7d4-4adc-9d6d-5433ea97fccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:47.282680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820b711-04bb-4074-8090-2edf36462eed None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:47.282680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820b711-04bb-4074-8090-2edf36462eed None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:47.282680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820b711-04bb-4074-8090-2edf36462eed None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:47.282908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51c33f-e7d4-4adc-9d6d-5433ea97fccd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:47.282981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 484/973] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:47.285516 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820b711-04bb-4074-8090-2edf36462eed None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-9f51c33f-e7d4-4adc-9d6d-5433ea97fccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:47.302939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:47.304298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:47.305187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:47.305187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:47.305187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:47.305187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 490/974] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:47.305854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3252d-f35a-4124-8d71-c276f9fb3326 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:47.306023 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3252d-f35a-4124-8d71-c276f9fb3326 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:47.306753 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3252d-f35a-4124-8d71-c276f9fb3326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:47.326067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7ad3252d-f35a-4124-8d71-c276f9fb3326 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:47.327308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7ad3252d-f35a-4124-8d71-c276f9fb3326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:47.422727 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 491/975] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:47.423607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3252d-f35a-4124-8d71-c276f9fb3326 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:47.443915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820b711-04bb-4074-8090-2edf36462eed None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:47.457549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:47.484870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2351dad-a6c0-4605-89bc-dac14f450ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:47.485491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2351dad-a6c0-4605-89bc-dac14f450ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:47.485777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2351dad-a6c0-4605-89bc-dac14f450ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:47.486048 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2351dad-a6c0-4605-89bc-dac14f450ac9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:47.486772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2351dad-a6c0-4605-89bc-dac14f450ac9 None admin] RBAC: Adding query filter params (interface=admin, service_id=09163c86345b4a9fb9bd913b09db338f, region_id=RegionOne) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:47.487083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2351dad-a6c0-4605-89bc-dac14f450ac9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:47.488500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2351dad-a6c0-4605-89bc-dac14f450ac9 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:47.494735 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 485/976] 10.222.0.30 () {56 vars in 1249 bytes} [Wed Aug 10 07:51:47 2022] GET /identity/v3/endpoints?service_id=09163c86345b4a9fb9bd913b09db338f&interface=admin®ion_id=RegionOne => generated 193 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:47.500695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb64cb-6c9a-4662-8e26-a1d385ceb59d None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:47.500980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb64cb-6c9a-4662-8e26-a1d385ceb59d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:47.501284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb64cb-6c9a-4662-8e26-a1d385ceb59d None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:47.502649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 486/977] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:47.503355 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb64cb-6c9a-4662-8e26-a1d385ceb59d None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:47.515509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:47.535120 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3252d-f35a-4124-8d71-c276f9fb3326 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:47.584350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94225a6-9c17-4ab6-a47c-bc76268ae66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:47.584975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94225a6-9c17-4ab6-a47c-bc76268ae66e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:47.585263 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94225a6-9c17-4ab6-a47c-bc76268ae66e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:47.585528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94225a6-9c17-4ab6-a47c-bc76268ae66e None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:47.586189 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94225a6-9c17-4ab6-a47c-bc76268ae66e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:47.586492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94225a6-9c17-4ab6-a47c-bc76268ae66e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:47.587905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94225a6-9c17-4ab6-a47c-bc76268ae66e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:47.602466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 492/978] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:47.602466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94225a6-9c17-4ab6-a47c-bc76268ae66e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:47.624780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb64cb-6c9a-4662-8e26-a1d385ceb59d None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:47.663301 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee3bc0-b21e-456f-8fc0-9a093dd54873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:47.663955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee3bc0-b21e-456f-8fc0-9a093dd54873 None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:47.664238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee3bc0-b21e-456f-8fc0-9a093dd54873 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:47.664508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee3bc0-b21e-456f-8fc0-9a093dd54873 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:47.665142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee3bc0-b21e-456f-8fc0-9a093dd54873 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:47.666583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee3bc0-b21e-456f-8fc0-9a093dd54873 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:47.682448 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.sql.core [None req-ecee3bc0-b21e-456f-8fc0-9a093dd54873 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 07:51:47.682448 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 07:51:47.682448 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [parameters: {'user_id': '864c09d4859642ddba0042789d213ca1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 07:51:47.682448 dv-cinder-781032-4-smb devstack@keystone.service[80195]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80195) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-ecee3bc0-b21e-456f-8fc0-9a093dd54873 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application conn.query(q) Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application result.read() Aug 10 07:51:47.689912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 07:51:47.691064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application next(self.gen) Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application yield resource Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application next(self.gen) Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise self.value Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application session.commit() Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 07:51:47.692195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self.session.flush() Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application compat.raise_( Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 07:51:47.693094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 07:51:47.693962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application conn.query(q) Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application result.read() Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 07:51:47.694802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [parameters: {'user_id': '864c09d4859642ddba0042789d213ca1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:47.695638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 10 07:51:47.697537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 10 07:51:47.698665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 10 07:51:47.698665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 10 07:51:47.698665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 07:51:47.698665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 07:51:47.698665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 07:51:47.698665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:47.698665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 487/979] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Aug 10 07:51:47 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:47.701034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b7e4c-a5a0-40e2-874b-6390dc04c76b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:47.701245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b7e4c-a5a0-40e2-874b-6390dc04c76b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:47.701528 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b7e4c-a5a0-40e2-874b-6390dc04c76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:47.708818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:47.719096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94225a6-9c17-4ab6-a47c-bc76268ae66e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:47.720125 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-de2b7e4c-a5a0-40e2-874b-6390dc04c76b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:47.721691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-de2b7e4c-a5a0-40e2-874b-6390dc04c76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:47.753551 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321c8ff-a2ce-4cc8-92fc-c63dd2ebfa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:47.754170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321c8ff-a2ce-4cc8-92fc-c63dd2ebfa1f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:47.754446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321c8ff-a2ce-4cc8-92fc-c63dd2ebfa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:47.754768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321c8ff-a2ce-4cc8-92fc-c63dd2ebfa1f None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:47.755375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321c8ff-a2ce-4cc8-92fc-c63dd2ebfa1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:47.756816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321c8ff-a2ce-4cc8-92fc-c63dd2ebfa1f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:47.763380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 493/980] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 10 07:51:47 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:51:47.764293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321c8ff-a2ce-4cc8-92fc-c63dd2ebfa1f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:47.803494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:47.815845 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 488/981] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:47.815845 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b7e4c-a5a0-40e2-874b-6390dc04c76b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:47.905541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321c8ff-a2ce-4cc8-92fc-c63dd2ebfa1f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:47.953158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728e796-e6ba-496a-8690-4e4fd99ce282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:47.953819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e796-e6ba-496a-8690-4e4fd99ce282 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:47.954094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e796-e6ba-496a-8690-4e4fd99ce282 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:47.954362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e796-e6ba-496a-8690-4e4fd99ce282 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:47.958915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b7e4c-a5a0-40e2-874b-6390dc04c76b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:47.963457 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728e796-e6ba-496a-8690-4e4fd99ce282 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:47.965038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728e796-e6ba-496a-8690-4e4fd99ce282 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2728e796-e6ba-496a-8690-4e4fd99ce282 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:47.979375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:47.980395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:47.981546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:47.981546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:47.981546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:47.981546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:47.981546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:47.981546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:47.981546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:47.981546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:47.981546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:51:47.981546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:47.981546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 494/982] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Aug 10 07:51:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:47.982274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728e796-e6ba-496a-8690-4e4fd99ce282 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:48.005269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:48.008388 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e6a37-64f6-48cf-b93d-2c167dee0bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:48.009091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e6a37-64f6-48cf-b93d-2c167dee0bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:48.009397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e6a37-64f6-48cf-b93d-2c167dee0bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:48.009703 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e6a37-64f6-48cf-b93d-2c167dee0bd6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:48.018954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e6a37-64f6-48cf-b93d-2c167dee0bd6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:48.020690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e6a37-64f6-48cf-b93d-2c167dee0bd6 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-3f1e6a37-64f6-48cf-b93d-2c167dee0bd6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:48.034051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:48.035121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:48.036680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:48.036680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:48.036680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:48.036680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:48.036680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:48.036680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:48.036680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:48.036680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:48.036680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:51:48.036680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:48.036680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 489/983] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:51:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:48.037303 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e6a37-64f6-48cf-b93d-2c167dee0bd6 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:48.121062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728e796-e6ba-496a-8690-4e4fd99ce282 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:48.127027 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:48.160162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad80218-961b-4967-abab-c9f455079a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:48.161468 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad80218-961b-4967-abab-c9f455079a2e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:48.161751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad80218-961b-4967-abab-c9f455079a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:48.162024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad80218-961b-4967-abab-c9f455079a2e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:48.162626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad80218-961b-4967-abab-c9f455079a2e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:48.164090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad80218-961b-4967-abab-c9f455079a2e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-fad80218-961b-4967-abab-c9f455079a2e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:48.173802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:48.175906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:48.178157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 495/984] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:48.179960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad80218-961b-4967-abab-c9f455079a2e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:48.187649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e6a37-64f6-48cf-b93d-2c167dee0bd6 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:48.237065 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4605a30-6a64-4271-97ef-b12d090bf731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:48.237809 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4605a30-6a64-4271-97ef-b12d090bf731 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:48.238091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4605a30-6a64-4271-97ef-b12d090bf731 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:48.238470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4605a30-6a64-4271-97ef-b12d090bf731 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:48.239950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4605a30-6a64-4271-97ef-b12d090bf731 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:48.240256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4605a30-6a64-4271-97ef-b12d090bf731 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:48.241756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4605a30-6a64-4271-97ef-b12d090bf731 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:48.269770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 490/985] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Aug 10 07:51:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:48.269770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4605a30-6a64-4271-97ef-b12d090bf731 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:48.287767 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:48.324106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad80218-961b-4967-abab-c9f455079a2e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:48.373932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de9dbb-b719-4e68-ad25-edeaac11b4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:48.374769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9dbb-b719-4e68-ad25-edeaac11b4bb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:48.375209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9dbb-b719-4e68-ad25-edeaac11b4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:48.375627 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9dbb-b719-4e68-ad25-edeaac11b4bb None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:48.376784 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de9dbb-b719-4e68-ad25-edeaac11b4bb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:48.377252 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de9dbb-b719-4e68-ad25-edeaac11b4bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:48.379621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de9dbb-b719-4e68-ad25-edeaac11b4bb None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:48.405704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4605a30-6a64-4271-97ef-b12d090bf731 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:48.439761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 496/986] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 10 07:51:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:48.439761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de9dbb-b719-4e68-ad25-edeaac11b4bb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:48.443194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:48.479571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb90daa-ecf1-4694-8deb-0cdcd3c1180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:48.480693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90daa-ecf1-4694-8deb-0cdcd3c1180e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:48.481227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90daa-ecf1-4694-8deb-0cdcd3c1180e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:48.482090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90daa-ecf1-4694-8deb-0cdcd3c1180e None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:48.483502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb90daa-ecf1-4694-8deb-0cdcd3c1180e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:48.484111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb90daa-ecf1-4694-8deb-0cdcd3c1180e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:48.487620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb90daa-ecf1-4694-8deb-0cdcd3c1180e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:48.500243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 491/987] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 10 07:51:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:48.509888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb90daa-ecf1-4694-8deb-0cdcd3c1180e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:48.609003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de9dbb-b719-4e68-ad25-edeaac11b4bb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:48.663116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc12227-c0b4-4d93-ae4b-c146ba475726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:48.663813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc12227-c0b4-4d93-ae4b-c146ba475726 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:48.664220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc12227-c0b4-4d93-ae4b-c146ba475726 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:48.664841 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc12227-c0b4-4d93-ae4b-c146ba475726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:48.673194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb90daa-ecf1-4694-8deb-0cdcd3c1180e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:48.674587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:48.725057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2b6e9-de97-4ba6-bb60-0e506b64590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:48.726013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2b6e9-de97-4ba6-bb60-0e506b64590f None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:48.726457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2b6e9-de97-4ba6-bb60-0e506b64590f None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:48.726885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2b6e9-de97-4ba6-bb60-0e506b64590f None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:48.728010 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2b6e9-de97-4ba6-bb60-0e506b64590f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:48.728495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2b6e9-de97-4ba6-bb60-0e506b64590f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:48.730731 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2b6e9-de97-4ba6-bb60-0e506b64590f None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:48.736887 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 492/988] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 10 07:51:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:48.746679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2b6e9-de97-4ba6-bb60-0e506b64590f None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:48.762247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc12227-c0b4-4d93-ae4b-c146ba475726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:48.764101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc12227-c0b4-4d93-ae4b-c146ba475726 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:48.808155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:48.870707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2b6e9-de97-4ba6-bb60-0e506b64590f None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:48.879325 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 497/989] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:48 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:51:48.880564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc12227-c0b4-4d93-ae4b-c146ba475726 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:48.918245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7673a1-08e0-4727-bee7-7e820d8e4adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:48.918796 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7673a1-08e0-4727-bee7-7e820d8e4adb None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:48.919379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7673a1-08e0-4727-bee7-7e820d8e4adb None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:48.919503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7673a1-08e0-4727-bee7-7e820d8e4adb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:48.920270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7673a1-08e0-4727-bee7-7e820d8e4adb None admin] RBAC: Adding query filter params (interface=public, service_id=2802ee22b01c4b71902420600b74919d, region_id=RegionOne) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:48.920535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7673a1-08e0-4727-bee7-7e820d8e4adb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:48.921925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7673a1-08e0-4727-bee7-7e820d8e4adb None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:48.928915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 493/990] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 10 07:51:48 2022] GET /identity/v3/endpoints?service_id=2802ee22b01c4b71902420600b74919d&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:48.933692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:48.934959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7673a1-08e0-4727-bee7-7e820d8e4adb None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:49.001925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc12227-c0b4-4d93-ae4b-c146ba475726 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:49.049337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f206e-1a78-4d42-845e-a0f18b8e87f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:49.049998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f206e-1a78-4d42-845e-a0f18b8e87f1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:49.050276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f206e-1a78-4d42-845e-a0f18b8e87f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:49.050559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f206e-1a78-4d42-845e-a0f18b8e87f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:49.063749 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f206e-1a78-4d42-845e-a0f18b8e87f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:49.064491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7673a1-08e0-4727-bee7-7e820d8e4adb None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:49.065527 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f206e-1a78-4d42-845e-a0f18b8e87f1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:49.079597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-cb2f206e-1a78-4d42-845e-a0f18b8e87f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:49.082603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:49.084125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:49.085356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:49.085356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:49.085356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:49.085356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 498/991] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:49.090099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f206e-1a78-4d42-845e-a0f18b8e87f1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:49.117462 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ededa-d3c6-4cd8-8092-e83417377123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:49.118083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ededa-d3c6-4cd8-8092-e83417377123 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:49.118433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ededa-d3c6-4cd8-8092-e83417377123 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:49.119228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ededa-d3c6-4cd8-8092-e83417377123 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:49.119371 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ededa-d3c6-4cd8-8092-e83417377123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:49.120786 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ededa-d3c6-4cd8-8092-e83417377123 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:49.136181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 494/992] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 10 07:51:48 2022] GET /identity/v3/services => generated 1727 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:51:49.237078 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:49.257990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f206e-1a78-4d42-845e-a0f18b8e87f1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:49.310416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328114a-0655-4285-9c00-c190720cc5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:49.311046 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328114a-0655-4285-9c00-c190720cc5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:49.311330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328114a-0655-4285-9c00-c190720cc5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:49.311605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328114a-0655-4285-9c00-c190720cc5c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:49.312305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328114a-0655-4285-9c00-c190720cc5c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:49.312609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328114a-0655-4285-9c00-c190720cc5c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:49.314018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328114a-0655-4285-9c00-c190720cc5c9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:49.328173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 499/993] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:49.337692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ededa-d3c6-4cd8-8092-e83417377123 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:49.469221 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ededa-d3c6-4cd8-8092-e83417377123 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:49.508034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f5a46-f587-410f-bf31-af08b5972716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:49.508682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f5a46-f587-410f-bf31-af08b5972716 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:49.508954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f5a46-f587-410f-bf31-af08b5972716 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:49.509149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f5a46-f587-410f-bf31-af08b5972716 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:49.516646 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f5a46-f587-410f-bf31-af08b5972716 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:49.518124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f5a46-f587-410f-bf31-af08b5972716 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-200f5a46-f587-410f-bf31-af08b5972716 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:49.530525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:49.532622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:49.533912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:49.533912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:49.533912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:49.533912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:49.533912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:49.533912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:49.533912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:49.533912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:49.533912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 495/994] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:49.538104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328114a-0655-4285-9c00-c190720cc5c9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:49.687306 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328114a-0655-4285-9c00-c190720cc5c9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:49.752039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63514c-d932-438d-bd20-4739c02c2b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:49.752856 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63514c-d932-438d-bd20-4739c02c2b81 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:49.753139 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63514c-d932-438d-bd20-4739c02c2b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:49.753408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63514c-d932-438d-bd20-4739c02c2b81 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:49.754111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63514c-d932-438d-bd20-4739c02c2b81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:49.754412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63514c-d932-438d-bd20-4739c02c2b81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:49.756529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63514c-d932-438d-bd20-4739c02c2b81 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:49.772430 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 500/995] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:49.778274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f5a46-f587-410f-bf31-af08b5972716 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:49.818459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:49.907132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f5a46-f587-410f-bf31-af08b5972716 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:49.944972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22366f-05b9-4b9f-ab07-5e06b841aea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:49.945589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22366f-05b9-4b9f-ab07-5e06b841aea8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:49.945874 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22366f-05b9-4b9f-ab07-5e06b841aea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:49.946150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22366f-05b9-4b9f-ab07-5e06b841aea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:49.946892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22366f-05b9-4b9f-ab07-5e06b841aea8 None admin] RBAC: Adding query filter params (role.id=bfd0f20224c5406491b85c14c4641a29, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=15690a9236a74f518837f7d47d9797b1) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:49.947205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22366f-05b9-4b9f-ab07-5e06b841aea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:49.948680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22366f-05b9-4b9f-ab07-5e06b841aea8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:49.955325 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 496/996] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:49 2022] GET /identity/v3/role_assignments?user.id=15690a9236a74f518837f7d47d9797b1&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=bfd0f20224c5406491b85c14c4641a29 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:50.181376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2f19-3565-4e88-ba57-22c341e48c32 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:50.181876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2f19-3565-4e88-ba57-22c341e48c32 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:50.182364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2f19-3565-4e88-ba57-22c341e48c32 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:50.184794 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 501/997] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:50.194273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59750f1a-8cc7-427d-b007-855618453e4a None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:50.194775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59750f1a-8cc7-427d-b007-855618453e4a None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:50.195259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59750f1a-8cc7-427d-b007-855618453e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:50.216105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-59750f1a-8cc7-427d-b007-855618453e4a None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:50.217314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-59750f1a-8cc7-427d-b007-855618453e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:50.307812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 497/998] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:50.338579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d2f19-3565-4e88-ba57-22c341e48c32 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:50.353956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:50.461432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d2f19-3565-4e88-ba57-22c341e48c32 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:50.496902 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ff008-b247-4198-8830-e9e1dda9b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:50.497544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ff008-b247-4198-8830-e9e1dda9b5fe None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:50.497830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ff008-b247-4198-8830-e9e1dda9b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:50.498104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ff008-b247-4198-8830-e9e1dda9b5fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:50.498693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ff008-b247-4198-8830-e9e1dda9b5fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:50.500100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ff008-b247-4198-8830-e9e1dda9b5fe None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-b22ff008-b247-4198-8830-e9e1dda9b5fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:50.509156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:50.510308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:50.511303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 502/999] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 10 07:51:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:50.516349 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59750f1a-8cc7-427d-b007-855618453e4a None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:50.546180 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:50.626625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59750f1a-8cc7-427d-b007-855618453e4a None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:50.662152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769194d-15fb-4a8a-ad09-027c6221cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:50.662760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769194d-15fb-4a8a-ad09-027c6221cde8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:50.663040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769194d-15fb-4a8a-ad09-027c6221cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:50.663312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769194d-15fb-4a8a-ad09-027c6221cde8 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:50.663968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769194d-15fb-4a8a-ad09-027c6221cde8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:50.664272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769194d-15fb-4a8a-ad09-027c6221cde8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:50.665627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769194d-15fb-4a8a-ad09-027c6221cde8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:50.676074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 498/1000] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Aug 10 07:51:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:50.680004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ff008-b247-4198-8830-e9e1dda9b5fe None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:50.761996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:50.789567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ff008-b247-4198-8830-e9e1dda9b5fe None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:50.824545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcaede-c2d0-4578-8785-3ef10b3d30e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:50.825148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcaede-c2d0-4578-8785-3ef10b3d30e1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:50.825430 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcaede-c2d0-4578-8785-3ef10b3d30e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:50.825702 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcaede-c2d0-4578-8785-3ef10b3d30e1 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:50.826323 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dcaede-c2d0-4578-8785-3ef10b3d30e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:50.826625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dcaede-c2d0-4578-8785-3ef10b3d30e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:50.828015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dcaede-c2d0-4578-8785-3ef10b3d30e1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:50.838137 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 503/1001] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Aug 10 07:51:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:50.839129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769194d-15fb-4a8a-ad09-027c6221cde8 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:50.960293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:50.972373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769194d-15fb-4a8a-ad09-027c6221cde8 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:51.033028 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c080694-1b14-4a04-b92d-0f699670229c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:51.033563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080694-1b14-4a04-b92d-0f699670229c None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:51.033858 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080694-1b14-4a04-b92d-0f699670229c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:51.034175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080694-1b14-4a04-b92d-0f699670229c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:51.034848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c080694-1b14-4a04-b92d-0f699670229c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:51.036754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c080694-1b14-4a04-b92d-0f699670229c None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:51.055959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 499/1002] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 07:51:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:51:51.338799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6b875-f228-4ca3-97cf-b98e2d73b995 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:51.339143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6b875-f228-4ca3-97cf-b98e2d73b995 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:51.339544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6b875-f228-4ca3-97cf-b98e2d73b995 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:51.341730 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 504/1003] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:51.349488 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f66ce-a924-433b-a483-1d6615c48ff5 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:51.349917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f66ce-a924-433b-a483-1d6615c48ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:51.350330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f66ce-a924-433b-a483-1d6615c48ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:51.374839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-cf4f66ce-a924-433b-a483-1d6615c48ff5 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:51.376598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-cf4f66ce-a924-433b-a483-1d6615c48ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:51.458612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 500/1004] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:51.481553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6b875-f228-4ca3-97cf-b98e2d73b995 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:51.587797 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6b875-f228-4ca3-97cf-b98e2d73b995 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:51.623232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53f47c-3fe6-4415-8268-d147508df6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:51.623808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53f47c-3fe6-4415-8268-d147508df6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:51.624088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53f47c-3fe6-4415-8268-d147508df6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:51.624357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53f47c-3fe6-4415-8268-d147508df6d5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:51.624939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53f47c-3fe6-4415-8268-d147508df6d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:51.626371 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53f47c-3fe6-4415-8268-d147508df6d5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-9f53f47c-3fe6-4415-8268-d147508df6d5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:51.638997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:51.640245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:51:51.641085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:51.647693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 505/1005] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:51.649759 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f66ce-a924-433b-a483-1d6615c48ff5 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:51.736786 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:51.762004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f66ce-a924-433b-a483-1d6615c48ff5 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:51.797957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac349c-0e34-478f-bdee-85d735af9b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:51.798590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac349c-0e34-478f-bdee-85d735af9b95 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:51.798859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac349c-0e34-478f-bdee-85d735af9b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:51.799129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac349c-0e34-478f-bdee-85d735af9b95 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:51.799800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac349c-0e34-478f-bdee-85d735af9b95 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:51.800107 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac349c-0e34-478f-bdee-85d735af9b95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:51.802076 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac349c-0e34-478f-bdee-85d735af9b95 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:51.812396 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 501/1006] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 10 07:51:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:51.813388 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53f47c-3fe6-4415-8268-d147508df6d5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:51.816399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:51.927294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53f47c-3fe6-4415-8268-d147508df6d5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:51.962804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f29e0d-89e3-4982-a6f1-0510a6e6509c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:51.963420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f29e0d-89e3-4982-a6f1-0510a6e6509c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:51.963698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f29e0d-89e3-4982-a6f1-0510a6e6509c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:51.963997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f29e0d-89e3-4982-a6f1-0510a6e6509c None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:51.964625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f29e0d-89e3-4982-a6f1-0510a6e6509c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:51.964925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f29e0d-89e3-4982-a6f1-0510a6e6509c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:51.966283 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f29e0d-89e3-4982-a6f1-0510a6e6509c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:51.976088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 506/1007] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 10 07:51:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:51.977713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac349c-0e34-478f-bdee-85d735af9b95 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:52.082599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcbce8-6378-4d25-9d24-37b3ea99e581 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:52.082888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcbce8-6378-4d25-9d24-37b3ea99e581 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:52.083157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcbce8-6378-4d25-9d24-37b3ea99e581 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:52.084518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 507/1008] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:51:52.089203 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac349c-0e34-478f-bdee-85d735af9b95 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:52.090513 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb7e74-599a-42cc-b5a0-c11ee4ae9b7d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:52.091008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb7e74-599a-42cc-b5a0-c11ee4ae9b7d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:52.091480 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb7e74-599a-42cc-b5a0-c11ee4ae9b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:52.110224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-34fb7e74-599a-42cc-b5a0-c11ee4ae9b7d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:52.111713 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-34fb7e74-599a-42cc-b5a0-c11ee4ae9b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:52.125143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed319f8-b687-42fa-9517-b9f1560c949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:52.125738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed319f8-b687-42fa-9517-b9f1560c949e None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:52.126021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed319f8-b687-42fa-9517-b9f1560c949e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:52.126287 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed319f8-b687-42fa-9517-b9f1560c949e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:52.126967 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed319f8-b687-42fa-9517-b9f1560c949e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:52.128366 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed319f8-b687-42fa-9517-b9f1560c949e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:52.145917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:52.160249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 502/1009] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 07:51:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:51:52.184650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:52.203768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 508/1010] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:52 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:51:52.224779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed319f8-b687-42fa-9517-b9f1560c949e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:52.340877 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed319f8-b687-42fa-9517-b9f1560c949e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:52.375944 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb315078-e9af-4633-8015-2e5c2fc288ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:52.376575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb315078-e9af-4633-8015-2e5c2fc288ef None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:52.376861 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb315078-e9af-4633-8015-2e5c2fc288ef None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:52.377136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb315078-e9af-4633-8015-2e5c2fc288ef None admin] PATH_INFO: `/v3/services/image` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:52.377721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb315078-e9af-4633-8015-2e5c2fc288ef None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:52.379070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb315078-e9af-4633-8015-2e5c2fc288ef None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-cb315078-e9af-4633-8015-2e5c2fc288ef None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:52.388477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:52.389681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:52.390791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 503/1011] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Aug 10 07:51:52 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:52.395951 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb7e74-599a-42cc-b5a0-c11ee4ae9b7d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:52.505145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb7e74-599a-42cc-b5a0-c11ee4ae9b7d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:52.539327 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc10f9-fe4e-49cd-806b-8c5e3dad5589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:52.539970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc10f9-fe4e-49cd-806b-8c5e3dad5589 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:52.540257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc10f9-fe4e-49cd-806b-8c5e3dad5589 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:52.540535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc10f9-fe4e-49cd-806b-8c5e3dad5589 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:52.541170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc10f9-fe4e-49cd-806b-8c5e3dad5589 None admin] RBAC: Adding query filter params (name=image) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:52.541481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc10f9-fe4e-49cd-806b-8c5e3dad5589 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:52.542885 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc10f9-fe4e-49cd-806b-8c5e3dad5589 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:52.548067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 509/1012] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:52.554168 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb315078-e9af-4633-8015-2e5c2fc288ef None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:52.626341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:52.677919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb315078-e9af-4633-8015-2e5c2fc288ef None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:52.717792 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669eda8-554b-476d-82e6-317147d91499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:52.718791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669eda8-554b-476d-82e6-317147d91499 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:52.719286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669eda8-554b-476d-82e6-317147d91499 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:52.719792 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669eda8-554b-476d-82e6-317147d91499 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:52.720598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669eda8-554b-476d-82e6-317147d91499 None admin] RBAC: Adding query filter params (type=image) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:52.720909 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669eda8-554b-476d-82e6-317147d91499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:52.722284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669eda8-554b-476d-82e6-317147d91499 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:52.735779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 504/1013] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:53.151810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388283-e99b-4659-afde-85bfe5f617d0 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:53.152359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388283-e99b-4659-afde-85bfe5f617d0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:53.152359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388283-e99b-4659-afde-85bfe5f617d0 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:53.153726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 510/1014] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:53.159070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e48fed-1c33-4c7e-af82-9a3dcade583f None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:53.159367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e48fed-1c33-4c7e-af82-9a3dcade583f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:53.159641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e48fed-1c33-4c7e-af82-9a3dcade583f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:53.185470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-76e48fed-1c33-4c7e-af82-9a3dcade583f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:53.186877 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-76e48fed-1c33-4c7e-af82-9a3dcade583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:53.257511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 505/1015] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:53 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:53.280817 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97388283-e99b-4659-afde-85bfe5f617d0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:53.339197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:53.387003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97388283-e99b-4659-afde-85bfe5f617d0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:53.436992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13684727-2a0c-4cd7-b541-007ddc18c3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:53.437549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13684727-2a0c-4cd7-b541-007ddc18c3cd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:53.437829 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13684727-2a0c-4cd7-b541-007ddc18c3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:53.438099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13684727-2a0c-4cd7-b541-007ddc18c3cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:53.439210 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13684727-2a0c-4cd7-b541-007ddc18c3cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:53.440680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13684727-2a0c-4cd7-b541-007ddc18c3cd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:53.442286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 511/1016] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:53.448476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e48fed-1c33-4c7e-af82-9a3dcade583f None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:53.508360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:53.559021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e48fed-1c33-4c7e-af82-9a3dcade583f None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:53.593545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fadd4a-c976-4d90-8ef9-cd1957f8b30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:53.594154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fadd4a-c976-4d90-8ef9-cd1957f8b30a None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:53.594435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fadd4a-c976-4d90-8ef9-cd1957f8b30a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:53.594707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fadd4a-c976-4d90-8ef9-cd1957f8b30a None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:53.595349 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fadd4a-c976-4d90-8ef9-cd1957f8b30a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:53.596790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fadd4a-c976-4d90-8ef9-cd1957f8b30a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:53.627778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 506/1017] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:51:53 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:51:54.342713 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7af8c-babe-421a-befb-be743c0798a0 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:54.343265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7af8c-babe-421a-befb-be743c0798a0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:54.343265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7af8c-babe-421a-befb-be743c0798a0 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:54.344788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 512/1018] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:54.349957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c78d1d-eaea-42ff-bb6c-baf2b30795ec None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:54.350430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c78d1d-eaea-42ff-bb6c-baf2b30795ec None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:54.350519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c78d1d-eaea-42ff-bb6c-baf2b30795ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:54.370443 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-22c78d1d-eaea-42ff-bb6c-baf2b30795ec None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:54.371644 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-22c78d1d-eaea-42ff-bb6c-baf2b30795ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:54.441832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 507/1019] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:54 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:54.464747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7af8c-babe-421a-befb-be743c0798a0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:54.566532 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7af8c-babe-421a-befb-be743c0798a0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:54.590045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:54.602291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d87c5f-4b6f-442f-a51e-0d293237eb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:54.602854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d87c5f-4b6f-442f-a51e-0d293237eb68 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:54.603133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d87c5f-4b6f-442f-a51e-0d293237eb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:54.603403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d87c5f-4b6f-442f-a51e-0d293237eb68 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:54.613475 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d87c5f-4b6f-442f-a51e-0d293237eb68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e4d87c5f-4b6f-442f-a51e-0d293237eb68 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:54.618104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:54.619087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:54.620400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:54.620400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:54.620400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:54.620400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:54.620400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:54.620400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:54.620400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:54.620400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:54.620400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:54.620400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:54.620400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:51:54.620400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:54.624057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 513/1020] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Aug 10 07:51:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:54.625246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c78d1d-eaea-42ff-bb6c-baf2b30795ec None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:54.665805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:54.734216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c78d1d-eaea-42ff-bb6c-baf2b30795ec None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:54.776283 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00997509-f2f1-4d77-936a-786416f459db None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:54.776594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00997509-f2f1-4d77-936a-786416f459db None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:54.776847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00997509-f2f1-4d77-936a-786416f459db None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:54.776955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a542d44-0a1b-422a-b908-bed9b5debc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:54.777482 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542d44-0a1b-422a-b908-bed9b5debc91 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:54.777767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542d44-0a1b-422a-b908-bed9b5debc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:54.778051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542d44-0a1b-422a-b908-bed9b5debc91 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:54.778798 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a542d44-0a1b-422a-b908-bed9b5debc91 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:54.779216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a542d44-0a1b-422a-b908-bed9b5debc91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:54.779492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 514/1021] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:51:54.780561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a542d44-0a1b-422a-b908-bed9b5debc91 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:54.784141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4d376-98fc-4953-8163-3642e655b294 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:54.784503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4d376-98fc-4953-8163-3642e655b294 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:54.784702 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4d376-98fc-4953-8163-3642e655b294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:54.796838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 508/1022] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Aug 10 07:51:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:54.798637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a542d44-0a1b-422a-b908-bed9b5debc91 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:54.815174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3ad4d376-98fc-4953-8163-3642e655b294 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:54.816574 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3ad4d376-98fc-4953-8163-3642e655b294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:54.908190 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 515/1023] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:54 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:51:54.929381 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:54.932472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a542d44-0a1b-422a-b908-bed9b5debc91 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:54.936277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4d376-98fc-4953-8163-3642e655b294 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:54.968996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4dfa7-b8e8-4e72-8d4a-02c2d1117bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:54.969634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4dfa7-b8e8-4e72-8d4a-02c2d1117bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:54.969919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4dfa7-b8e8-4e72-8d4a-02c2d1117bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:54.970214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4dfa7-b8e8-4e72-8d4a-02c2d1117bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:54.982285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4dfa7-b8e8-4e72-8d4a-02c2d1117bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:54.984166 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4dfa7-b8e8-4e72-8d4a-02c2d1117bb1 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-4ae4dfa7-b8e8-4e72-8d4a-02c2d1117bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:54.999334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:55.000942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:55.002373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:55.002373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:55.002373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:55.002373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 509/1024] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:55.006126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4dfa7-b8e8-4e72-8d4a-02c2d1117bb1 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:55.047670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4d376-98fc-4953-8163-3642e655b294 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:55.063346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:55.086521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13032c4-956b-4df1-994f-3a0fe8c4fa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:55.087147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13032c4-956b-4df1-994f-3a0fe8c4fa5a None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:55.087434 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13032c4-956b-4df1-994f-3a0fe8c4fa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:55.087710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13032c4-956b-4df1-994f-3a0fe8c4fa5a None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:55.088411 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13032c4-956b-4df1-994f-3a0fe8c4fa5a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:55.089939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13032c4-956b-4df1-994f-3a0fe8c4fa5a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:55.110614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 516/1025] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:51:54 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:51:55.118287 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4dfa7-b8e8-4e72-8d4a-02c2d1117bb1 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:55.167198 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ced52-b4d9-4fc3-a868-4d05ab0096ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:55.167762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ced52-b4d9-4fc3-a868-4d05ab0096ff None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:55.168047 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ced52-b4d9-4fc3-a868-4d05ab0096ff None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:55.168322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ced52-b4d9-4fc3-a868-4d05ab0096ff None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:55.169006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ced52-b4d9-4fc3-a868-4d05ab0096ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:55.169314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ced52-b4d9-4fc3-a868-4d05ab0096ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:55.170787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ced52-b4d9-4fc3-a868-4d05ab0096ff None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:55.185702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 510/1026] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:55.191383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13032c4-956b-4df1-994f-3a0fe8c4fa5a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:55.305109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13032c4-956b-4df1-994f-3a0fe8c4fa5a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:55.346618 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb18d2-ebc3-4262-bdad-ddf0dd557383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:55.347411 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb18d2-ebc3-4262-bdad-ddf0dd557383 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:55.347601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb18d2-ebc3-4262-bdad-ddf0dd557383 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:55.347981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb18d2-ebc3-4262-bdad-ddf0dd557383 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:55.357505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb18d2-ebc3-4262-bdad-ddf0dd557383 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:55.358996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb18d2-ebc3-4262-bdad-ddf0dd557383 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c0fb18d2-ebc3-4262-bdad-ddf0dd557383 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:51:55.371004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:55.372060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:55.373635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:55.373635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:55.373635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:51:55.373635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:51:55.373635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:51:55.373635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:51:55.373635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:51:55.373635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:51:55.373635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:51:55.373635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:55.373635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 517/1027] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 10 07:51:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:55.377940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ced52-b4d9-4fc3-a868-4d05ab0096ff None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:55.390719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:55.491061 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ced52-b4d9-4fc3-a868-4d05ab0096ff None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:55.534659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cca532-225b-47b1-85e6-fc9d46c69070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:55.535275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cca532-225b-47b1-85e6-fc9d46c69070 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:55.535580 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cca532-225b-47b1-85e6-fc9d46c69070 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:55.535887 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cca532-225b-47b1-85e6-fc9d46c69070 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:55.536628 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cca532-225b-47b1-85e6-fc9d46c69070 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:55.536931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cca532-225b-47b1-85e6-fc9d46c69070 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:55.538351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cca532-225b-47b1-85e6-fc9d46c69070 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:55.561634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 511/1028] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 10 07:51:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:55.563315 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb18d2-ebc3-4262-bdad-ddf0dd557383 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:55.599969 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:55.671075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb18d2-ebc3-4262-bdad-ddf0dd557383 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:55.706028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eae880-10c8-4096-b8a0-bb2e0270310b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:55.706641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eae880-10c8-4096-b8a0-bb2e0270310b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:55.706919 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eae880-10c8-4096-b8a0-bb2e0270310b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:55.707187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eae880-10c8-4096-b8a0-bb2e0270310b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:55.719123 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c0760-7beb-4a18-8020-957f2a095932 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:55.719420 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c0760-7beb-4a18-8020-957f2a095932 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:55.719687 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c0760-7beb-4a18-8020-957f2a095932 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:55.721077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 512/1029] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:51:55.726159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43334529-0989-4fc8-a670-ab7957324035 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:55.726516 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43334529-0989-4fc8-a670-ab7957324035 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:55.726865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43334529-0989-4fc8-a670-ab7957324035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:55.745228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-43334529-0989-4fc8-a670-ab7957324035 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:55.746436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-43334529-0989-4fc8-a670-ab7957324035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:55.786690 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eae880-10c8-4096-b8a0-bb2e0270310b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:55.788218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eae880-10c8-4096-b8a0-bb2e0270310b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:55.814153 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:55.823473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 513/1030] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:51:55.830849 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:55.849864 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43334529-0989-4fc8-a670-ab7957324035 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:55.916085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 518/1031] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:55 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 07:51:55.917045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eae880-10c8-4096-b8a0-bb2e0270310b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:55.967325 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43334529-0989-4fc8-a670-ab7957324035 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:56.003018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86022e0-a728-4e37-9022-60a7f5955a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:56.003576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86022e0-a728-4e37-9022-60a7f5955a6d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:56.003897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86022e0-a728-4e37-9022-60a7f5955a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:56.004178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86022e0-a728-4e37-9022-60a7f5955a6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:56.005361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86022e0-a728-4e37-9022-60a7f5955a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:56.006800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86022e0-a728-4e37-9022-60a7f5955a6d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:56.008439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 514/1032] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:56.014231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86022e0-a728-4e37-9022-60a7f5955a6d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:56.027677 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eae880-10c8-4096-b8a0-bb2e0270310b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:56.070353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373a1a4-31d6-44e0-8ac6-47422e8fea0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:56.071314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373a1a4-31d6-44e0-8ac6-47422e8fea0a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:56.071845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373a1a4-31d6-44e0-8ac6-47422e8fea0a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:56.072313 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373a1a4-31d6-44e0-8ac6-47422e8fea0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:56.074554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:56.084718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373a1a4-31d6-44e0-8ac6-47422e8fea0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:56.085360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:56.086569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373a1a4-31d6-44e0-8ac6-47422e8fea0a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-9373a1a4-31d6-44e0-8ac6-47422e8fea0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:56.108459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:56.109476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:56.110377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:56.110377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:56.110377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:56.110377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 519/1033] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:56.118255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373a1a4-31d6-44e0-8ac6-47422e8fea0a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:56.137520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86022e0-a728-4e37-9022-60a7f5955a6d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:56.181530 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefabb1-0afd-4e45-bb96-245588d5ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:56.182139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefabb1-0afd-4e45-bb96-245588d5ff74 None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:56.182433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefabb1-0afd-4e45-bb96-245588d5ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:56.182694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefabb1-0afd-4e45-bb96-245588d5ff74 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:56.183342 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefabb1-0afd-4e45-bb96-245588d5ff74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:56.184855 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefabb1-0afd-4e45-bb96-245588d5ff74 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:56.215772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 515/1034] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:51:56 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:51:56.251714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373a1a4-31d6-44e0-8ac6-47422e8fea0a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:56.296206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e4cca-81ed-4d7f-82be-9bf29b7ea04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:56.296745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e4cca-81ed-4d7f-82be-9bf29b7ea04d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:56.297034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e4cca-81ed-4d7f-82be-9bf29b7ea04d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:56.297311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e4cca-81ed-4d7f-82be-9bf29b7ea04d None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:56.297977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e4cca-81ed-4d7f-82be-9bf29b7ea04d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:56.298282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e4cca-81ed-4d7f-82be-9bf29b7ea04d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:56.299744 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e4cca-81ed-4d7f-82be-9bf29b7ea04d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:56.313682 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 520/1035] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:56.320118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefabb1-0afd-4e45-bb96-245588d5ff74 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:56.436374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefabb1-0afd-4e45-bb96-245588d5ff74 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:56.459177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:56.484444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53313840-088a-4685-ae48-3b9a0fe185f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:56.485079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53313840-088a-4685-ae48-3b9a0fe185f8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:56.485360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53313840-088a-4685-ae48-3b9a0fe185f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:56.485626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53313840-088a-4685-ae48-3b9a0fe185f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:56.493151 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53313840-088a-4685-ae48-3b9a0fe185f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:56.494569 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53313840-088a-4685-ae48-3b9a0fe185f8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-53313840-088a-4685-ae48-3b9a0fe185f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:51:56.506232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:56.507142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:56.508100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:51:56.508100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:51:56.508100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:51:56.508100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:51:56.508100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:51:56.508100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:51:56.508100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:51:56.508100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:56.508100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 516/1036] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:56.515029 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e4cca-81ed-4d7f-82be-9bf29b7ea04d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:56.565251 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:56.621414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e4cca-81ed-4d7f-82be-9bf29b7ea04d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:56.663232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b151a71-83c0-4838-9964-1c5b7d17450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:56.663898 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b151a71-83c0-4838-9964-1c5b7d17450f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:56.664184 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b151a71-83c0-4838-9964-1c5b7d17450f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:56.664463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b151a71-83c0-4838-9964-1c5b7d17450f None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:56.665164 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b151a71-83c0-4838-9964-1c5b7d17450f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:56.665476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b151a71-83c0-4838-9964-1c5b7d17450f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:56.666921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b151a71-83c0-4838-9964-1c5b7d17450f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:56.680690 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 521/1037] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:51:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:56.686779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53313840-088a-4685-ae48-3b9a0fe185f8 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:56.804028 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53313840-088a-4685-ae48-3b9a0fe185f8 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:56.839191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cb392-9d81-408e-a600-2a9cf1b223ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:56.839715 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb392-9d81-408e-a600-2a9cf1b223ad None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:56.840026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb392-9d81-408e-a600-2a9cf1b223ad None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:56.840302 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb392-9d81-408e-a600-2a9cf1b223ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:56.841036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cb392-9d81-408e-a600-2a9cf1b223ad None admin] RBAC: Adding query filter params (role.id=bfd0f20224c5406491b85c14c4641a29, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=6c8e7a0b9eb14983ac117690e2705eb4) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:56.841347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cb392-9d81-408e-a600-2a9cf1b223ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:56.842764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cb392-9d81-408e-a600-2a9cf1b223ad None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:56.855812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 517/1038] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:56 2022] GET /identity/v3/role_assignments?user.id=6c8e7a0b9eb14983ac117690e2705eb4&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=bfd0f20224c5406491b85c14c4641a29 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:57.197649 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1fb43-a590-4531-be86-9203f390e798 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:57.198088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1fb43-a590-4531-be86-9203f390e798 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:57.198312 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1fb43-a590-4531-be86-9203f390e798 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:57.199912 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 522/1039] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:57.205207 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f518be-b276-4503-9934-49991d8de0b6 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:57.205499 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f518be-b276-4503-9934-49991d8de0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:57.205784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f518be-b276-4503-9934-49991d8de0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:57.225039 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-56f518be-b276-4503-9934-49991d8de0b6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:57.226267 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-56f518be-b276-4503-9934-49991d8de0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:57.275798 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:57.308904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 518/1040] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:57.330676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1fb43-a590-4531-be86-9203f390e798 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:57.450107 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1fb43-a590-4531-be86-9203f390e798 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:57.458109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:57.491535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624e273-893b-451a-b326-031bac374771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:57.492212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624e273-893b-451a-b326-031bac374771 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:57.492493 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624e273-893b-451a-b326-031bac374771 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:57.492765 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624e273-893b-451a-b326-031bac374771 None admin] PATH_INFO: `/v3/services/image` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:57.493355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624e273-893b-451a-b326-031bac374771 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:57.494724 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624e273-893b-451a-b326-031bac374771 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c624e273-893b-451a-b326-031bac374771 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:57.505514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:57.506636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:51:57.512413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 523/1041] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Aug 10 07:51:57 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:57.513261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f518be-b276-4503-9934-49991d8de0b6 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:57.622832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f518be-b276-4503-9934-49991d8de0b6 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:57.662391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0ee51-ee5a-41b0-bce4-8526b87aa149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:57.663002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0ee51-ee5a-41b0-bce4-8526b87aa149 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:57.663283 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0ee51-ee5a-41b0-bce4-8526b87aa149 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:57.663553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0ee51-ee5a-41b0-bce4-8526b87aa149 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:57.664274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0ee51-ee5a-41b0-bce4-8526b87aa149 None admin] RBAC: Adding query filter params (name=image) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:57.664586 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0ee51-ee5a-41b0-bce4-8526b87aa149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:57.665933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0ee51-ee5a-41b0-bce4-8526b87aa149 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:57.675597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 519/1042] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:57.676987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624e273-893b-451a-b326-031bac374771 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:57.792572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624e273-893b-451a-b326-031bac374771 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:57.826672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8551b9-456a-46b4-acae-0cdb2c4476ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:57.827287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8551b9-456a-46b4-acae-0cdb2c4476ca None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:57.827564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8551b9-456a-46b4-acae-0cdb2c4476ca None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:57.827862 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8551b9-456a-46b4-acae-0cdb2c4476ca None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:57.828499 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8551b9-456a-46b4-acae-0cdb2c4476ca None admin] RBAC: Adding query filter params (type=image) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:57.828862 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8551b9-456a-46b4-acae-0cdb2c4476ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:57.830229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8551b9-456a-46b4-acae-0cdb2c4476ca None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:57.841940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 524/1043] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:57.842162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0ee51-ee5a-41b0-bce4-8526b87aa149 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:57.893033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:57.963246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0ee51-ee5a-41b0-bce4-8526b87aa149 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:58.009668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea7a12-fc7d-4aa7-a924-b0d0b64ea453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:58.010286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea7a12-fc7d-4aa7-a924-b0d0b64ea453 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:58.010567 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea7a12-fc7d-4aa7-a924-b0d0b64ea453 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:58.010841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea7a12-fc7d-4aa7-a924-b0d0b64ea453 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:58.011553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea7a12-fc7d-4aa7-a924-b0d0b64ea453 None admin] RBAC: Adding query filter params (interface=public, service_id=8c1f27af74df45af87336153bcf38266, region_id=RegionOne) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:58.011908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea7a12-fc7d-4aa7-a924-b0d0b64ea453 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:58.013274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea7a12-fc7d-4aa7-a924-b0d0b64ea453 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:58.021091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 520/1044] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 10 07:51:57 2022] GET /identity/v3/endpoints?service_id=8c1f27af74df45af87336153bcf38266&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:58.026425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8551b9-456a-46b4-acae-0cdb2c4476ca None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:58.063387 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:58.137400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8551b9-456a-46b4-acae-0cdb2c4476ca None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:58.175537 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7d609-abc9-4f43-9d19-6bc3f7eb99a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:58.176232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d609-abc9-4f43-9d19-6bc3f7eb99a0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:58.176514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d609-abc9-4f43-9d19-6bc3f7eb99a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:58.176792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d609-abc9-4f43-9d19-6bc3f7eb99a0 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:58.177401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7d609-abc9-4f43-9d19-6bc3f7eb99a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:58.179013 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7d609-abc9-4f43-9d19-6bc3f7eb99a0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:58.186015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 525/1045] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 10 07:51:58 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:51:58.370785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6cfe8-170e-49f0-beff-6523962f3630 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:58.370993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6cfe8-170e-49f0-beff-6523962f3630 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:58.371274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6cfe8-170e-49f0-beff-6523962f3630 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:58.372767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 521/1046] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:58.378501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e9fdf-235d-4949-9cde-b1a4b3e7ca19 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:58.378778 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e9fdf-235d-4949-9cde-b1a4b3e7ca19 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:58.379058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e9fdf-235d-4949-9cde-b1a4b3e7ca19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:58.399237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-770e9fdf-235d-4949-9cde-b1a4b3e7ca19 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:58.400495 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-770e9fdf-235d-4949-9cde-b1a4b3e7ca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:58.480082 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 526/1047] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:51:58.503758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6cfe8-170e-49f0-beff-6523962f3630 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:58.611883 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6cfe8-170e-49f0-beff-6523962f3630 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:58.613529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:58.655265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d8bc3-8086-4ee3-9397-f3b0520d945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:58.655265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d8bc3-8086-4ee3-9397-f3b0520d945b None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:58.655265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d8bc3-8086-4ee3-9397-f3b0520d945b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:58.655265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d8bc3-8086-4ee3-9397-f3b0520d945b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:58.670225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d8bc3-8086-4ee3-9397-f3b0520d945b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-3e3d8bc3-8086-4ee3-9397-f3b0520d945b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:58.674937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:58.676036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:58.676881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:58.676881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:58.676881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:58.676881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:58.676881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:58.676881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:58.676881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:58.676881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:58.676881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:58.676881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:58.676881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:51:58.676881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:58.680098 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 522/1048] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:51:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:51:58.682677 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e9fdf-235d-4949-9cde-b1a4b3e7ca19 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:58.713243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:58.790951 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e9fdf-235d-4949-9cde-b1a4b3e7ca19 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:58.828352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60195d04-9c85-4e53-940d-f30d1d14d924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:58.828967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60195d04-9c85-4e53-940d-f30d1d14d924 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:58.829241 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60195d04-9c85-4e53-940d-f30d1d14d924 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:58.829572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60195d04-9c85-4e53-940d-f30d1d14d924 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:58.830241 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60195d04-9c85-4e53-940d-f30d1d14d924 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:58.830542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60195d04-9c85-4e53-940d-f30d1d14d924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:58.831942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60195d04-9c85-4e53-940d-f30d1d14d924 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:58.841127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 527/1049] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:51:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:58.846676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d8bc3-8086-4ee3-9397-f3b0520d945b None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:58.897780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a362d27-e0d9-4788-ba26-f064709c2120 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:58.898116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a362d27-e0d9-4788-ba26-f064709c2120 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:58.898704 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a362d27-e0d9-4788-ba26-f064709c2120 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:58.900721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 528/1050] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:51:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:51:58.906260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c596bdd-9c6d-4150-8045-a9617112dc91 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:58.906529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c596bdd-9c6d-4150-8045-a9617112dc91 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:58.906748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c596bdd-9c6d-4150-8045-a9617112dc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:58.929941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0c596bdd-9c6d-4150-8045-a9617112dc91 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:51:58.931166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0c596bdd-9c6d-4150-8045-a9617112dc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:51:58.965914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d8bc3-8086-4ee3-9397-f3b0520d945b None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:59.002921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8aa63-d143-47e5-8f23-b0e46e46f086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:59.003701 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8aa63-d143-47e5-8f23-b0e46e46f086 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:59.003975 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8aa63-d143-47e5-8f23-b0e46e46f086 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:59.004810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8aa63-d143-47e5-8f23-b0e46e46f086 None admin] PATH_INFO: `/v3/users/7bea7dee89df40efb50a79917539dc93` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:59.006476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 529/1051] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:51:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:51:59.020107 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8aa63-d143-47e5-8f23-b0e46e46f086 None admin] RBAC: Authorizing `identity:get_user(user_id=7bea7dee89df40efb50a79917539dc93)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:59.021546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8aa63-d143-47e5-8f23-b0e46e46f086 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:59.023399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 523/1052] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:51:58 2022] GET /identity/v3/users/7bea7dee89df40efb50a79917539dc93 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:59.029109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c596bdd-9c6d-4150-8045-a9617112dc91 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:59.029467 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8aa63-d143-47e5-8f23-b0e46e46f086 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:59.052435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:59.058155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:59.145947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8aa63-d143-47e5-8f23-b0e46e46f086 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:59.149588 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c596bdd-9c6d-4150-8045-a9617112dc91 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:59.185924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b3abd-066d-43d2-a577-6d5dcfab0df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:59.186655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b3abd-066d-43d2-a577-6d5dcfab0df5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:59.186928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b3abd-066d-43d2-a577-6d5dcfab0df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:59.187265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b3abd-066d-43d2-a577-6d5dcfab0df5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:59.188500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4653e8a-099e-4adc-b192-7c5cd59d7c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:59.189125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4653e8a-099e-4adc-b192-7c5cd59d7c91 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:59.189401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4653e8a-099e-4adc-b192-7c5cd59d7c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:59.189672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4653e8a-099e-4adc-b192-7c5cd59d7c91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:59.198842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b3abd-066d-43d2-a577-6d5dcfab0df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-595b3abd-066d-43d2-a577-6d5dcfab0df5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:51:59.203496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:59.204614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:59.210812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:59.210812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:59.210812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:59.210812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:59.210812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:51:59.210812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:51:59.210812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:51:59.210812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:51:59.210812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:51:59.210812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:51:59.210812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:51:59.210812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:59.210812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 524/1053] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Aug 10 07:51:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:59.211512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b3abd-066d-43d2-a577-6d5dcfab0df5 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:59.273381 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4653e8a-099e-4adc-b192-7c5cd59d7c91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:59.275280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4653e8a-099e-4adc-b192-7c5cd59d7c91 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:59.300686 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:59.308007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:59.349884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b3abd-066d-43d2-a577-6d5dcfab0df5 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:59.396099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef198087-7f9a-436f-991e-f987459f7c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:59.396780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef198087-7f9a-436f-991e-f987459f7c05 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:59.397104 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef198087-7f9a-436f-991e-f987459f7c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:59.397346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef198087-7f9a-436f-991e-f987459f7c05 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:59.398258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef198087-7f9a-436f-991e-f987459f7c05 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:59.398366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 530/1054] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:51:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 07:51:59.398457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef198087-7f9a-436f-991e-f987459f7c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:59.399721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef198087-7f9a-436f-991e-f987459f7c05 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:59.404055 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4653e8a-099e-4adc-b192-7c5cd59d7c91 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:59.409909 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 525/1055] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Aug 10 07:51:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:59.416227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef198087-7f9a-436f-991e-f987459f7c05 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:59.515850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4653e8a-099e-4adc-b192-7c5cd59d7c91 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:59.527003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef198087-7f9a-436f-991e-f987459f7c05 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:59.539247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:59.554590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578620d-f635-4d22-ba20-54c84ddd7763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:59.555215 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578620d-f635-4d22-ba20-54c84ddd7763 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:59.555447 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578620d-f635-4d22-ba20-54c84ddd7763 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:59.555719 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578620d-f635-4d22-ba20-54c84ddd7763 None admin] PATH_INFO: `/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:59.556891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578620d-f635-4d22-ba20-54c84ddd7763 None admin] RBAC: Authorizing `identity:get_project(project_id=d1ebfa3cb6824502854e0c58b4062f2e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:59.558315 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578620d-f635-4d22-ba20-54c84ddd7763 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:59.559997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 531/1056] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:51:59 2022] GET /identity/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:59.565930 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578620d-f635-4d22-ba20-54c84ddd7763 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:59.571217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d3840-de81-4cbe-9555-54e016b921c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:59.571882 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d3840-de81-4cbe-9555-54e016b921c9 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:59.572284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d3840-de81-4cbe-9555-54e016b921c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:59.572774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d3840-de81-4cbe-9555-54e016b921c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:59.585157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d3840-de81-4cbe-9555-54e016b921c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:59.586641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d3840-de81-4cbe-9555-54e016b921c9 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:59.588685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-043d3840-de81-4cbe-9555-54e016b921c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:51:59.603631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:51:59.604655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:51:59.605550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:51:59.605550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:51:59.605550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:51:59.609651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 526/1057] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:51:59.611180 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d3840-de81-4cbe-9555-54e016b921c9 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:59.686884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578620d-f635-4d22-ba20-54c84ddd7763 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:59.726889 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e81792-d4a5-4e5d-a1d0-e6c1ba215a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:59.727518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e81792-d4a5-4e5d-a1d0-e6c1ba215a75 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:59.727824 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e81792-d4a5-4e5d-a1d0-e6c1ba215a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:59.728103 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e81792-d4a5-4e5d-a1d0-e6c1ba215a75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:59.728848 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e81792-d4a5-4e5d-a1d0-e6c1ba215a75 None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=d1ebfa3cb6824502854e0c58b4062f2e, user.id=7bea7dee89df40efb50a79917539dc93) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:59.729161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e81792-d4a5-4e5d-a1d0-e6c1ba215a75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:59.730611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e81792-d4a5-4e5d-a1d0-e6c1ba215a75 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:59.739574 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 532/1058] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:51:59 2022] GET /identity/v3/role_assignments?user.id=7bea7dee89df40efb50a79917539dc93&scope.project.id=d1ebfa3cb6824502854e0c58b4062f2e&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:51:59.753714 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d3840-de81-4cbe-9555-54e016b921c9 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:51:59.815056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455b3df-9806-4e1a-99be-26f84dde9368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:51:59.815953 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b3df-9806-4e1a-99be-26f84dde9368 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:51:59.816418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b3df-9806-4e1a-99be-26f84dde9368 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:51:59.816891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b3df-9806-4e1a-99be-26f84dde9368 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:51:59.817954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455b3df-9806-4e1a-99be-26f84dde9368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:51:59.818459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455b3df-9806-4e1a-99be-26f84dde9368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:51:59.820824 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455b3df-9806-4e1a-99be-26f84dde9368 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:51:59.844163 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 527/1059] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:51:59.847121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e81792-d4a5-4e5d-a1d0-e6c1ba215a75 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:51:59.925903 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:51:59.985248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e81792-d4a5-4e5d-a1d0-e6c1ba215a75 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:00.022848 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd28c9e-c20f-4d88-9e9d-7d289d6af2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:00.023567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28c9e-c20f-4d88-9e9d-7d289d6af2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:00.023877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28c9e-c20f-4d88-9e9d-7d289d6af2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:00.024080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28c9e-c20f-4d88-9e9d-7d289d6af2c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:00.032392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd28c9e-c20f-4d88-9e9d-7d289d6af2c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:00.033868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd28c9e-c20f-4d88-9e9d-7d289d6af2c0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-1fd28c9e-c20f-4d88-9e9d-7d289d6af2c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:52:00.047054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:00.048119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:00.049050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:00.049050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:00.049050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:52:00.049050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:52:00.049050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:52:00.049050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:52:00.049050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:52:00.049050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:52:00.049050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:52:00.049050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:00.049050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 533/1060] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 10 07:51:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:52:00.055008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455b3df-9806-4e1a-99be-26f84dde9368 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:00.134999 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:00.187248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455b3df-9806-4e1a-99be-26f84dde9368 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:00.232375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7e791-1415-4c85-b564-434b7dbd7089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:00.232986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e791-1415-4c85-b564-434b7dbd7089 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:00.233267 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e791-1415-4c85-b564-434b7dbd7089 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:00.233540 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e791-1415-4c85-b564-434b7dbd7089 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:00.234268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7e791-1415-4c85-b564-434b7dbd7089 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:00.236346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7e791-1415-4c85-b564-434b7dbd7089 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:00.236346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7e791-1415-4c85-b564-434b7dbd7089 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:00.251781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26533506-13ef-4d56-8d5e-16e869c92979 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:00.252059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26533506-13ef-4d56-8d5e-16e869c92979 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:00.253063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26533506-13ef-4d56-8d5e-16e869c92979 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:00.253935 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 534/1061] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:00.259272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedba263-1495-47eb-af5f-059b9ccf3526 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:00.259641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedba263-1495-47eb-af5f-059b9ccf3526 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:00.259961 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedba263-1495-47eb-af5f-059b9ccf3526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:00.267776 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 528/1062] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 10 07:52:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:00.269682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7e791-1415-4c85-b564-434b7dbd7089 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:00.283421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-dedba263-1495-47eb-af5f-059b9ccf3526 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:00.284690 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dedba263-1495-47eb-af5f-059b9ccf3526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:00.380731 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 535/1063] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:52:00.403553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7e791-1415-4c85-b564-434b7dbd7089 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:00.405194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedba263-1495-47eb-af5f-059b9ccf3526 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:00.418875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:00.445341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544e839-e041-426b-b435-4d19d91b6f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:00.445984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544e839-e041-426b-b435-4d19d91b6f27 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:00.446447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544e839-e041-426b-b435-4d19d91b6f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:00.446612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544e839-e041-426b-b435-4d19d91b6f27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:00.464037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:00.467657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544e839-e041-426b-b435-4d19d91b6f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:00.470087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544e839-e041-426b-b435-4d19d91b6f27 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-e544e839-e041-426b-b435-4d19d91b6f27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:52:00.489494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:00.490508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:52:00.491391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:52:00.491391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:52:00.491391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:52:00.491391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 529/1064] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:52:00.496747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544e839-e041-426b-b435-4d19d91b6f27 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:00.534071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedba263-1495-47eb-af5f-059b9ccf3526 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:00.577421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac4718-d2e2-4a48-9d9b-91357d4cd3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:00.578077 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac4718-d2e2-4a48-9d9b-91357d4cd3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:00.578358 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac4718-d2e2-4a48-9d9b-91357d4cd3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:00.578747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac4718-d2e2-4a48-9d9b-91357d4cd3b8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:00.579347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac4718-d2e2-4a48-9d9b-91357d4cd3b8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:00.580762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac4718-d2e2-4a48-9d9b-91357d4cd3b8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-65ac4718-d2e2-4a48-9d9b-91357d4cd3b8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:00.597974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:00.599545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:00.600582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 536/1065] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Aug 10 07:52:00 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:52:00.605695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac4718-d2e2-4a48-9d9b-91357d4cd3b8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:00.622212 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544e839-e041-426b-b435-4d19d91b6f27 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:00.661287 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b5b79-4817-45bf-af77-8207a120e3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:00.661818 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b5b79-4817-45bf-af77-8207a120e3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:00.662101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b5b79-4817-45bf-af77-8207a120e3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:00.662375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b5b79-4817-45bf-af77-8207a120e3a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:00.663034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b5b79-4817-45bf-af77-8207a120e3a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:00.663339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b5b79-4817-45bf-af77-8207a120e3a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:00.664748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b5b79-4817-45bf-af77-8207a120e3a3 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:00.682370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 530/1066] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:52:00.684837 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b5b79-4817-45bf-af77-8207a120e3a3 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:00.713376 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:00.722180 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac4718-d2e2-4a48-9d9b-91357d4cd3b8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:00.729631 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:00.763886 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b74a51-bf1d-4e77-ae8e-f00f3fcd5727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:00.764510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b74a51-bf1d-4e77-ae8e-f00f3fcd5727 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:00.764790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b74a51-bf1d-4e77-ae8e-f00f3fcd5727 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:00.765060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b74a51-bf1d-4e77-ae8e-f00f3fcd5727 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:00.765696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b74a51-bf1d-4e77-ae8e-f00f3fcd5727 None admin] RBAC: Adding query filter params (name=image) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:00.766091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b74a51-bf1d-4e77-ae8e-f00f3fcd5727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:00.767382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b74a51-bf1d-4e77-ae8e-f00f3fcd5727 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:00.777238 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 537/1067] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:52:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:00.778736 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b74a51-bf1d-4e77-ae8e-f00f3fcd5727 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:00.804805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b5b79-4817-45bf-af77-8207a120e3a3 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:00.847177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813de86-978f-417b-aec1-2f2a04c1a95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:00.847879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813de86-978f-417b-aec1-2f2a04c1a95c None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:00.848165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813de86-978f-417b-aec1-2f2a04c1a95c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:00.848440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813de86-978f-417b-aec1-2f2a04c1a95c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:00.855828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813de86-978f-417b-aec1-2f2a04c1a95c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:00.857285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813de86-978f-417b-aec1-2f2a04c1a95c None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-3813de86-978f-417b-aec1-2f2a04c1a95c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:52:00.869341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:00.871019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:00.872634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:52:00.872634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:52:00.872634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:52:00.872634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:52:00.872634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:52:00.872634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:52:00.872634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:52:00.872634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:52:00.872634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 531/1068] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:52:00.876598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813de86-978f-417b-aec1-2f2a04c1a95c None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:00.914360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b74a51-bf1d-4e77-ae8e-f00f3fcd5727 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:00.949466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a2223-b4b4-4fff-952d-23c02e07babe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:00.950232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a2223-b4b4-4fff-952d-23c02e07babe None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:00.950591 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a2223-b4b4-4fff-952d-23c02e07babe None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:00.950872 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a2223-b4b4-4fff-952d-23c02e07babe None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:00.951513 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a2223-b4b4-4fff-952d-23c02e07babe None admin] RBAC: Adding query filter params (type=image) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:00.951851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a2223-b4b4-4fff-952d-23c02e07babe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:00.953245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a2223-b4b4-4fff-952d-23c02e07babe None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:00.959197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 538/1069] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:52:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:00.964683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a2223-b4b4-4fff-952d-23c02e07babe None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:00.982183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:01.001397 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:01.002538 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813de86-978f-417b-aec1-2f2a04c1a95c None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:01.039996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecc996-bef6-4076-ad50-6f9ea77f689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:01.040618 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecc996-bef6-4076-ad50-6f9ea77f689b None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:01.040905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecc996-bef6-4076-ad50-6f9ea77f689b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:01.041183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecc996-bef6-4076-ad50-6f9ea77f689b None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:01.041895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecc996-bef6-4076-ad50-6f9ea77f689b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:01.042205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecc996-bef6-4076-ad50-6f9ea77f689b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:01.043640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecc996-bef6-4076-ad50-6f9ea77f689b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:01.062217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 532/1070] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:52:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:52:01.063641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecc996-bef6-4076-ad50-6f9ea77f689b None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:01.080724 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a2223-b4b4-4fff-952d-23c02e07babe None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:01.120234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e6d73-d925-4a94-9160-6f49e05be471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:01.120861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e6d73-d925-4a94-9160-6f49e05be471 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:01.121144 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e6d73-d925-4a94-9160-6f49e05be471 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:01.121885 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e6d73-d925-4a94-9160-6f49e05be471 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:01.122572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e6d73-d925-4a94-9160-6f49e05be471 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:01.124027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e6d73-d925-4a94-9160-6f49e05be471 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:01.147154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 539/1071] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 07:52:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:52:01.192373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecc996-bef6-4076-ad50-6f9ea77f689b None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:01.241875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386f626-0aea-431f-a051-d7366615a818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:01.242679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386f626-0aea-431f-a051-d7366615a818 None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:01.242966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386f626-0aea-431f-a051-d7366615a818 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:01.243243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386f626-0aea-431f-a051-d7366615a818 None admin] PATH_INFO: `/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/6c8e7a0b9eb14983ac117690e2705eb4/roles/bfd0f20224c5406491b85c14c4641a29` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:01.245727 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386f626-0aea-431f-a051-d7366615a818 None admin] RBAC: Authorizing `identity:create_grant(project_id=bad7eba8964f4acf9c6c1397df7cd1dd, user_id=6c8e7a0b9eb14983ac117690e2705eb4, role_id=bfd0f20224c5406491b85c14c4641a29)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:01.247238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386f626-0aea-431f-a051-d7366615a818 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:01.258067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:01.266508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 533/1072] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:52:01 2022] PUT /identity/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/6c8e7a0b9eb14983ac117690e2705eb4/roles/bfd0f20224c5406491b85c14c4641a29 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:52:01.805836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8acdf-99d9-4e0e-af1a-d3757cef6925 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:01.806471 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8acdf-99d9-4e0e-af1a-d3757cef6925 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:01.806471 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8acdf-99d9-4e0e-af1a-d3757cef6925 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:01.807764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 540/1073] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:01.813360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d7a4d-9dcf-4423-b666-c60fd7410418 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:01.813858 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d7a4d-9dcf-4423-b666-c60fd7410418 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:01.813965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d7a4d-9dcf-4423-b666-c60fd7410418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:01.833739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-407d7a4d-9dcf-4423-b666-c60fd7410418 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:01.834937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-407d7a4d-9dcf-4423-b666-c60fd7410418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:01.922968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 534/1074] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:52:01.945263 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8acdf-99d9-4e0e-af1a-d3757cef6925 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:02.095962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:02.116233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8acdf-99d9-4e0e-af1a-d3757cef6925 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:02.173436 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6ccf-146c-4f1c-914a-6d0d90e08a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:02.174474 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6ccf-146c-4f1c-914a-6d0d90e08a2b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:02.174956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6ccf-146c-4f1c-914a-6d0d90e08a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:02.175432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6ccf-146c-4f1c-914a-6d0d90e08a2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:02.194263 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f6ccf-146c-4f1c-914a-6d0d90e08a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-a49f6ccf-146c-4f1c-914a-6d0d90e08a2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:52:02.203439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:02.204652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:02.205587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:02.205587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:02.205587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:02.205587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:02.205587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:52:02.205587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:52:02.205587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:52:02.205587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:52:02.205587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:52:02.205587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:52:02.205587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:02.205587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:02.206816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 541/1075] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:52:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:52:02.215205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d7a4d-9dcf-4423-b666-c60fd7410418 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:02.367277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d7a4d-9dcf-4423-b666-c60fd7410418 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:02.408561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:02.420083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24429ba4-d759-49be-9a89-16ab6f0277f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:02.420712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24429ba4-d759-49be-9a89-16ab6f0277f7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:02.420985 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24429ba4-d759-49be-9a89-16ab6f0277f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:02.421257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24429ba4-d759-49be-9a89-16ab6f0277f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:02.421934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24429ba4-d759-49be-9a89-16ab6f0277f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:02.422241 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24429ba4-d759-49be-9a89-16ab6f0277f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:02.423609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24429ba4-d759-49be-9a89-16ab6f0277f7 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:02.439807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 535/1076] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:52:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:02.442477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6ccf-146c-4f1c-914a-6d0d90e08a2b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:02.571759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6ccf-146c-4f1c-914a-6d0d90e08a2b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:02.610909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeea3cc-ffcf-4ec5-90ae-50073e27fb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:02.611885 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeea3cc-ffcf-4ec5-90ae-50073e27fb98 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:02.612303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeea3cc-ffcf-4ec5-90ae-50073e27fb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:02.612703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeea3cc-ffcf-4ec5-90ae-50073e27fb98 None admin] PATH_INFO: `/v3/users/7bea7dee89df40efb50a79917539dc93` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:02.615042 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeea3cc-ffcf-4ec5-90ae-50073e27fb98 None admin] RBAC: Authorizing `identity:get_user(user_id=7bea7dee89df40efb50a79917539dc93)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:02.617608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeea3cc-ffcf-4ec5-90ae-50073e27fb98 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:02.624780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 542/1077] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:02 2022] GET /identity/v3/users/7bea7dee89df40efb50a79917539dc93 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:52:02.625833 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24429ba4-d759-49be-9a89-16ab6f0277f7 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:02.756214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24429ba4-d759-49be-9a89-16ab6f0277f7 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:02.809556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bea87-bcce-477e-a7c7-bcebf210f9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:02.810547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bea87-bcce-477e-a7c7-bcebf210f9bc None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:02.811013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bea87-bcce-477e-a7c7-bcebf210f9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:02.811469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bea87-bcce-477e-a7c7-bcebf210f9bc None admin] PATH_INFO: `/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:02.813291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bea87-bcce-477e-a7c7-bcebf210f9bc None admin] RBAC: Authorizing `identity:get_project(project_id=d1ebfa3cb6824502854e0c58b4062f2e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:02.815788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bea87-bcce-477e-a7c7-bcebf210f9bc None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:02.824207 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 536/1078] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:52:02 2022] GET /identity/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e => generated 311 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:02.825592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeea3cc-ffcf-4ec5-90ae-50073e27fb98 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:02.845870 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:02.941404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeea3cc-ffcf-4ec5-90ae-50073e27fb98 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:02.976189 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c1f44-a5b7-467e-8edf-45264fc2ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:02.976854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c1f44-a5b7-467e-8edf-45264fc2ab3d None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:02.977130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c1f44-a5b7-467e-8edf-45264fc2ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:02.977403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c1f44-a5b7-467e-8edf-45264fc2ab3d None admin] PATH_INFO: `/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e/users/7bea7dee89df40efb50a79917539dc93/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:02.979330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c1f44-a5b7-467e-8edf-45264fc2ab3d None admin] RBAC: Authorizing `identity:create_grant(project_id=d1ebfa3cb6824502854e0c58b4062f2e, user_id=7bea7dee89df40efb50a79917539dc93, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:02.980809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c1f44-a5b7-467e-8edf-45264fc2ab3d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:02.994922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 543/1079] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:52:02 2022] PUT /identity/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e/users/7bea7dee89df40efb50a79917539dc93/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:52:03.221833 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d875b14-8caf-45ac-99a7-5c3f60d5db85 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:03.222183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d875b14-8caf-45ac-99a7-5c3f60d5db85 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:03.222394 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d875b14-8caf-45ac-99a7-5c3f60d5db85 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:03.224505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 537/1080] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:03.229624 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb2c7a-5a5d-4594-b221-7699643e9463 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:03.229915 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb2c7a-5a5d-4594-b221-7699643e9463 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:03.230191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb2c7a-5a5d-4594-b221-7699643e9463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:03.252087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8beb2c7a-5a5d-4594-b221-7699643e9463 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:03.253288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8beb2c7a-5a5d-4594-b221-7699643e9463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:03.328862 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 544/1081] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:03.350574 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d875b14-8caf-45ac-99a7-5c3f60d5db85 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:03.415038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:03.461585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d875b14-8caf-45ac-99a7-5c3f60d5db85 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:03.498096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617788d-4b65-4b07-a0a6-1689f5967a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:03.498629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617788d-4b65-4b07-a0a6-1689f5967a85 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:03.499201 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617788d-4b65-4b07-a0a6-1689f5967a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:03.499201 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617788d-4b65-4b07-a0a6-1689f5967a85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:03.510401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ff8b-d1c1-470f-9cc1-525c6a7f2cce None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:03.510698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ff8b-d1c1-470f-9cc1-525c6a7f2cce None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:03.510963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ff8b-d1c1-470f-9cc1-525c6a7f2cce None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:03.512479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 545/1082] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:03.517414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ddaae-63e3-4c52-a928-00e755a6b21b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:03.517700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ddaae-63e3-4c52-a928-00e755a6b21b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:03.517976 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ddaae-63e3-4c52-a928-00e755a6b21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:03.536359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-938ddaae-63e3-4c52-a928-00e755a6b21b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:03.537575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-938ddaae-63e3-4c52-a928-00e755a6b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:03.539779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:03.583700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617788d-4b65-4b07-a0a6-1689f5967a85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:03.585449 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617788d-4b65-4b07-a0a6-1689f5967a85 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:03.615696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 546/1083] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:52:03.640660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ddaae-63e3-4c52-a928-00e755a6b21b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:03.651352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:03.706559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 538/1084] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:52:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:52:03.712141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617788d-4b65-4b07-a0a6-1689f5967a85 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:03.747529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ddaae-63e3-4c52-a928-00e755a6b21b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:03.784651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5c75c-23ed-40c6-867d-1f61c5eb4380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:03.785216 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5c75c-23ed-40c6-867d-1f61c5eb4380 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:03.786092 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5c75c-23ed-40c6-867d-1f61c5eb4380 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:03.786368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5c75c-23ed-40c6-867d-1f61c5eb4380 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:03.794547 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:03.799823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5c75c-23ed-40c6-867d-1f61c5eb4380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-a5f5c75c-23ed-40c6-867d-1f61c5eb4380 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:52:03.805211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:03.806414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:03.807606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:03.807606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:03.807606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:03.807606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:03.807606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:52:03.807606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:52:03.807606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:52:03.807606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:52:03.807606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:52:03.807606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:52:03.807606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:52:03.807606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:03.807606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 547/1085] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Aug 10 07:52:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:52:03.812355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5c75c-23ed-40c6-867d-1f61c5eb4380 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:03.849199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617788d-4b65-4b07-a0a6-1689f5967a85 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:03.897282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33797ec5-f49d-469c-8c82-36da81c7c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:03.898328 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797ec5-f49d-469c-8c82-36da81c7c6aa None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:03.898846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797ec5-f49d-469c-8c82-36da81c7c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:03.899353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797ec5-f49d-469c-8c82-36da81c7c6aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:03.914536 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33797ec5-f49d-469c-8c82-36da81c7c6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:03.916050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33797ec5-f49d-469c-8c82-36da81c7c6aa None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:03.928027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5c75c-23ed-40c6-867d-1f61c5eb4380 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-33797ec5-f49d-469c-8c82-36da81c7c6aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:52:03.932003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:03.932952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:52:03.934457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:52:03.934457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:52:03.934457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:52:03.934457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 539/1086] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:52:03.938886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33797ec5-f49d-469c-8c82-36da81c7c6aa None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:03.953741 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:03.975526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a045d-b180-4945-a022-2255e536a0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:03.976177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a045d-b180-4945-a022-2255e536a0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:03.976459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a045d-b180-4945-a022-2255e536a0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:03.976729 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a045d-b180-4945-a022-2255e536a0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:03.977402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a045d-b180-4945-a022-2255e536a0a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:03.977708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a045d-b180-4945-a022-2255e536a0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:03.979087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a045d-b180-4945-a022-2255e536a0a9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:03.988138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 548/1087] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Aug 10 07:52:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:52:03.994531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a045d-b180-4945-a022-2255e536a0a9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:04.061094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33797ec5-f49d-469c-8c82-36da81c7c6aa None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:04.066926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:04.110645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3187d2-5eb2-499c-94e5-f00fe7c96ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:04.111623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3187d2-5eb2-499c-94e5-f00fe7c96ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:04.112147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3187d2-5eb2-499c-94e5-f00fe7c96ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:04.112622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3187d2-5eb2-499c-94e5-f00fe7c96ea0 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:04.113669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3187d2-5eb2-499c-94e5-f00fe7c96ea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:04.114144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3187d2-5eb2-499c-94e5-f00fe7c96ea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:04.115519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3187d2-5eb2-499c-94e5-f00fe7c96ea0 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:04.131086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a045d-b180-4945-a022-2255e536a0a9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:04.132599 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 540/1088] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:52:04.185932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3f641-84ee-4864-ab2c-ba2ec1c55435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:04.186596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3f641-84ee-4864-ab2c-ba2ec1c55435 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:04.186876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3f641-84ee-4864-ab2c-ba2ec1c55435 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:04.187146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3f641-84ee-4864-ab2c-ba2ec1c55435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:04.200498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3f641-84ee-4864-ab2c-ba2ec1c55435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:04.201994 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3f641-84ee-4864-ab2c-ba2ec1c55435 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-4fd3f641-84ee-4864-ab2c-ba2ec1c55435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:52:04.218803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:04.220188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:52:04.221117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:52:04.221117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:52:04.221117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:04.224154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 549/1089] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:52:04.226542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3187d2-5eb2-499c-94e5-f00fe7c96ea0 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:04.320896 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:04.355253 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3187d2-5eb2-499c-94e5-f00fe7c96ea0 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:04.390773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3631d4b-5363-4c3e-b811-d52dbc643876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:04.391383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3631d4b-5363-4c3e-b811-d52dbc643876 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:04.391662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3631d4b-5363-4c3e-b811-d52dbc643876 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:04.391958 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3631d4b-5363-4c3e-b811-d52dbc643876 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:04.392615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3631d4b-5363-4c3e-b811-d52dbc643876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:04.392912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3631d4b-5363-4c3e-b811-d52dbc643876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:04.394280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3631d4b-5363-4c3e-b811-d52dbc643876 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:04.409121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 541/1090] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:04.414667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3f641-84ee-4864-ab2c-ba2ec1c55435 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:04.529579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3f641-84ee-4864-ab2c-ba2ec1c55435 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:04.543115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:04.573099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6f8f4-3d15-4666-a613-0db50f6069d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:04.573654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6f8f4-3d15-4666-a613-0db50f6069d8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:04.573938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6f8f4-3d15-4666-a613-0db50f6069d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:04.574213 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6f8f4-3d15-4666-a613-0db50f6069d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:04.582896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6f8f4-3d15-4666-a613-0db50f6069d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:04.584532 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6f8f4-3d15-4666-a613-0db50f6069d8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-bdd6f8f4-3d15-4666-a613-0db50f6069d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:52:04.596334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:04.597390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:04.598375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:04.598375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:04.598375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:52:04.598375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:52:04.598375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:52:04.598375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:52:04.598375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:52:04.598375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:52:04.598375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:52:04.598375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:04.598375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 550/1091] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 10 07:52:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:52:04.603426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3631d4b-5363-4c3e-b811-d52dbc643876 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:04.711771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3631d4b-5363-4c3e-b811-d52dbc643876 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:04.740883 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:04.746629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9a228-6204-4d7c-85ab-a06a42e6b0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:04.747246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9a228-6204-4d7c-85ab-a06a42e6b0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:04.747533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9a228-6204-4d7c-85ab-a06a42e6b0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:04.747852 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9a228-6204-4d7c-85ab-a06a42e6b0e3 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:04.748610 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9a228-6204-4d7c-85ab-a06a42e6b0e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:04.748920 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9a228-6204-4d7c-85ab-a06a42e6b0e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:04.750363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9a228-6204-4d7c-85ab-a06a42e6b0e3 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:04.769626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 542/1092] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 10 07:52:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:04.776154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6f8f4-3d15-4666-a613-0db50f6069d8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:04.885858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6f8f4-3d15-4666-a613-0db50f6069d8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:04.923301 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d30e64-a04a-4813-af3b-85f7b9f4d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:04.924001 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30e64-a04a-4813-af3b-85f7b9f4d843 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:04.924315 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30e64-a04a-4813-af3b-85f7b9f4d843 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:04.924596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30e64-a04a-4813-af3b-85f7b9f4d843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:04.968707 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:04.999192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d30e64-a04a-4813-af3b-85f7b9f4d843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:05.002579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d30e64-a04a-4813-af3b-85f7b9f4d843 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:05.066057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95effb1f-73a7-4747-81d9-9f4780be9eb4 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:05.067110 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95effb1f-73a7-4747-81d9-9f4780be9eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:05.067110 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95effb1f-73a7-4747-81d9-9f4780be9eb4 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:05.068560 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 543/1093] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:52:05.074100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b9fe8-253e-4502-ae08-8f4ec56ec055 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:05.074389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b9fe8-253e-4502-ae08-8f4ec56ec055 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:05.074667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b9fe8-253e-4502-ae08-8f4ec56ec055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:05.092484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-9f2b9fe8-253e-4502-ae08-8f4ec56ec055 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:05.093698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-9f2b9fe8-253e-4502-ae08-8f4ec56ec055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:05.107031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 551/1094] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:52:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:52:05.112978 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d30e64-a04a-4813-af3b-85f7b9f4d843 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:05.166610 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 544/1095] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:52:05.187847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:05.190681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b9fe8-253e-4502-ae08-8f4ec56ec055 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:05.218253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d30e64-a04a-4813-af3b-85f7b9f4d843 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:05.255102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2e66e-4adc-4b6b-84b2-234b573f039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:05.255765 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2e66e-4adc-4b6b-84b2-234b573f039e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:05.256046 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2e66e-4adc-4b6b-84b2-234b573f039e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:05.256315 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2e66e-4adc-4b6b-84b2-234b573f039e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:05.266572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2e66e-4adc-4b6b-84b2-234b573f039e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:05.268065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2e66e-4adc-4b6b-84b2-234b573f039e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c2d2e66e-4adc-4b6b-84b2-234b573f039e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:52:05.282925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:05.284080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:52:05.284989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:52:05.284989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:52:05.284989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:05.284989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 552/1096] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:52:05.290359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2e66e-4adc-4b6b-84b2-234b573f039e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:05.294654 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b9fe8-253e-4502-ae08-8f4ec56ec055 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:05.316030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:05.334665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57b8e6-89b8-40c5-bfe3-57eb9c87fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:05.335291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57b8e6-89b8-40c5-bfe3-57eb9c87fea6 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:05.335573 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57b8e6-89b8-40c5-bfe3-57eb9c87fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:05.335885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57b8e6-89b8-40c5-bfe3-57eb9c87fea6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:05.347663 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57b8e6-89b8-40c5-bfe3-57eb9c87fea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-1d57b8e6-89b8-40c5-bfe3-57eb9c87fea6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:52:05.352679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:05.353785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:05.354624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:05.354624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:05.354624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:05.354624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:05.354624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:52:05.354624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:52:05.354624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:52:05.354624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:52:05.354624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:52:05.354624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:52:05.354624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:05.354624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:52:05.354624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 545/1097] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:52:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:52:05.362793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57b8e6-89b8-40c5-bfe3-57eb9c87fea6 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:05.403183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2e66e-4adc-4b6b-84b2-234b573f039e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:05.428894 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:05.441162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd341e6-92f6-4ee0-b4e3-e4ecea763237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:05.442304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd341e6-92f6-4ee0-b4e3-e4ecea763237 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:05.442581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd341e6-92f6-4ee0-b4e3-e4ecea763237 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:05.442852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd341e6-92f6-4ee0-b4e3-e4ecea763237 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:05.443497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd341e6-92f6-4ee0-b4e3-e4ecea763237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:05.443823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd341e6-92f6-4ee0-b4e3-e4ecea763237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:05.453160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd341e6-92f6-4ee0-b4e3-e4ecea763237 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:05.469279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 553/1098] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:52:05.475606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd341e6-92f6-4ee0-b4e3-e4ecea763237 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:05.481857 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57b8e6-89b8-40c5-bfe3-57eb9c87fea6 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:05.520211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7535548-248b-41fc-85be-c3b68469075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:05.520820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7535548-248b-41fc-85be-c3b68469075d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:05.521100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7535548-248b-41fc-85be-c3b68469075d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:05.521370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7535548-248b-41fc-85be-c3b68469075d None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:05.522038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7535548-248b-41fc-85be-c3b68469075d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:05.522337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7535548-248b-41fc-85be-c3b68469075d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:05.524314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7535548-248b-41fc-85be-c3b68469075d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:05.532879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 546/1099] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:52:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:52:05.538674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7535548-248b-41fc-85be-c3b68469075d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:05.581906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd341e6-92f6-4ee0-b4e3-e4ecea763237 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:05.586936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:05.619368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff101417-9253-4945-8f17-df688420a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:05.621288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff101417-9253-4945-8f17-df688420a939 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:05.621288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff101417-9253-4945-8f17-df688420a939 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:05.621288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff101417-9253-4945-8f17-df688420a939 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:05.627550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff101417-9253-4945-8f17-df688420a939 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:05.629630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff101417-9253-4945-8f17-df688420a939 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-ff101417-9253-4945-8f17-df688420a939 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:52:05.641626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:05.642712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:05.644090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:52:05.644090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:52:05.644090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:52:05.644090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:52:05.644090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:52:05.644090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:52:05.644090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:52:05.644090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:05.644090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 554/1100] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:52:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:52:05.648695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff101417-9253-4945-8f17-df688420a939 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:05.650107 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7535548-248b-41fc-85be-c3b68469075d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:05.687410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa5fe9-e705-41ad-ad96-af9d70650165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:05.687986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa5fe9-e705-41ad-ad96-af9d70650165 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:05.688267 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa5fe9-e705-41ad-ad96-af9d70650165 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:05.688538 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa5fe9-e705-41ad-ad96-af9d70650165 None admin] PATH_INFO: `/v3/users/7bea7dee89df40efb50a79917539dc93` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:05.689689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa5fe9-e705-41ad-ad96-af9d70650165 None admin] RBAC: Authorizing `identity:get_user(user_id=7bea7dee89df40efb50a79917539dc93)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:05.691115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa5fe9-e705-41ad-ad96-af9d70650165 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:05.693470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 547/1101] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:05 2022] GET /identity/v3/users/7bea7dee89df40efb50a79917539dc93 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:52:05.695990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:05.699202 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa5fe9-e705-41ad-ad96-af9d70650165 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:05.753861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff101417-9253-4945-8f17-df688420a939 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:05.792950 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373babc-5287-42f7-b77e-b91869c85b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:05.793626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373babc-5287-42f7-b77e-b91869c85b11 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:05.793919 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373babc-5287-42f7-b77e-b91869c85b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:05.794262 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373babc-5287-42f7-b77e-b91869c85b11 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:05.795002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373babc-5287-42f7-b77e-b91869c85b11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:05.795311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373babc-5287-42f7-b77e-b91869c85b11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:05.796857 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373babc-5287-42f7-b77e-b91869c85b11 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:05.811870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa5fe9-e705-41ad-ad96-af9d70650165 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:05.813671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 555/1102] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:52:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:52:05.820374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373babc-5287-42f7-b77e-b91869c85b11 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:05.825977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:05.856639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacfc28-0fc1-454d-a249-84d0bda0b0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:05.857440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacfc28-0fc1-454d-a249-84d0bda0b0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:05.857825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacfc28-0fc1-454d-a249-84d0bda0b0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:05.858269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacfc28-0fc1-454d-a249-84d0bda0b0b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:05.940070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacfc28-0fc1-454d-a249-84d0bda0b0b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:05.941509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacfc28-0fc1-454d-a249-84d0bda0b0b5 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:05.944761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373babc-5287-42f7-b77e-b91869c85b11 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:05.948028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:05.982002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a0d89-56d6-4821-84e2-305c82d70501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:05.982691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0d89-56d6-4821-84e2-305c82d70501 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:05.982883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0d89-56d6-4821-84e2-305c82d70501 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:05.983160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0d89-56d6-4821-84e2-305c82d70501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:05.983928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a0d89-56d6-4821-84e2-305c82d70501 None admin] RBAC: Adding query filter params (role.id=bfd0f20224c5406491b85c14c4641a29, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=6c8e7a0b9eb14983ac117690e2705eb4) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:05.984235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a0d89-56d6-4821-84e2-305c82d70501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:05.985680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a0d89-56d6-4821-84e2-305c82d70501 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:05.992286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 556/1103] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:52:05 2022] GET /identity/v3/role_assignments?user.id=6c8e7a0b9eb14983ac117690e2705eb4&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=bfd0f20224c5406491b85c14c4641a29 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:52:06.050018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 548/1104] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:52:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:52:06.057123 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a0d89-56d6-4821-84e2-305c82d70501 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:06.172223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a0d89-56d6-4821-84e2-305c82d70501 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:06.210888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6224d-565a-4974-9d23-d1cab1abaef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:06.211459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6224d-565a-4974-9d23-d1cab1abaef2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:06.211855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6224d-565a-4974-9d23-d1cab1abaef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:06.212109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6224d-565a-4974-9d23-d1cab1abaef2 None admin] PATH_INFO: `/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:06.213472 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6224d-565a-4974-9d23-d1cab1abaef2 None admin] RBAC: Authorizing `identity:get_project(project_id=d1ebfa3cb6824502854e0c58b4062f2e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:06.214951 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6224d-565a-4974-9d23-d1cab1abaef2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:06.216786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 557/1105] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:52:06 2022] GET /identity/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:06.223789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacfc28-0fc1-454d-a249-84d0bda0b0b5 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:06.238054 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:06.339208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacfc28-0fc1-454d-a249-84d0bda0b0b5 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:06.375363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171287e-246a-4866-b045-02c619a9525a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:06.376006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171287e-246a-4866-b045-02c619a9525a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:06.379767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171287e-246a-4866-b045-02c619a9525a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:06.379767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171287e-246a-4866-b045-02c619a9525a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:06.379767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171287e-246a-4866-b045-02c619a9525a None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=d1ebfa3cb6824502854e0c58b4062f2e, user.id=7bea7dee89df40efb50a79917539dc93) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:06.379767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171287e-246a-4866-b045-02c619a9525a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:06.379767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171287e-246a-4866-b045-02c619a9525a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:06.385654 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 549/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:52:06 2022] GET /identity/v3/role_assignments?user.id=7bea7dee89df40efb50a79917539dc93&scope.project.id=d1ebfa3cb6824502854e0c58b4062f2e&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:08.464239 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e462bde-d118-4fe5-ab61-386540bcbf2a None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:08.464775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e462bde-d118-4fe5-ab61-386540bcbf2a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:08.464775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e462bde-d118-4fe5-ab61-386540bcbf2a None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:08.466132 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 558/1107] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:08.471660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8741917-c6fd-4f52-9b18-f39d895f0133 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:08.472193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8741917-c6fd-4f52-9b18-f39d895f0133 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:08.472288 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8741917-c6fd-4f52-9b18-f39d895f0133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:08.494228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b8741917-c6fd-4f52-9b18-f39d895f0133 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:08.495404 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b8741917-c6fd-4f52-9b18-f39d895f0133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:08.563109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 550/1108] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:08.587700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e462bde-d118-4fe5-ab61-386540bcbf2a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:08.625136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:08.692814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e462bde-d118-4fe5-ab61-386540bcbf2a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:08.733282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70ac43-0ec1-43f7-9910-fd1e38a65b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:08.733820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70ac43-0ec1-43f7-9910-fd1e38a65b17 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:08.734102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70ac43-0ec1-43f7-9910-fd1e38a65b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:08.734376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70ac43-0ec1-43f7-9910-fd1e38a65b17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:08.735532 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70ac43-0ec1-43f7-9910-fd1e38a65b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:08.737000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70ac43-0ec1-43f7-9910-fd1e38a65b17 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:08.739096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 559/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:52:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:08.744962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8741917-c6fd-4f52-9b18-f39d895f0133 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:08.748145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:08.844267 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8741917-c6fd-4f52-9b18-f39d895f0133 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:08.878434 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390384a-235e-4e7a-8477-7c3cf1b2a028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:08.879709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390384a-235e-4e7a-8477-7c3cf1b2a028 None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:08.880016 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390384a-235e-4e7a-8477-7c3cf1b2a028 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:08.880281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390384a-235e-4e7a-8477-7c3cf1b2a028 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:08.880935 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390384a-235e-4e7a-8477-7c3cf1b2a028 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:08.882357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390384a-235e-4e7a-8477-7c3cf1b2a028 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:08.904954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 551/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:52:08 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:52:10.961656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b8d21-d159-4eb6-b14f-4048c039b2a6 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:10.962231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b8d21-d159-4eb6-b14f-4048c039b2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:10.962231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b8d21-d159-4eb6-b14f-4048c039b2a6 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:10.963515 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 560/1111] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:10.968851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fbf3b-217c-4d5e-a464-27b6ddecced3 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:10.969314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fbf3b-217c-4d5e-a464-27b6ddecced3 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:10.969417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fbf3b-217c-4d5e-a464-27b6ddecced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:10.987587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-590fbf3b-217c-4d5e-a464-27b6ddecced3 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:10.989354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-590fbf3b-217c-4d5e-a464-27b6ddecced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:11.044869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:11.057659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 552/1112] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:11.081439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b8d21-d159-4eb6-b14f-4048c039b2a6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:11.187895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b8d21-d159-4eb6-b14f-4048c039b2a6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:11.190244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:11.221426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f6e48-0604-4e95-8a12-f9c286e64c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:11.222062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f6e48-0604-4e95-8a12-f9c286e64c04 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:11.222343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f6e48-0604-4e95-8a12-f9c286e64c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:11.223149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f6e48-0604-4e95-8a12-f9c286e64c04 None admin] PATH_INFO: `/v3/roles/a5a6c597145c4b23983d1b04377af7ed` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:11.224570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f6e48-0604-4e95-8a12-f9c286e64c04 None admin] RBAC: Authorizing `identity:get_role(role_id=a5a6c597145c4b23983d1b04377af7ed)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:11.225944 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f6e48-0604-4e95-8a12-f9c286e64c04 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:11.227287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 561/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:11 2022] GET /identity/v3/roles/a5a6c597145c4b23983d1b04377af7ed => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:11.233200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fbf3b-217c-4d5e-a464-27b6ddecced3 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:11.338563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fbf3b-217c-4d5e-a464-27b6ddecced3 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:11.375490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c59bc9-4d8b-4f3f-ae8d-0d2f6d06a9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:11.376151 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59bc9-4d8b-4f3f-ae8d-0d2f6d06a9df None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:11.376435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59bc9-4d8b-4f3f-ae8d-0d2f6d06a9df None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:11.376707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59bc9-4d8b-4f3f-ae8d-0d2f6d06a9df None admin] PATH_INFO: `/v3/users/1cd412fc6cd34b63b08cbc412bbc7c60` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:11.391049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c59bc9-4d8b-4f3f-ae8d-0d2f6d06a9df None admin] RBAC: Authorizing `identity:get_user(user_id=1cd412fc6cd34b63b08cbc412bbc7c60)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:11.392523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c59bc9-4d8b-4f3f-ae8d-0d2f6d06a9df None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:11.394228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 553/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:11 2022] GET /identity/v3/users/1cd412fc6cd34b63b08cbc412bbc7c60 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:11.400500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f6e48-0604-4e95-8a12-f9c286e64c04 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:11.518001 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f6e48-0604-4e95-8a12-f9c286e64c04 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:11.559273 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f19f0d-f89f-431d-8efc-7b7e43ee4ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:11.560066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f19f0d-f89f-431d-8efc-7b7e43ee4ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:11.560066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f19f0d-f89f-431d-8efc-7b7e43ee4ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:11.560302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f19f0d-f89f-431d-8efc-7b7e43ee4ce5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:11.605813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:11.637700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f19f0d-f89f-431d-8efc-7b7e43ee4ce5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:11.639164 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f19f0d-f89f-431d-8efc-7b7e43ee4ce5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:11.740372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 562/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:52:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:52:11.746667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c59bc9-4d8b-4f3f-ae8d-0d2f6d06a9df None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:11.798000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:11.852916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c59bc9-4d8b-4f3f-ae8d-0d2f6d06a9df None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:11.890052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79838846-dec1-4892-93f9-3eff0f016ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:11.890694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838846-dec1-4892-93f9-3eff0f016ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:11.890976 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838846-dec1-4892-93f9-3eff0f016ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:11.891254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838846-dec1-4892-93f9-3eff0f016ab4 None admin] PATH_INFO: `/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:11.892520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79838846-dec1-4892-93f9-3eff0f016ab4 None admin] RBAC: Authorizing `identity:get_project(project_id=d1ebfa3cb6824502854e0c58b4062f2e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:11.893961 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79838846-dec1-4892-93f9-3eff0f016ab4 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:11.896801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 554/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:52:11 2022] GET /identity/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:11.904928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f19f0d-f89f-431d-8efc-7b7e43ee4ce5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:11.980250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:12.013650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f19f0d-f89f-431d-8efc-7b7e43ee4ce5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:12.049192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855295b-46a6-4986-93a5-a5a77f9c4ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:12.049718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855295b-46a6-4986-93a5-a5a77f9c4ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:12.050000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855295b-46a6-4986-93a5-a5a77f9c4ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:12.050272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855295b-46a6-4986-93a5-a5a77f9c4ec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:12.051040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855295b-46a6-4986-93a5-a5a77f9c4ec0 None admin] RBAC: Adding query filter params (role.id=a5a6c597145c4b23983d1b04377af7ed, scope.project.id=d1ebfa3cb6824502854e0c58b4062f2e, user.id=1cd412fc6cd34b63b08cbc412bbc7c60) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:12.051352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855295b-46a6-4986-93a5-a5a77f9c4ec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:12.052826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855295b-46a6-4986-93a5-a5a77f9c4ec0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:12.059326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 563/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:52:11 2022] GET /identity/v3/role_assignments?user.id=1cd412fc6cd34b63b08cbc412bbc7c60&scope.project.id=d1ebfa3cb6824502854e0c58b4062f2e&role.id=a5a6c597145c4b23983d1b04377af7ed => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:52:14.049547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e3ac9-a326-415d-9a61-078ed82b36ce None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:14.050092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e3ac9-a326-415d-9a61-078ed82b36ce None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:14.050092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e3ac9-a326-415d-9a61-078ed82b36ce None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:14.051982 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 555/1118] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:14.057638 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ecb76-ab2b-4522-9e69-7ebed4b5f9c6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:14.058042 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ecb76-ab2b-4522-9e69-7ebed4b5f9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:14.058190 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ecb76-ab2b-4522-9e69-7ebed4b5f9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:14.076558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9d8ecb76-ab2b-4522-9e69-7ebed4b5f9c6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:14.077764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9d8ecb76-ab2b-4522-9e69-7ebed4b5f9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:14.144214 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 564/1119] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:14.167313 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e3ac9-a326-415d-9a61-078ed82b36ce None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:14.268833 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e3ac9-a326-415d-9a61-078ed82b36ce None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:14.285841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:14.304854 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee310-6059-4cb8-9123-15e69aeaf74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:14.305485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee310-6059-4cb8-9123-15e69aeaf74d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:14.305765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee310-6059-4cb8-9123-15e69aeaf74d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:14.306038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee310-6059-4cb8-9123-15e69aeaf74d None admin] PATH_INFO: `/v3/roles/a5a6c597145c4b23983d1b04377af7ed` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:14.307415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ee310-6059-4cb8-9123-15e69aeaf74d None admin] RBAC: Authorizing `identity:get_role(role_id=a5a6c597145c4b23983d1b04377af7ed)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:14.308803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ee310-6059-4cb8-9123-15e69aeaf74d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:14.310137 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 556/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:14 2022] GET /identity/v3/roles/a5a6c597145c4b23983d1b04377af7ed => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:14.316061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ecb76-ab2b-4522-9e69-7ebed4b5f9c6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:14.381256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:14.417060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ecb76-ab2b-4522-9e69-7ebed4b5f9c6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:14.451680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed1f12-be7b-48e5-933f-8acc694c725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:14.452340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1f12-be7b-48e5-933f-8acc694c725d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:14.452622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1f12-be7b-48e5-933f-8acc694c725d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:14.452894 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1f12-be7b-48e5-933f-8acc694c725d None admin] PATH_INFO: `/v3/users/1cd412fc6cd34b63b08cbc412bbc7c60` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:14.454033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed1f12-be7b-48e5-933f-8acc694c725d None admin] RBAC: Authorizing `identity:get_user(user_id=1cd412fc6cd34b63b08cbc412bbc7c60)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:14.455469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed1f12-be7b-48e5-933f-8acc694c725d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:14.457097 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 565/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:14 2022] GET /identity/v3/users/1cd412fc6cd34b63b08cbc412bbc7c60 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:14.462950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee310-6059-4cb8-9123-15e69aeaf74d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:14.563043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee310-6059-4cb8-9123-15e69aeaf74d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:14.601564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d94e85-4f9c-4a5b-824c-772d32c4d1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:14.602175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d94e85-4f9c-4a5b-824c-772d32c4d1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:14.602453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d94e85-4f9c-4a5b-824c-772d32c4d1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:14.602726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d94e85-4f9c-4a5b-824c-772d32c4d1f5 None admin] PATH_INFO: `/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:14.603877 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d94e85-4f9c-4a5b-824c-772d32c4d1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=d1ebfa3cb6824502854e0c58b4062f2e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:14.605297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d94e85-4f9c-4a5b-824c-772d32c4d1f5 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:14.606933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 557/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:52:14 2022] GET /identity/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:14.613609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed1f12-be7b-48e5-933f-8acc694c725d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:14.713271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed1f12-be7b-48e5-933f-8acc694c725d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:14.746191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7f5b9-fd66-468b-b3be-3275f78de8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:14.746845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f5b9-fd66-468b-b3be-3275f78de8c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:14.747126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f5b9-fd66-468b-b3be-3275f78de8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:14.747398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f5b9-fd66-468b-b3be-3275f78de8c2 None admin] PATH_INFO: `/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e/users/1cd412fc6cd34b63b08cbc412bbc7c60/roles/a5a6c597145c4b23983d1b04377af7ed` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:14.749652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7f5b9-fd66-468b-b3be-3275f78de8c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1ebfa3cb6824502854e0c58b4062f2e, user_id=1cd412fc6cd34b63b08cbc412bbc7c60, role_id=a5a6c597145c4b23983d1b04377af7ed)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:14.751091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7f5b9-fd66-468b-b3be-3275f78de8c2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:14.753387 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:14.765285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 566/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:52:14 2022] PUT /identity/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e/users/1cd412fc6cd34b63b08cbc412bbc7c60/roles/a5a6c597145c4b23983d1b04377af7ed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:52:16.782013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc4733-324d-4023-9768-61dbf4921967 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:16.782547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc4733-324d-4023-9768-61dbf4921967 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:16.782547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc4733-324d-4023-9768-61dbf4921967 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:16.783992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 558/1124] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:16.789529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5164766-2813-457b-9ece-80cb1a4b76fe None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:16.790018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5164766-2813-457b-9ece-80cb1a4b76fe None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:16.790122 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5164766-2813-457b-9ece-80cb1a4b76fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:16.809082 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d5164766-2813-457b-9ece-80cb1a4b76fe None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:16.810297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d5164766-2813-457b-9ece-80cb1a4b76fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:16.877583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 567/1125] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:16.901569 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc4733-324d-4023-9768-61dbf4921967 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:16.956616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:17.006427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc4733-324d-4023-9768-61dbf4921967 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:17.039440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6469a1-8454-425a-a8fb-1edf32162f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:17.040011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6469a1-8454-425a-a8fb-1edf32162f7f None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:17.040293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6469a1-8454-425a-a8fb-1edf32162f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:17.040565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6469a1-8454-425a-a8fb-1edf32162f7f None admin] PATH_INFO: `/v3/roles/a5a6c597145c4b23983d1b04377af7ed` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:17.041934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6469a1-8454-425a-a8fb-1edf32162f7f None admin] RBAC: Authorizing `identity:get_role(role_id=a5a6c597145c4b23983d1b04377af7ed)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:17.043284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6469a1-8454-425a-a8fb-1edf32162f7f None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:17.044634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 559/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:16 2022] GET /identity/v3/roles/a5a6c597145c4b23983d1b04377af7ed => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:17.051079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5164766-2813-457b-9ece-80cb1a4b76fe None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:17.152391 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5164766-2813-457b-9ece-80cb1a4b76fe None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:17.178204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:17.190192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a557272-945e-4c8d-9a5e-b7c556ccc308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:17.190830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a557272-945e-4c8d-9a5e-b7c556ccc308 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:17.191151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a557272-945e-4c8d-9a5e-b7c556ccc308 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:17.191428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a557272-945e-4c8d-9a5e-b7c556ccc308 None admin] PATH_INFO: `/v3/users/1cd412fc6cd34b63b08cbc412bbc7c60` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:17.192605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a557272-945e-4c8d-9a5e-b7c556ccc308 None admin] RBAC: Authorizing `identity:get_user(user_id=1cd412fc6cd34b63b08cbc412bbc7c60)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:17.194041 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a557272-945e-4c8d-9a5e-b7c556ccc308 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:17.195636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 568/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:17 2022] GET /identity/v3/users/1cd412fc6cd34b63b08cbc412bbc7c60 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:17.201504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6469a1-8454-425a-a8fb-1edf32162f7f None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:17.300688 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6469a1-8454-425a-a8fb-1edf32162f7f None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:17.320986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:17.337462 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780e23a-2400-4428-8b05-e67fe217a156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:17.338074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780e23a-2400-4428-8b05-e67fe217a156 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:17.338359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780e23a-2400-4428-8b05-e67fe217a156 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:17.338633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780e23a-2400-4428-8b05-e67fe217a156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:17.406103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780e23a-2400-4428-8b05-e67fe217a156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:17.407564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780e23a-2400-4428-8b05-e67fe217a156 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:17.508754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 560/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:52:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:52:17.514712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a557272-945e-4c8d-9a5e-b7c556ccc308 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:17.623405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a557272-945e-4c8d-9a5e-b7c556ccc308 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:17.657366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f182f-fdc1-4b16-8360-6a0250b60f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:17.657999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f182f-fdc1-4b16-8360-6a0250b60f28 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:17.658280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f182f-fdc1-4b16-8360-6a0250b60f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:17.658555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f182f-fdc1-4b16-8360-6a0250b60f28 None admin] PATH_INFO: `/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:17.659682 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f182f-fdc1-4b16-8360-6a0250b60f28 None admin] RBAC: Authorizing `identity:get_project(project_id=d1ebfa3cb6824502854e0c58b4062f2e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:17.661319 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f182f-fdc1-4b16-8360-6a0250b60f28 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:17.662949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 569/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:52:17 2022] GET /identity/v3/projects/d1ebfa3cb6824502854e0c58b4062f2e => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:17.669138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780e23a-2400-4428-8b05-e67fe217a156 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:17.690760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:17.768962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780e23a-2400-4428-8b05-e67fe217a156 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:17.803779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57717bfe-b12c-4c5d-aebc-b281517dacfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:17.804429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57717bfe-b12c-4c5d-aebc-b281517dacfb None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:17.804657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57717bfe-b12c-4c5d-aebc-b281517dacfb None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:17.804925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57717bfe-b12c-4c5d-aebc-b281517dacfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:17.805677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57717bfe-b12c-4c5d-aebc-b281517dacfb None admin] RBAC: Adding query filter params (role.id=a5a6c597145c4b23983d1b04377af7ed, scope.project.id=d1ebfa3cb6824502854e0c58b4062f2e, user.id=1cd412fc6cd34b63b08cbc412bbc7c60) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:17.805982 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57717bfe-b12c-4c5d-aebc-b281517dacfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:17.807444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57717bfe-b12c-4c5d-aebc-b281517dacfb None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:17.813418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 561/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:52:17 2022] GET /identity/v3/role_assignments?user.id=1cd412fc6cd34b63b08cbc412bbc7c60&scope.project.id=d1ebfa3cb6824502854e0c58b4062f2e&role.id=a5a6c597145c4b23983d1b04377af7ed => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:19.881260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fc7bc-54ac-4bc3-9b79-a93aba49acf4 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:19.881831 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fc7bc-54ac-4bc3-9b79-a93aba49acf4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:19.881831 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fc7bc-54ac-4bc3-9b79-a93aba49acf4 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:19.883143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 570/1131] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:19.888784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac2062-9d12-44b0-af2c-8d2f7ef2148b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:19.889241 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac2062-9d12-44b0-af2c-8d2f7ef2148b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:19.889504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac2062-9d12-44b0-af2c-8d2f7ef2148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:19.908467 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-75ac2062-9d12-44b0-af2c-8d2f7ef2148b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:19.909754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-75ac2062-9d12-44b0-af2c-8d2f7ef2148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:19.986494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 562/1132] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:52:20.010128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fc7bc-54ac-4bc3-9b79-a93aba49acf4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:20.071115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:20.114084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fc7bc-54ac-4bc3-9b79-a93aba49acf4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:20.149716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf9989-324b-4aab-87e4-5eddfec97888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:20.150258 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf9989-324b-4aab-87e4-5eddfec97888 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:20.150542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf9989-324b-4aab-87e4-5eddfec97888 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:20.150819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf9989-324b-4aab-87e4-5eddfec97888 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:20.151976 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf9989-324b-4aab-87e4-5eddfec97888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:20.153420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf9989-324b-4aab-87e4-5eddfec97888 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:20.155009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 571/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:52:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:20.161448 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac2062-9d12-44b0-af2c-8d2f7ef2148b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:20.176412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:20.267515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac2062-9d12-44b0-af2c-8d2f7ef2148b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:20.304147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29471d47-0bff-42bc-b5b1-eea0fb8dbdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:20.304753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471d47-0bff-42bc-b5b1-eea0fb8dbdb6 None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:20.305032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471d47-0bff-42bc-b5b1-eea0fb8dbdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:20.305304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471d47-0bff-42bc-b5b1-eea0fb8dbdb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:20.305945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29471d47-0bff-42bc-b5b1-eea0fb8dbdb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:20.307353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29471d47-0bff-42bc-b5b1-eea0fb8dbdb6 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:20.336436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 563/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:52:20 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:52:22.437760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d777518-281e-485a-adc6-6324ce39a0fe None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:22.438293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d777518-281e-485a-adc6-6324ce39a0fe None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:22.438293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d777518-281e-485a-adc6-6324ce39a0fe None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:22.439632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 572/1135] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:22.445570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6deda-7a1e-483c-97e9-50d29c96e032 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:22.446013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6deda-7a1e-483c-97e9-50d29c96e032 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:22.446107 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6deda-7a1e-483c-97e9-50d29c96e032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:22.464652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-a8e6deda-7a1e-483c-97e9-50d29c96e032 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:22.465832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a8e6deda-7a1e-483c-97e9-50d29c96e032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:22.524216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:22.534109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 564/1136] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:22.558441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d777518-281e-485a-adc6-6324ce39a0fe None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:22.663077 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d777518-281e-485a-adc6-6324ce39a0fe None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:22.693966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:22.703801 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e68ca7-7609-467c-aed6-7c7e73ce8fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:22.704445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e68ca7-7609-467c-aed6-7c7e73ce8fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:22.704728 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e68ca7-7609-467c-aed6-7c7e73ce8fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:22.705003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e68ca7-7609-467c-aed6-7c7e73ce8fa6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:22.706151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e68ca7-7609-467c-aed6-7c7e73ce8fa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:22.708289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e68ca7-7609-467c-aed6-7c7e73ce8fa6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:22.709875 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 573/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:52:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:22.715713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6deda-7a1e-483c-97e9-50d29c96e032 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:22.815748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6deda-7a1e-483c-97e9-50d29c96e032 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:22.850148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff96ad5-c94c-4ee4-93b2-5f7d46a8719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:22.850761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96ad5-c94c-4ee4-93b2-5f7d46a8719f None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:22.851047 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96ad5-c94c-4ee4-93b2-5f7d46a8719f None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:22.851323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96ad5-c94c-4ee4-93b2-5f7d46a8719f None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:22.852010 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff96ad5-c94c-4ee4-93b2-5f7d46a8719f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:22.853439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff96ad5-c94c-4ee4-93b2-5f7d46a8719f None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:22.879037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 565/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:52:22 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:52:24.921121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4078f9b-b4e5-4959-9e41-0f639a7baa74 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:24.921603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4078f9b-b4e5-4959-9e41-0f639a7baa74 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:24.921709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4078f9b-b4e5-4959-9e41-0f639a7baa74 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:24.922992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 574/1139] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:24.928407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029198c-1666-417c-8531-463a5a5b093c None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:24.929097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029198c-1666-417c-8531-463a5a5b093c None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:24.929215 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029198c-1666-417c-8531-463a5a5b093c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:24.948466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-6029198c-1666-417c-8531-463a5a5b093c None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:24.949673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6029198c-1666-417c-8531-463a5a5b093c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:24.996532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:25.017916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 566/1140] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:25.040942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4078f9b-b4e5-4959-9e41-0f639a7baa74 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:25.143198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4078f9b-b4e5-4959-9e41-0f639a7baa74 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:25.183132 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cb828-53b3-40da-bd0b-ff6a2c6ccee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:25.183796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cb828-53b3-40da-bd0b-ff6a2c6ccee2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:25.184083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cb828-53b3-40da-bd0b-ff6a2c6ccee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:25.184360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cb828-53b3-40da-bd0b-ff6a2c6ccee2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:25.194808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cb828-53b3-40da-bd0b-ff6a2c6ccee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-475cb828-53b3-40da-bd0b-ff6a2c6ccee2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:52:25.199553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:25.200684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:25.201800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:25.201800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:25.201800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:25.201800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:25.201800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:52:25.201800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:52:25.201800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:52:25.201800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:52:25.201800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:52:25.201800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:52:25.201800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:25.201800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:25.201800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 575/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:52:25.207287 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029198c-1666-417c-8531-463a5a5b093c None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:25.306799 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029198c-1666-417c-8531-463a5a5b093c None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:25.348383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377cd0e-793a-4e42-82ec-d23b7094eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:25.348991 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377cd0e-793a-4e42-82ec-d23b7094eec6 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:25.349270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377cd0e-793a-4e42-82ec-d23b7094eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:25.349538 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377cd0e-793a-4e42-82ec-d23b7094eec6 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:25.350202 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377cd0e-793a-4e42-82ec-d23b7094eec6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:25.350501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377cd0e-793a-4e42-82ec-d23b7094eec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:25.351872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377cd0e-793a-4e42-82ec-d23b7094eec6 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:25.361801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 567/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:25.367676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cb828-53b3-40da-bd0b-ff6a2c6ccee2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:25.425004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:25.469750 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cb828-53b3-40da-bd0b-ff6a2c6ccee2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:25.505170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d2a9e-27ec-4726-940f-3048c4257442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:25.505805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d2a9e-27ec-4726-940f-3048c4257442 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:25.506082 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d2a9e-27ec-4726-940f-3048c4257442 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:25.506350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d2a9e-27ec-4726-940f-3048c4257442 None admin] PATH_INFO: `/v3/users/13247930d856499ba308151f5289ab4b` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:25.521503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d2a9e-27ec-4726-940f-3048c4257442 None admin] RBAC: Authorizing `identity:get_user(user_id=13247930d856499ba308151f5289ab4b)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:25.522954 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d2a9e-27ec-4726-940f-3048c4257442 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:25.524650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 576/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:25 2022] GET /identity/v3/users/13247930d856499ba308151f5289ab4b => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:25.530541 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377cd0e-793a-4e42-82ec-d23b7094eec6 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:25.577424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:25.631907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377cd0e-793a-4e42-82ec-d23b7094eec6 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:25.665043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0b8da-892f-4777-bf2a-1580a60be993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:25.665648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0b8da-892f-4777-bf2a-1580a60be993 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:25.665925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0b8da-892f-4777-bf2a-1580a60be993 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:25.666196 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0b8da-892f-4777-bf2a-1580a60be993 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:25.732785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0b8da-892f-4777-bf2a-1580a60be993 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:25.734124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0b8da-892f-4777-bf2a-1580a60be993 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:25.777882 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:25.832433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 568/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:52:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:52:25.838464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d2a9e-27ec-4726-940f-3048c4257442 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:25.937782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d2a9e-27ec-4726-940f-3048c4257442 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:25.952802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:25.972956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc025683-a386-496d-957c-da272580530a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:25.973594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc025683-a386-496d-957c-da272580530a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:25.973876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc025683-a386-496d-957c-da272580530a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:25.974149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc025683-a386-496d-957c-da272580530a None admin] PATH_INFO: `/v3/projects/34f71a3834b748f28227c56132887251` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:25.975267 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc025683-a386-496d-957c-da272580530a None admin] RBAC: Authorizing `identity:get_project(project_id=34f71a3834b748f28227c56132887251)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:25.976744 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc025683-a386-496d-957c-da272580530a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:25.978374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 577/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:52:25 2022] GET /identity/v3/projects/34f71a3834b748f28227c56132887251 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:25.984769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0b8da-892f-4777-bf2a-1580a60be993 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:26.083928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0b8da-892f-4777-bf2a-1580a60be993 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:26.117910 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66460a0-f96e-4d5c-8578-0df39c9a41cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:26.118525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66460a0-f96e-4d5c-8578-0df39c9a41cc None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:26.118809 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66460a0-f96e-4d5c-8578-0df39c9a41cc None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:26.119082 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66460a0-f96e-4d5c-8578-0df39c9a41cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:26.119850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66460a0-f96e-4d5c-8578-0df39c9a41cc None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=34f71a3834b748f28227c56132887251, user.id=13247930d856499ba308151f5289ab4b) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:26.120161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66460a0-f96e-4d5c-8578-0df39c9a41cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:26.121586 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66460a0-f96e-4d5c-8578-0df39c9a41cc None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:26.127184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 569/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:52:25 2022] GET /identity/v3/role_assignments?user.id=13247930d856499ba308151f5289ab4b&scope.project.id=34f71a3834b748f28227c56132887251&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:28.131064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92172f-4be9-4d17-95df-b684debd6e49 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:28.131590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92172f-4be9-4d17-95df-b684debd6e49 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:28.131590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92172f-4be9-4d17-95df-b684debd6e49 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:28.133017 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 578/1147] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:28.138454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f2699-8380-4db8-a323-437a51ff60f6 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:28.138884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f2699-8380-4db8-a323-437a51ff60f6 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:28.139017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f2699-8380-4db8-a323-437a51ff60f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:28.157030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-271f2699-8380-4db8-a323-437a51ff60f6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:28.158227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-271f2699-8380-4db8-a323-437a51ff60f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:28.160336 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:28.230763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 570/1148] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:28.253726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92172f-4be9-4d17-95df-b684debd6e49 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:28.353829 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92172f-4be9-4d17-95df-b684debd6e49 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:28.389135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf2331-f6cd-448c-abb4-90a59c8174e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:28.389765 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf2331-f6cd-448c-abb4-90a59c8174e4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:28.390045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf2331-f6cd-448c-abb4-90a59c8174e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:28.390314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf2331-f6cd-448c-abb4-90a59c8174e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:28.400599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf2331-f6cd-448c-abb4-90a59c8174e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-5bdf2331-f6cd-448c-abb4-90a59c8174e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:52:28.405271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:28.406429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:28.407488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:28.407488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:28.407488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:28.407488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:28.407488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:52:28.407488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:52:28.407488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:52:28.407488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:52:28.407488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:52:28.407488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:52:28.407488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:28.407488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:28.407488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 579/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:52:28.413168 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f2699-8380-4db8-a323-437a51ff60f6 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:28.514926 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f2699-8380-4db8-a323-437a51ff60f6 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:28.548970 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7da7f-e7fa-4767-940b-4a2aaa616c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:28.549577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7da7f-e7fa-4767-940b-4a2aaa616c7f None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:28.549859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7da7f-e7fa-4767-940b-4a2aaa616c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:28.550785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7da7f-e7fa-4767-940b-4a2aaa616c7f None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:28.551449 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7da7f-e7fa-4767-940b-4a2aaa616c7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:28.551775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7da7f-e7fa-4767-940b-4a2aaa616c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:28.553139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7da7f-e7fa-4767-940b-4a2aaa616c7f None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:28.558533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:28.562542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 571/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:52:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:28.568457 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf2331-f6cd-448c-abb4-90a59c8174e4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:28.614345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:28.671194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf2331-f6cd-448c-abb4-90a59c8174e4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:28.706248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52376c5b-ce18-4fc2-8ade-82b390d3e005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:28.706881 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52376c5b-ce18-4fc2-8ade-82b390d3e005 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:28.707163 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52376c5b-ce18-4fc2-8ade-82b390d3e005 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:28.707436 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52376c5b-ce18-4fc2-8ade-82b390d3e005 None admin] PATH_INFO: `/v3/users/13247930d856499ba308151f5289ab4b` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:28.708606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52376c5b-ce18-4fc2-8ade-82b390d3e005 None admin] RBAC: Authorizing `identity:get_user(user_id=13247930d856499ba308151f5289ab4b)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:28.710039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52376c5b-ce18-4fc2-8ade-82b390d3e005 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:28.711614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 580/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:28 2022] GET /identity/v3/users/13247930d856499ba308151f5289ab4b => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:28.718089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7da7f-e7fa-4767-940b-4a2aaa616c7f None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:28.820418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7da7f-e7fa-4767-940b-4a2aaa616c7f None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:28.854368 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059c61e-b467-4e44-9aff-e6bcdd6649d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:28.855003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059c61e-b467-4e44-9aff-e6bcdd6649d8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:28.855289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059c61e-b467-4e44-9aff-e6bcdd6649d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:28.855565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059c61e-b467-4e44-9aff-e6bcdd6649d8 None admin] PATH_INFO: `/v3/projects/34f71a3834b748f28227c56132887251` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:28.856722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059c61e-b467-4e44-9aff-e6bcdd6649d8 None admin] RBAC: Authorizing `identity:get_project(project_id=34f71a3834b748f28227c56132887251)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:28.858138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059c61e-b467-4e44-9aff-e6bcdd6649d8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:28.859797 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 572/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:52:28 2022] GET /identity/v3/projects/34f71a3834b748f28227c56132887251 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:28.865834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52376c5b-ce18-4fc2-8ade-82b390d3e005 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:28.969446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52376c5b-ce18-4fc2-8ade-82b390d3e005 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:28.981077 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:29.007453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8d1e2-3c88-44b1-b824-4f6dfcbfe405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:29.008148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8d1e2-3c88-44b1-b824-4f6dfcbfe405 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:29.008430 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8d1e2-3c88-44b1-b824-4f6dfcbfe405 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:29.008704 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8d1e2-3c88-44b1-b824-4f6dfcbfe405 None admin] PATH_INFO: `/v3/projects/34f71a3834b748f28227c56132887251/users/13247930d856499ba308151f5289ab4b/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:29.010610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8d1e2-3c88-44b1-b824-4f6dfcbfe405 None admin] RBAC: Authorizing `identity:create_grant(project_id=34f71a3834b748f28227c56132887251, user_id=13247930d856499ba308151f5289ab4b, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:29.012069 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8d1e2-3c88-44b1-b824-4f6dfcbfe405 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:29.028624 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 581/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:52:28 2022] PUT /identity/v3/projects/34f71a3834b748f28227c56132887251/users/13247930d856499ba308151f5289ab4b/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:52:31.010727 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b7f3-877e-4464-ad89-7069c41cb9a1 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:31.011277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b7f3-877e-4464-ad89-7069c41cb9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:31.011277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b7f3-877e-4464-ad89-7069c41cb9a1 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:31.012630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 573/1154] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:31.017876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf519a-26ed-4528-b4d2-244e803e74c6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:31.018310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf519a-26ed-4528-b4d2-244e803e74c6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:31.018427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf519a-26ed-4528-b4d2-244e803e74c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:31.037652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-dfbf519a-26ed-4528-b4d2-244e803e74c6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:31.038854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dfbf519a-26ed-4528-b4d2-244e803e74c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:31.107287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 582/1155] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:31.130289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b7f3-877e-4464-ad89-7069c41cb9a1 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:31.206032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:31.242324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b7f3-877e-4464-ad89-7069c41cb9a1 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:31.280496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f040846-5b6a-4acf-9e4e-487cebb70bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:31.281121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040846-5b6a-4acf-9e4e-487cebb70bcd None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:31.281403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040846-5b6a-4acf-9e4e-487cebb70bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:31.281671 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040846-5b6a-4acf-9e4e-487cebb70bcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:31.292914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f040846-5b6a-4acf-9e4e-487cebb70bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-4f040846-5b6a-4acf-9e4e-487cebb70bcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:52:31.297559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:31.298661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:31.299614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:31.299614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:31.299614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:31.299614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:31.299614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:52:31.299614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:52:31.299614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:52:31.299614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:52:31.299614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:52:31.299614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:52:31.299614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:31.299614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:52:31.299614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 574/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:52:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:52:31.305087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf519a-26ed-4528-b4d2-244e803e74c6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:31.401660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:31.404674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf519a-26ed-4528-b4d2-244e803e74c6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:31.440975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d445b-2b98-4380-b043-7e3060c748a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:31.441703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d445b-2b98-4380-b043-7e3060c748a8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:31.441996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d445b-2b98-4380-b043-7e3060c748a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:31.442270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d445b-2b98-4380-b043-7e3060c748a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:31.442974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d445b-2b98-4380-b043-7e3060c748a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:31.443277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d445b-2b98-4380-b043-7e3060c748a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:31.444694 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d445b-2b98-4380-b043-7e3060c748a8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:31.453482 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 583/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:52:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:31.459877 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f040846-5b6a-4acf-9e4e-487cebb70bcd None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:31.570538 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f040846-5b6a-4acf-9e4e-487cebb70bcd None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:31.598018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:31.606817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2718c-a64f-4d76-a55a-7833c33b5872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:31.607451 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2718c-a64f-4d76-a55a-7833c33b5872 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:31.607751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2718c-a64f-4d76-a55a-7833c33b5872 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:31.608039 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2718c-a64f-4d76-a55a-7833c33b5872 None admin] PATH_INFO: `/v3/users/13247930d856499ba308151f5289ab4b` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:31.609180 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2718c-a64f-4d76-a55a-7833c33b5872 None admin] RBAC: Authorizing `identity:get_user(user_id=13247930d856499ba308151f5289ab4b)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:31.610612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2718c-a64f-4d76-a55a-7833c33b5872 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:31.612288 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 575/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:31 2022] GET /identity/v3/users/13247930d856499ba308151f5289ab4b => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:31.618253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d445b-2b98-4380-b043-7e3060c748a8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:31.720998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d445b-2b98-4380-b043-7e3060c748a8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:31.754762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f5514-1323-4637-99df-44771b07a3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:31.755287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f5514-1323-4637-99df-44771b07a3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:31.755570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f5514-1323-4637-99df-44771b07a3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:31.755877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f5514-1323-4637-99df-44771b07a3d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:31.789652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:31.833359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f5514-1323-4637-99df-44771b07a3d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:31.834809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f5514-1323-4637-99df-44771b07a3d2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:31.944562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 584/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:52:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:52:31.950540 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2718c-a64f-4d76-a55a-7833c33b5872 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:32.050340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2718c-a64f-4d76-a55a-7833c33b5872 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:32.084546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745581b-107a-405c-a3a6-7e0c4b40061d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:32.085172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745581b-107a-405c-a3a6-7e0c4b40061d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:32.085456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745581b-107a-405c-a3a6-7e0c4b40061d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:32.085730 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745581b-107a-405c-a3a6-7e0c4b40061d None admin] PATH_INFO: `/v3/projects/34f71a3834b748f28227c56132887251` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:32.086854 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745581b-107a-405c-a3a6-7e0c4b40061d None admin] RBAC: Authorizing `identity:get_project(project_id=34f71a3834b748f28227c56132887251)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:32.088325 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745581b-107a-405c-a3a6-7e0c4b40061d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:32.089968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 576/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:52:31 2022] GET /identity/v3/projects/34f71a3834b748f28227c56132887251 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:32.096213 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f5514-1323-4637-99df-44771b07a3d2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:32.160674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:32.200857 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f5514-1323-4637-99df-44771b07a3d2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:32.235261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465141d0-58e0-4d1d-a183-e53fab35620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:32.235907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465141d0-58e0-4d1d-a183-e53fab35620c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:32.236195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465141d0-58e0-4d1d-a183-e53fab35620c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:32.236473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465141d0-58e0-4d1d-a183-e53fab35620c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:32.237206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465141d0-58e0-4d1d-a183-e53fab35620c None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=34f71a3834b748f28227c56132887251, user.id=13247930d856499ba308151f5289ab4b) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:32.238124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465141d0-58e0-4d1d-a183-e53fab35620c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:32.239565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465141d0-58e0-4d1d-a183-e53fab35620c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:32.245734 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 585/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:52:32 2022] GET /identity/v3/role_assignments?user.id=13247930d856499ba308151f5289ab4b&scope.project.id=34f71a3834b748f28227c56132887251&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:34.280439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd626ab8-9142-41a1-9d53-b042496970a8 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:34.281036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd626ab8-9142-41a1-9d53-b042496970a8 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:34.281036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd626ab8-9142-41a1-9d53-b042496970a8 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:34.282313 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 577/1162] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:34.287686 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a2a3e-43a1-4549-99d5-7f09f8bbe853 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:34.288167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a2a3e-43a1-4549-99d5-7f09f8bbe853 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:34.288293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a2a3e-43a1-4549-99d5-7f09f8bbe853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:34.307180 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f08a2a3e-43a1-4549-99d5-7f09f8bbe853 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:34.308433 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f08a2a3e-43a1-4549-99d5-7f09f8bbe853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:34.375480 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 586/1163] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:34.398327 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd626ab8-9142-41a1-9d53-b042496970a8 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:34.461778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:34.503163 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd626ab8-9142-41a1-9d53-b042496970a8 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:34.536827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb95756-c318-453b-a28c-5d6f04b732ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:34.537340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95756-c318-453b-a28c-5d6f04b732ae None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:34.537621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95756-c318-453b-a28c-5d6f04b732ae None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:34.537897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95756-c318-453b-a28c-5d6f04b732ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:34.609314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb95756-c318-453b-a28c-5d6f04b732ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:34.610765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb95756-c318-453b-a28c-5d6f04b732ae None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:34.671528 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:34.713168 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 578/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:52:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:52:34.719179 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a2a3e-43a1-4549-99d5-7f09f8bbe853 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:34.775902 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:34.820220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a2a3e-43a1-4549-99d5-7f09f8bbe853 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:34.856080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ff04b-08ba-4a83-8b28-3d37528c5627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:34.856704 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ff04b-08ba-4a83-8b28-3d37528c5627 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:34.856980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ff04b-08ba-4a83-8b28-3d37528c5627 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:34.857253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ff04b-08ba-4a83-8b28-3d37528c5627 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:34.863984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ff04b-08ba-4a83-8b28-3d37528c5627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:34.865411 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ff04b-08ba-4a83-8b28-3d37528c5627 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-6b8ff04b-08ba-4a83-8b28-3d37528c5627 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:34.876693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:34.877987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:34.878909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 587/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Aug 10 07:52:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:52:34.884232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb95756-c318-453b-a28c-5d6f04b732ae None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:34.987207 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb95756-c318-453b-a28c-5d6f04b732ae None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:35.021645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9577d98-f405-40e8-a118-d3f116201a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:35.022287 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9577d98-f405-40e8-a118-d3f116201a4a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:35.022707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9577d98-f405-40e8-a118-d3f116201a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:35.022988 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9577d98-f405-40e8-a118-d3f116201a4a None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:35.023644 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9577d98-f405-40e8-a118-d3f116201a4a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:35.023983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9577d98-f405-40e8-a118-d3f116201a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:35.025345 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9577d98-f405-40e8-a118-d3f116201a4a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:35.033015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 579/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Aug 10 07:52:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:52:37.043684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fa47e-e18e-461c-96ba-ff0190dd2698 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:37.044348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fa47e-e18e-461c-96ba-ff0190dd2698 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:37.044701 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fa47e-e18e-461c-96ba-ff0190dd2698 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:37.046951 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 588/1167] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:37.053293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12d28c-0c11-48c4-af98-980b3b890cd5 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:37.054059 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12d28c-0c11-48c4-af98-980b3b890cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:37.054162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12d28c-0c11-48c4-af98-980b3b890cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:37.072656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-1f12d28c-0c11-48c4-af98-980b3b890cd5 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:37.073865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1f12d28c-0c11-48c4-af98-980b3b890cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:37.117281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:37.168106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 580/1168] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:37.192155 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fa47e-e18e-461c-96ba-ff0190dd2698 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:37.303935 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fa47e-e18e-461c-96ba-ff0190dd2698 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:37.328118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:37.346926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154399c-177f-46fd-8ae4-57c027695f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:37.347544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154399c-177f-46fd-8ae4-57c027695f08 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:37.347945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154399c-177f-46fd-8ae4-57c027695f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:37.348216 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154399c-177f-46fd-8ae4-57c027695f08 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:37.348883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154399c-177f-46fd-8ae4-57c027695f08 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:37.350252 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154399c-177f-46fd-8ae4-57c027695f08 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:37.366804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 589/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Wed Aug 10 07:52:37 2022] POST /identity/v3/domains => generated 267 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:52:39.457583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988db1b-99d4-4519-a791-c5b8637abb62 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:39.458134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988db1b-99d4-4519-a791-c5b8637abb62 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:39.458134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988db1b-99d4-4519-a791-c5b8637abb62 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:39.459477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 581/1170] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:39.465093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e809b9-1747-44e8-b279-9235b4aef87f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:39.465548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e809b9-1747-44e8-b279-9235b4aef87f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:39.465644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e809b9-1747-44e8-b279-9235b4aef87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:39.488036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-77e809b9-1747-44e8-b279-9235b4aef87f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:39.489263 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-77e809b9-1747-44e8-b279-9235b4aef87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:39.557493 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 590/1171] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:39.581025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988db1b-99d4-4519-a791-c5b8637abb62 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:39.691036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988db1b-99d4-4519-a791-c5b8637abb62 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:39.726174 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe878625-ab3d-49a7-b21c-af21371d14bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:39.726724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878625-ab3d-49a7-b21c-af21371d14bc None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:39.727007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878625-ab3d-49a7-b21c-af21371d14bc None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:39.727281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878625-ab3d-49a7-b21c-af21371d14bc None admin] PATH_INFO: `/v3/domains/e08af9c380ad4543aa4ab4cf34361181` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:39.738421 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe878625-ab3d-49a7-b21c-af21371d14bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=e08af9c380ad4543aa4ab4cf34361181)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:39.739896 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe878625-ab3d-49a7-b21c-af21371d14bc None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:39.741568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 582/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Wed Aug 10 07:52:39 2022] GET /identity/v3/domains/e08af9c380ad4543aa4ab4cf34361181 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:39.747459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e809b9-1747-44e8-b279-9235b4aef87f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:39.846147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e809b9-1747-44e8-b279-9235b4aef87f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:39.854061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:39.881983 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0976ec5-18d0-4549-a899-5f963b1ec73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:39.882594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0976ec5-18d0-4549-a899-5f963b1ec73f None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:39.882877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0976ec5-18d0-4549-a899-5f963b1ec73f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:39.883146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0976ec5-18d0-4549-a899-5f963b1ec73f None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:39.883830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0976ec5-18d0-4549-a899-5f963b1ec73f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:39.885307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0976ec5-18d0-4549-a899-5f963b1ec73f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:39.912666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 591/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:52:39 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:52:41.959803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49c79c-d3f5-4c22-8847-b09ab8a88eb3 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:41.960363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49c79c-d3f5-4c22-8847-b09ab8a88eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:41.960363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49c79c-d3f5-4c22-8847-b09ab8a88eb3 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:41.961736 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 583/1174] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:41.967042 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6279-38a4-4d7d-b485-9d02b4e603b8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:41.967515 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6279-38a4-4d7d-b485-9d02b4e603b8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:41.967621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6279-38a4-4d7d-b485-9d02b4e603b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:41.985900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f36b6279-38a4-4d7d-b485-9d02b4e603b8 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:41.987274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f36b6279-38a4-4d7d-b485-9d02b4e603b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:42.054406 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 592/1175] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:42.079416 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49c79c-d3f5-4c22-8847-b09ab8a88eb3 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:42.099211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:42.182583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49c79c-d3f5-4c22-8847-b09ab8a88eb3 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:42.216405 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9379575-a9e7-4715-9060-fa029dd45b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:42.217025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379575-a9e7-4715-9060-fa029dd45b2d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:42.217305 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379575-a9e7-4715-9060-fa029dd45b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:42.217576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379575-a9e7-4715-9060-fa029dd45b2d None admin] PATH_INFO: `/v3/domains/e08af9c380ad4543aa4ab4cf34361181` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:42.218676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9379575-a9e7-4715-9060-fa029dd45b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=e08af9c380ad4543aa4ab4cf34361181)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:42.220107 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9379575-a9e7-4715-9060-fa029dd45b2d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:42.221696 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 584/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Wed Aug 10 07:52:42 2022] GET /identity/v3/domains/e08af9c380ad4543aa4ab4cf34361181 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:42.227613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b6279-38a4-4d7d-b485-9d02b4e603b8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:42.319090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:42.331936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b6279-38a4-4d7d-b485-9d02b4e603b8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:42.366800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41094ea-aa6a-4626-a04f-65e504a6756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:42.367428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41094ea-aa6a-4626-a04f-65e504a6756f None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:42.367707 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41094ea-aa6a-4626-a04f-65e504a6756f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:42.368010 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41094ea-aa6a-4626-a04f-65e504a6756f None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:42.368670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41094ea-aa6a-4626-a04f-65e504a6756f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:42.370113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41094ea-aa6a-4626-a04f-65e504a6756f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:42.394120 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 593/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:52:42 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:52:44.459431 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f1d5f-12ec-4ea1-95c9-a76d25d9a379 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:44.460008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f1d5f-12ec-4ea1-95c9-a76d25d9a379 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:44.460008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f1d5f-12ec-4ea1-95c9-a76d25d9a379 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:44.461340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 585/1178] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:44.466770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd0971-9a76-4732-bf36-62c0b5c4ea70 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:44.467224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd0971-9a76-4732-bf36-62c0b5c4ea70 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:44.467338 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd0971-9a76-4732-bf36-62c0b5c4ea70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:44.486563 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-70fd0971-9a76-4732-bf36-62c0b5c4ea70 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:44.488425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-70fd0971-9a76-4732-bf36-62c0b5c4ea70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:44.556368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 594/1179] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:44.579248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f1d5f-12ec-4ea1-95c9-a76d25d9a379 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:44.665685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:44.683236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f1d5f-12ec-4ea1-95c9-a76d25d9a379 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:44.718513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d888f-05f7-4632-b576-c72b17233200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:44.719075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d888f-05f7-4632-b576-c72b17233200 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:44.719358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d888f-05f7-4632-b576-c72b17233200 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:44.719634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d888f-05f7-4632-b576-c72b17233200 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:44.731177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d888f-05f7-4632-b576-c72b17233200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-327d888f-05f7-4632-b576-c72b17233200 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:52:44.735916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:44.736933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:44.740793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:44.740793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:44.740793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:44.740793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:44.740793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:52:44.740793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:52:44.740793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:52:44.740793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:52:44.740793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:52:44.740793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:52:44.740793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:44.740793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:52:44.740793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 586/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:52:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:52:44.743613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd0971-9a76-4732-bf36-62c0b5c4ea70 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:44.821515 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:44.849506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd0971-9a76-4732-bf36-62c0b5c4ea70 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:44.886075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c2831-59af-45ad-b4f4-10f9e7357aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:44.886686 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c2831-59af-45ad-b4f4-10f9e7357aea None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:44.886954 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c2831-59af-45ad-b4f4-10f9e7357aea None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:44.887228 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c2831-59af-45ad-b4f4-10f9e7357aea None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:44.887926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c2831-59af-45ad-b4f4-10f9e7357aea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:44.888231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c2831-59af-45ad-b4f4-10f9e7357aea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:44.889645 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c2831-59af-45ad-b4f4-10f9e7357aea None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:44.899365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 595/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:52:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:44.905265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d888f-05f7-4632-b576-c72b17233200 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:45.008058 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d888f-05f7-4632-b576-c72b17233200 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:45.041361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76af4c4-eaf2-4318-b954-202f66654714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:45.041990 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76af4c4-eaf2-4318-b954-202f66654714 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:45.042270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76af4c4-eaf2-4318-b954-202f66654714 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:45.042544 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76af4c4-eaf2-4318-b954-202f66654714 None admin] PATH_INFO: `/v3/users/72ae33210e384df58bd41b8331ba732f` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:45.055927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76af4c4-eaf2-4318-b954-202f66654714 None admin] RBAC: Authorizing `identity:get_user(user_id=72ae33210e384df58bd41b8331ba732f)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:45.057352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76af4c4-eaf2-4318-b954-202f66654714 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:45.058992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 587/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:44 2022] GET /identity/v3/users/72ae33210e384df58bd41b8331ba732f => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:52:45.065526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c2831-59af-45ad-b4f4-10f9e7357aea None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:45.165266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c2831-59af-45ad-b4f4-10f9e7357aea None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:45.199051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaa643-8780-4a55-a67f-c7e4d0eeeea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:45.199663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaa643-8780-4a55-a67f-c7e4d0eeeea6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:45.199979 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaa643-8780-4a55-a67f-c7e4d0eeeea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:45.200253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaa643-8780-4a55-a67f-c7e4d0eeeea6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:45.203744 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:45.269859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfaa643-8780-4a55-a67f-c7e4d0eeeea6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:45.271231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfaa643-8780-4a55-a67f-c7e4d0eeeea6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:45.373917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 596/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:52:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:52:45.379993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76af4c4-eaf2-4318-b954-202f66654714 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:45.383830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:45.481717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76af4c4-eaf2-4318-b954-202f66654714 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:45.515493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522dde8-0d23-4e06-80fa-4b322969cdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:45.516172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522dde8-0d23-4e06-80fa-4b322969cdcf None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:45.516464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522dde8-0d23-4e06-80fa-4b322969cdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:45.516740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522dde8-0d23-4e06-80fa-4b322969cdcf None admin] PATH_INFO: `/v3/projects/c95cb3866db745788ff1bb5ba6b72645` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:45.517870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522dde8-0d23-4e06-80fa-4b322969cdcf None admin] RBAC: Authorizing `identity:get_project(project_id=c95cb3866db745788ff1bb5ba6b72645)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:45.519918 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522dde8-0d23-4e06-80fa-4b322969cdcf None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:45.521573 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 588/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:52:45 2022] GET /identity/v3/projects/c95cb3866db745788ff1bb5ba6b72645 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:45.527913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaa643-8780-4a55-a67f-c7e4d0eeeea6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:45.561785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:45.635053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaa643-8780-4a55-a67f-c7e4d0eeeea6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:45.670148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2f97f-de74-4cc3-a02d-40f0ab16fee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:45.670748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2f97f-de74-4cc3-a02d-40f0ab16fee8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:45.671028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2f97f-de74-4cc3-a02d-40f0ab16fee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:45.671299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2f97f-de74-4cc3-a02d-40f0ab16fee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:45.672047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2f97f-de74-4cc3-a02d-40f0ab16fee8 None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=c95cb3866db745788ff1bb5ba6b72645, user.id=72ae33210e384df58bd41b8331ba732f) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:45.672354 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2f97f-de74-4cc3-a02d-40f0ab16fee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:45.673785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2f97f-de74-4cc3-a02d-40f0ab16fee8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:45.679751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 597/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:52:45 2022] GET /identity/v3/role_assignments?user.id=72ae33210e384df58bd41b8331ba732f&scope.project.id=c95cb3866db745788ff1bb5ba6b72645&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:47.664631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976035bf-6e8d-4c93-854a-9b16532fa02f None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:47.665174 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976035bf-6e8d-4c93-854a-9b16532fa02f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:47.665174 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976035bf-6e8d-4c93-854a-9b16532fa02f None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:47.666505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 589/1186] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:47.672212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce153f9e-b153-4b9e-9a53-fde92f8e82cf None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:47.672643 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce153f9e-b153-4b9e-9a53-fde92f8e82cf None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:47.672799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce153f9e-b153-4b9e-9a53-fde92f8e82cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:47.691160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ce153f9e-b153-4b9e-9a53-fde92f8e82cf None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:47.692402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ce153f9e-b153-4b9e-9a53-fde92f8e82cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:47.760324 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 598/1187] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:52:47.783063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976035bf-6e8d-4c93-854a-9b16532fa02f None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:47.855763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:47.886994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976035bf-6e8d-4c93-854a-9b16532fa02f None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:47.923530 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d49e5-90dd-4ea4-9d7f-f806e51c951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:47.924210 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d49e5-90dd-4ea4-9d7f-f806e51c951e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:47.924496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d49e5-90dd-4ea4-9d7f-f806e51c951e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:47.924773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d49e5-90dd-4ea4-9d7f-f806e51c951e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:47.935272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d49e5-90dd-4ea4-9d7f-f806e51c951e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-269d49e5-90dd-4ea4-9d7f-f806e51c951e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:52:47.940535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:47.941653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:47.942765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:47.942765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:47.942765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:47.942765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:47.942765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:52:47.942765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:52:47.942765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:52:47.942765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:52:47.942765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:52:47.942765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:52:47.942765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:47.942765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:52:47.942765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 590/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:52:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:52:47.947916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce153f9e-b153-4b9e-9a53-fde92f8e82cf None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:47.978262 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:48.049140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce153f9e-b153-4b9e-9a53-fde92f8e82cf None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:48.083641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05c400-4002-4cc2-9059-cd303a0c9037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:48.084280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05c400-4002-4cc2-9059-cd303a0c9037 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:48.084560 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05c400-4002-4cc2-9059-cd303a0c9037 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:48.084832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05c400-4002-4cc2-9059-cd303a0c9037 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:48.085518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05c400-4002-4cc2-9059-cd303a0c9037 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:48.085815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05c400-4002-4cc2-9059-cd303a0c9037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:48.087182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05c400-4002-4cc2-9059-cd303a0c9037 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:48.095434 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 599/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:52:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:48.101699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d49e5-90dd-4ea4-9d7f-f806e51c951e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:48.212337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d49e5-90dd-4ea4-9d7f-f806e51c951e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:48.242518 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:48.247986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418c056-3ee3-44ee-a8e8-70a2fe2af8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:48.248623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418c056-3ee3-44ee-a8e8-70a2fe2af8fa None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:48.248910 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418c056-3ee3-44ee-a8e8-70a2fe2af8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:48.249190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418c056-3ee3-44ee-a8e8-70a2fe2af8fa None admin] PATH_INFO: `/v3/users/72ae33210e384df58bd41b8331ba732f` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:48.250334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418c056-3ee3-44ee-a8e8-70a2fe2af8fa None admin] RBAC: Authorizing `identity:get_user(user_id=72ae33210e384df58bd41b8331ba732f)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:48.251806 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418c056-3ee3-44ee-a8e8-70a2fe2af8fa None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:48.253973 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 591/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:48 2022] GET /identity/v3/users/72ae33210e384df58bd41b8331ba732f => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:48.260129 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05c400-4002-4cc2-9059-cd303a0c9037 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:48.355833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:48.365971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05c400-4002-4cc2-9059-cd303a0c9037 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:48.402031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b213e-94b1-436b-8f53-3e1035d7ae1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:48.402668 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b213e-94b1-436b-8f53-3e1035d7ae1c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:48.402944 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b213e-94b1-436b-8f53-3e1035d7ae1c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:48.403217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b213e-94b1-436b-8f53-3e1035d7ae1c None admin] PATH_INFO: `/v3/projects/c95cb3866db745788ff1bb5ba6b72645` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:48.404344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b213e-94b1-436b-8f53-3e1035d7ae1c None admin] RBAC: Authorizing `identity:get_project(project_id=c95cb3866db745788ff1bb5ba6b72645)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:48.405777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b213e-94b1-436b-8f53-3e1035d7ae1c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:48.407408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 600/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:52:48 2022] GET /identity/v3/projects/c95cb3866db745788ff1bb5ba6b72645 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:48.413462 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418c056-3ee3-44ee-a8e8-70a2fe2af8fa None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:48.512625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418c056-3ee3-44ee-a8e8-70a2fe2af8fa None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:48.544921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0105ff-f9af-459b-ac9e-2f3b435e632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:48.545575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0105ff-f9af-459b-ac9e-2f3b435e632b None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:48.545852 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0105ff-f9af-459b-ac9e-2f3b435e632b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:48.546119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0105ff-f9af-459b-ac9e-2f3b435e632b None admin] PATH_INFO: `/v3/projects/c95cb3866db745788ff1bb5ba6b72645/users/72ae33210e384df58bd41b8331ba732f/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:48.548028 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0105ff-f9af-459b-ac9e-2f3b435e632b None admin] RBAC: Authorizing `identity:create_grant(project_id=c95cb3866db745788ff1bb5ba6b72645, user_id=72ae33210e384df58bd41b8331ba732f, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:48.549964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0105ff-f9af-459b-ac9e-2f3b435e632b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:48.562789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 592/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:52:48 2022] PUT /identity/v3/projects/c95cb3866db745788ff1bb5ba6b72645/users/72ae33210e384df58bd41b8331ba732f/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:52:50.583969 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc1b35-5be1-42b8-8b91-9051c8130a90 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:50.584577 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc1b35-5be1-42b8-8b91-9051c8130a90 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:50.584682 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc1b35-5be1-42b8-8b91-9051c8130a90 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:50.585968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 601/1193] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:52:50.591318 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4caf6-ae6f-42de-b57e-550e3c4a5efb None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:50.591776 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4caf6-ae6f-42de-b57e-550e3c4a5efb None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:50.591889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4caf6-ae6f-42de-b57e-550e3c4a5efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:50.610006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-aec4caf6-ae6f-42de-b57e-550e3c4a5efb None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:52:50.611238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-aec4caf6-ae6f-42de-b57e-550e3c4a5efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:52:50.669237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:50.682460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 593/1194] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:52:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:52:50.706575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc1b35-5be1-42b8-8b91-9051c8130a90 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:50.808972 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc1b35-5be1-42b8-8b91-9051c8130a90 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:50.842955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9e67a-b99b-4d97-b358-206143f01181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:50.843503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9e67a-b99b-4d97-b358-206143f01181 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:50.843806 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9e67a-b99b-4d97-b358-206143f01181 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:50.844081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9e67a-b99b-4d97-b358-206143f01181 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:50.854775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9e67a-b99b-4d97-b358-206143f01181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-02e9e67a-b99b-4d97-b358-206143f01181 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:52:50.859392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:52:50.860562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:52:50.861446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:52:50.861446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:52:50.861446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:52:50.861446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:52:50.861446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:52:50.861446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:52:50.861446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:52:50.861446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:52:50.861446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:52:50.861446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:52:50.861446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:52:50.861446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:52:50.861446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 602/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:52:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:52:50.867228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4caf6-ae6f-42de-b57e-550e3c4a5efb None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:50.968074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4caf6-ae6f-42de-b57e-550e3c4a5efb None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:51.002476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164527c4-5371-42c1-a56c-d3c6ac5f8080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:51.003080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164527c4-5371-42c1-a56c-d3c6ac5f8080 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:51.003361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164527c4-5371-42c1-a56c-d3c6ac5f8080 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:51.003635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164527c4-5371-42c1-a56c-d3c6ac5f8080 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:51.004329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164527c4-5371-42c1-a56c-d3c6ac5f8080 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:51.004629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164527c4-5371-42c1-a56c-d3c6ac5f8080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:51.005979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164527c4-5371-42c1-a56c-d3c6ac5f8080 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:51.014517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 594/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:52:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:51.020389 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9e67a-b99b-4d97-b358-206143f01181 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:51.042868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:51.125491 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9e67a-b99b-4d97-b358-206143f01181 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:51.158349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2474920-3a48-447f-af95-bc29bbea0c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:51.159496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2474920-3a48-447f-af95-bc29bbea0c9b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:51.159797 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2474920-3a48-447f-af95-bc29bbea0c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:51.160067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2474920-3a48-447f-af95-bc29bbea0c9b None admin] PATH_INFO: `/v3/users/72ae33210e384df58bd41b8331ba732f` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:51.161187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2474920-3a48-447f-af95-bc29bbea0c9b None admin] RBAC: Authorizing `identity:get_user(user_id=72ae33210e384df58bd41b8331ba732f)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:51.162631 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2474920-3a48-447f-af95-bc29bbea0c9b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:51.164236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 603/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 10 07:52:51 2022] GET /identity/v3/users/72ae33210e384df58bd41b8331ba732f => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:51.170098 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164527c4-5371-42c1-a56c-d3c6ac5f8080 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:51.224021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:51.271312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164527c4-5371-42c1-a56c-d3c6ac5f8080 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:51.303760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa93b3-dd73-48f8-a6b3-f29d125c4857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:51.304361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa93b3-dd73-48f8-a6b3-f29d125c4857 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:51.304643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa93b3-dd73-48f8-a6b3-f29d125c4857 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:51.304916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa93b3-dd73-48f8-a6b3-f29d125c4857 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:51.369485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa93b3-dd73-48f8-a6b3-f29d125c4857 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:51.370925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa93b3-dd73-48f8-a6b3-f29d125c4857 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:51.420587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:51.466776 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 595/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:52:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:52:51.473320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2474920-3a48-447f-af95-bc29bbea0c9b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:51.563057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:52:51.575605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2474920-3a48-447f-af95-bc29bbea0c9b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:51.610103 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4621c57-4356-4272-8044-c8b0e7757c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:51.610804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4621c57-4356-4272-8044-c8b0e7757c09 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:51.610997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4621c57-4356-4272-8044-c8b0e7757c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:51.611272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4621c57-4356-4272-8044-c8b0e7757c09 None admin] PATH_INFO: `/v3/projects/c95cb3866db745788ff1bb5ba6b72645` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:51.612378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4621c57-4356-4272-8044-c8b0e7757c09 None admin] RBAC: Authorizing `identity:get_project(project_id=c95cb3866db745788ff1bb5ba6b72645)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:51.613855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4621c57-4356-4272-8044-c8b0e7757c09 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:51.615488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 604/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 10 07:52:51 2022] GET /identity/v3/projects/c95cb3866db745788ff1bb5ba6b72645 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:52:51.621717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa93b3-dd73-48f8-a6b3-f29d125c4857 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:52:51.726168 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa93b3-dd73-48f8-a6b3-f29d125c4857 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:52:51.760750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafb0ca-a978-403b-a8e9-f54129fe3f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:52:51.761743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafb0ca-a978-403b-a8e9-f54129fe3f07 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:52:51.762245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafb0ca-a978-403b-a8e9-f54129fe3f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:52:51.762739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafb0ca-a978-403b-a8e9-f54129fe3f07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:52:51.764152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafb0ca-a978-403b-a8e9-f54129fe3f07 None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=c95cb3866db745788ff1bb5ba6b72645, user.id=72ae33210e384df58bd41b8331ba732f) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:52:51.764712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafb0ca-a978-403b-a8e9-f54129fe3f07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:52:51.767440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafb0ca-a978-403b-a8e9-f54129fe3f07 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:52:51.778299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 596/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:52:51 2022] GET /identity/v3/role_assignments?user.id=72ae33210e384df58bd41b8331ba732f&scope.project.id=c95cb3866db745788ff1bb5ba6b72645&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:53:01.605747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=22 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:01.774000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:48.174560 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07519735-a3b9-4df2-a45b-cbd392dd581c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:48.175234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07519735-a3b9-4df2-a45b-cbd392dd581c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:48.175234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07519735-a3b9-4df2-a45b-cbd392dd581c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:48.176919 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 605/1201] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:53:48.183517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48061bb8-87fe-4d61-b733-d0ba7b5124aa None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:48.184319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48061bb8-87fe-4d61-b733-d0ba7b5124aa None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:48.184319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48061bb8-87fe-4d61-b733-d0ba7b5124aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:48.209169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-48061bb8-87fe-4d61-b733-d0ba7b5124aa None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:53:48.210439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-48061bb8-87fe-4d61-b733-d0ba7b5124aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:53:48.298054 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 597/1202] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:53:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:53:48.330633 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07519735-a3b9-4df2-a45b-cbd392dd581c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:48.476109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07519735-a3b9-4df2-a45b-cbd392dd581c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:48.519741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c2421-bc80-40e6-ab20-59d115673059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:48.520441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c2421-bc80-40e6-ab20-59d115673059 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:48.520722 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c2421-bc80-40e6-ab20-59d115673059 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:48.520993 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c2421-bc80-40e6-ab20-59d115673059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:48.533674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c2421-bc80-40e6-ab20-59d115673059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:48.535442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c2421-bc80-40e6-ab20-59d115673059 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-5a2c2421-bc80-40e6-ab20-59d115673059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:53:48.558660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:53:48.559782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:53:48.560756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:53:48.560756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:53:48.560756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:53:48.560756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 606/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:53:48.566070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48061bb8-87fe-4d61-b733-d0ba7b5124aa None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:48.700805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48061bb8-87fe-4d61-b733-d0ba7b5124aa None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:48.736234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:48.743070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a65b4d-e10d-4a44-97c5-6641358c3724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:48.743941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a65b4d-e10d-4a44-97c5-6641358c3724 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:48.744388 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a65b4d-e10d-4a44-97c5-6641358c3724 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:48.744819 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a65b4d-e10d-4a44-97c5-6641358c3724 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:48.745637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a65b4d-e10d-4a44-97c5-6641358c3724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:53:48.745959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a65b4d-e10d-4a44-97c5-6641358c3724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:48.747328 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a65b4d-e10d-4a44-97c5-6641358c3724 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:48.766383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 598/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:53:48.775267 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c2421-bc80-40e6-ab20-59d115673059 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:48.845576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:48.913526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c2421-bc80-40e6-ab20-59d115673059 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:48.963560 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556615b2-4f33-4dd8-ae46-f672fddfe490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:48.964246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556615b2-4f33-4dd8-ae46-f672fddfe490 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:48.964531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556615b2-4f33-4dd8-ae46-f672fddfe490 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:48.964813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556615b2-4f33-4dd8-ae46-f672fddfe490 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:48.971025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556615b2-4f33-4dd8-ae46-f672fddfe490 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:48.971025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556615b2-4f33-4dd8-ae46-f672fddfe490 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:48.994231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 607/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 10 07:53:48 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:53:51.417802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4c584-51cc-436e-9768-fe177d005656 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:51.418358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4c584-51cc-436e-9768-fe177d005656 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:51.418358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4c584-51cc-436e-9768-fe177d005656 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:51.419923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 599/1206] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:53:51.425999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf5d3f-6b97-40e4-bad8-84d89e3ca7fa None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:51.426533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf5d3f-6b97-40e4-bad8-84d89e3ca7fa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:51.426650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf5d3f-6b97-40e4-bad8-84d89e3ca7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:51.447925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-18cf5d3f-6b97-40e4-bad8-84d89e3ca7fa None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:53:51.449186 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-18cf5d3f-6b97-40e4-bad8-84d89e3ca7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:53:51.536312 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 608/1207] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:53:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:53:51.564610 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4c584-51cc-436e-9768-fe177d005656 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:51.708298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4c584-51cc-436e-9768-fe177d005656 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:51.762353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38248d0e-2c9a-4cc8-9a83-7d00eb140456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:51.763710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248d0e-2c9a-4cc8-9a83-7d00eb140456 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:51.764398 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248d0e-2c9a-4cc8-9a83-7d00eb140456 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:51.764779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248d0e-2c9a-4cc8-9a83-7d00eb140456 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:51.786908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38248d0e-2c9a-4cc8-9a83-7d00eb140456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-38248d0e-2c9a-4cc8-9a83-7d00eb140456 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:53:51.794793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:53:51.795956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:53:51.796870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:53:51.796870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:53:51.796870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:53:51.796870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:53:51.796870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:53:51.796870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:53:51.796870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:53:51.796870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:53:51.796870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:53:51.796870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:53:51.796870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:53:51.796870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:53:51.806237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 600/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:53:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:53:51.806522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf5d3f-6b97-40e4-bad8-84d89e3ca7fa None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:51.860693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:51.946919 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf5d3f-6b97-40e4-bad8-84d89e3ca7fa None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:51.987977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d9558-c2d5-4f7a-9e5e-67aae8dc59fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:51.988552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9558-c2d5-4f7a-9e5e-67aae8dc59fc None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:51.988844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9558-c2d5-4f7a-9e5e-67aae8dc59fc None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:51.989120 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9558-c2d5-4f7a-9e5e-67aae8dc59fc None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:51.989805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d9558-c2d5-4f7a-9e5e-67aae8dc59fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:53:51.990145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d9558-c2d5-4f7a-9e5e-67aae8dc59fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:51.991851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d9558-c2d5-4f7a-9e5e-67aae8dc59fc None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:52.003101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 609/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:53:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:53:52.010543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38248d0e-2c9a-4cc8-9a83-7d00eb140456 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:52.078650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:52.153322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38248d0e-2c9a-4cc8-9a83-7d00eb140456 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:52.205195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b16eff-9e82-4e60-8e4b-22500f09b775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:52.206073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16eff-9e82-4e60-8e4b-22500f09b775 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:52.206367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16eff-9e82-4e60-8e4b-22500f09b775 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:52.206692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16eff-9e82-4e60-8e4b-22500f09b775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:52.220990 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b16eff-9e82-4e60-8e4b-22500f09b775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:52.222777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b16eff-9e82-4e60-8e4b-22500f09b775 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-08b16eff-9e82-4e60-8e4b-22500f09b775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:53:52.241023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:53:52.242021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:53:52.242992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:53:52.242992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:53:52.242992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:53:52.247352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 601/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:53:52.248879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d9558-c2d5-4f7a-9e5e-67aae8dc59fc None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:52.363711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:52.369093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d9558-c2d5-4f7a-9e5e-67aae8dc59fc None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:52.409352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a66f0-f8eb-4f8e-99e6-12f5332a7ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:52.409988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a66f0-f8eb-4f8e-99e6-12f5332a7ecf None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:52.410278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a66f0-f8eb-4f8e-99e6-12f5332a7ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:52.410555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a66f0-f8eb-4f8e-99e6-12f5332a7ecf None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:52.411201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a66f0-f8eb-4f8e-99e6-12f5332a7ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:53:52.411515 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a66f0-f8eb-4f8e-99e6-12f5332a7ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:52.412938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a66f0-f8eb-4f8e-99e6-12f5332a7ecf None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:52.428459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 610/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:53:52.435113 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b16eff-9e82-4e60-8e4b-22500f09b775 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:52.548083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b16eff-9e82-4e60-8e4b-22500f09b775 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:52.549729 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:52.590346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1262d70-4645-4969-a2d0-5626851c8b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:52.591040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1262d70-4645-4969-a2d0-5626851c8b84 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:52.591317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1262d70-4645-4969-a2d0-5626851c8b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:52.591613 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1262d70-4645-4969-a2d0-5626851c8b84 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:52.600987 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1262d70-4645-4969-a2d0-5626851c8b84 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:52.602571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1262d70-4645-4969-a2d0-5626851c8b84 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-f1262d70-4645-4969-a2d0-5626851c8b84 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:53:52.615888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:53:52.617635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:53:52.618575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:53:52.618575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:53:52.618575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:53:52.618575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:53:52.618575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:53:52.618575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:53:52.618575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:53:52.618575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:53:52.618575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 07:53:52.618575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:53:52.618575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 602/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:53:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:53:52.623874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a66f0-f8eb-4f8e-99e6-12f5332a7ecf None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:52.752732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a66f0-f8eb-4f8e-99e6-12f5332a7ecf None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:52.794968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee6918-c4d7-410b-8992-bb6b637897c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:52.795680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee6918-c4d7-410b-8992-bb6b637897c6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:52.796008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee6918-c4d7-410b-8992-bb6b637897c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:52.796285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee6918-c4d7-410b-8992-bb6b637897c6 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:52.797337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee6918-c4d7-410b-8992-bb6b637897c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:53:52.797681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee6918-c4d7-410b-8992-bb6b637897c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:52.799652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee6918-c4d7-410b-8992-bb6b637897c6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:52.828805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 611/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Aug 10 07:53:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:53:52.834625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1262d70-4645-4969-a2d0-5626851c8b84 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:52.973695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1262d70-4645-4969-a2d0-5626851c8b84 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:53.019112 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e3020-94f8-48ac-9c40-cf97326b461b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:53.019814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3020-94f8-48ac-9c40-cf97326b461b None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:53.020105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3020-94f8-48ac-9c40-cf97326b461b None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:53.020411 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3020-94f8-48ac-9c40-cf97326b461b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:53.071091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:53.136677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e3020-94f8-48ac-9c40-cf97326b461b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:53.138220 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e3020-94f8-48ac-9c40-cf97326b461b None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:53.273324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 603/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:53:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 07:53:53.279522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee6918-c4d7-410b-8992-bb6b637897c6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:53.309336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:53.399106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee6918-c4d7-410b-8992-bb6b637897c6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:53.451031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6d495-c5da-434f-b115-4d211748114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:53.452542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d495-c5da-434f-b115-4d211748114f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:53.452542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d495-c5da-434f-b115-4d211748114f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:53.452938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d495-c5da-434f-b115-4d211748114f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:53.466068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6d495-c5da-434f-b115-4d211748114f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:53.467613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6d495-c5da-434f-b115-4d211748114f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-66d6d495-c5da-434f-b115-4d211748114f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:53:53.487496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:53:53.490096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:53:53.491900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:53:53.491900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:53:53.491900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:53:53.491900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 612/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:53:53.495224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e3020-94f8-48ac-9c40-cf97326b461b None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:53.579649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:53.630294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e3020-94f8-48ac-9c40-cf97326b461b None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:53.680044 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deed22-f662-4c75-b725-fe985db9b96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:53.680670 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deed22-f662-4c75-b725-fe985db9b96e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:53.680955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deed22-f662-4c75-b725-fe985db9b96e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:53.681267 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deed22-f662-4c75-b725-fe985db9b96e None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:53.681864 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0deed22-f662-4c75-b725-fe985db9b96e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:53:53.682165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0deed22-f662-4c75-b725-fe985db9b96e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:53.683630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0deed22-f662-4c75-b725-fe985db9b96e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:53.701248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 604/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:53:53.702874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6d495-c5da-434f-b115-4d211748114f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:53.797638 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:53.840707 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6d495-c5da-434f-b115-4d211748114f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:53.902832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e1c0e-e9ec-424a-b32c-18900d9dfaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:53.903567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e1c0e-e9ec-424a-b32c-18900d9dfaae None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:53.903924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e1c0e-e9ec-424a-b32c-18900d9dfaae None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:53.904186 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e1c0e-e9ec-424a-b32c-18900d9dfaae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:53.917196 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e1c0e-e9ec-424a-b32c-18900d9dfaae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:53.918773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e1c0e-e9ec-424a-b32c-18900d9dfaae None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-3d6e1c0e-e9ec-424a-b32c-18900d9dfaae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:53:53.933161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:53:53.934278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:53:53.935175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:53:53.935175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:53:53.935175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:53:53.935175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:53:53.935175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:53:53.935175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:53:53.935175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:53:53.935175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:53:53.935175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 613/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:53:53.940810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deed22-f662-4c75-b725-fe985db9b96e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:54.055677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deed22-f662-4c75-b725-fe985db9b96e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:54.090981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:54.105121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74156310-3efc-4699-88c6-b1a70279abd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:54.105740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74156310-3efc-4699-88c6-b1a70279abd1 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:54.106069 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74156310-3efc-4699-88c6-b1a70279abd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:54.106360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74156310-3efc-4699-88c6-b1a70279abd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:54.107071 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74156310-3efc-4699-88c6-b1a70279abd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:53:54.107376 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74156310-3efc-4699-88c6-b1a70279abd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:54.108866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74156310-3efc-4699-88c6-b1a70279abd1 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:54.123908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 605/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:53:54.131628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e1c0e-e9ec-424a-b32c-18900d9dfaae None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:54.321126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e1c0e-e9ec-424a-b32c-18900d9dfaae None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:54.355465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:54.363040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd48299-9601-45e3-bae1-fb2e0dccfb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:54.363956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd48299-9601-45e3-bae1-fb2e0dccfb5c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:54.364285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd48299-9601-45e3-bae1-fb2e0dccfb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:54.364558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd48299-9601-45e3-bae1-fb2e0dccfb5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:54.365434 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd48299-9601-45e3-bae1-fb2e0dccfb5c None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=ccab7239a2474aa093e685d5da97f1a9) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:53:54.365791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd48299-9601-45e3-bae1-fb2e0dccfb5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:54.367391 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd48299-9601-45e3-bae1-fb2e0dccfb5c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:54.373435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 614/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:53:54 2022] GET /identity/v3/role_assignments?user.id=ccab7239a2474aa093e685d5da97f1a9&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:53:56.645533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df174a44-e3d6-470e-9599-295608f91547 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:56.646099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df174a44-e3d6-470e-9599-295608f91547 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:56.646253 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df174a44-e3d6-470e-9599-295608f91547 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:56.648229 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 606/1220] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:53:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:53:56.654853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eef6dd-8fb7-4438-89da-cf6c41e65c93 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:56.655402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eef6dd-8fb7-4438-89da-cf6c41e65c93 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:56.655516 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eef6dd-8fb7-4438-89da-cf6c41e65c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:56.675511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-50eef6dd-8fb7-4438-89da-cf6c41e65c93 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:53:56.676749 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-50eef6dd-8fb7-4438-89da-cf6c41e65c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:53:56.766402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 615/1221] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:53:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:53:56.789519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df174a44-e3d6-470e-9599-295608f91547 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:56.909602 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df174a44-e3d6-470e-9599-295608f91547 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:56.952556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef1a92-c30b-4119-8c6d-e948a5f08b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:56.954212 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef1a92-c30b-4119-8c6d-e948a5f08b36 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:56.954662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef1a92-c30b-4119-8c6d-e948a5f08b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:56.955155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef1a92-c30b-4119-8c6d-e948a5f08b36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:56.966877 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef1a92-c30b-4119-8c6d-e948a5f08b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-3aef1a92-c30b-4119-8c6d-e948a5f08b36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:53:56.971667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:53:56.973040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:53:56.974626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:53:56.974626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:53:56.974626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:53:56.974626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:53:56.974626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:53:56.974626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:53:56.974626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:53:56.974626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:53:56.974626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:53:56.974626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:53:56.974626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:53:56.974626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:53:56.974626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 607/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:53:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:53:56.980092 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eef6dd-8fb7-4438-89da-cf6c41e65c93 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:57.107143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eef6dd-8fb7-4438-89da-cf6c41e65c93 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:57.141573 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:57.156964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f92e8f-e832-4d23-ae7f-b989bdca940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:57.157574 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f92e8f-e832-4d23-ae7f-b989bdca940b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:57.157852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f92e8f-e832-4d23-ae7f-b989bdca940b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:57.158123 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f92e8f-e832-4d23-ae7f-b989bdca940b None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:57.158942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f92e8f-e832-4d23-ae7f-b989bdca940b None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:53:57.159240 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f92e8f-e832-4d23-ae7f-b989bdca940b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:57.161026 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f92e8f-e832-4d23-ae7f-b989bdca940b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:57.170083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 616/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:53:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:53:57.176671 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef1a92-c30b-4119-8c6d-e948a5f08b36 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:57.226172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:57.295146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef1a92-c30b-4119-8c6d-e948a5f08b36 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:57.335254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80bd43-bf7f-47f5-8630-b11f28916c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:57.336054 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80bd43-bf7f-47f5-8630-b11f28916c62 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:57.336337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80bd43-bf7f-47f5-8630-b11f28916c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:57.336610 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80bd43-bf7f-47f5-8630-b11f28916c62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:57.349270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80bd43-bf7f-47f5-8630-b11f28916c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:57.350981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80bd43-bf7f-47f5-8630-b11f28916c62 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-ca80bd43-bf7f-47f5-8630-b11f28916c62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:53:57.375156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:53:57.376638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:53:57.377998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:53:57.377998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:53:57.377998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:53:57.377998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 608/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:53:57.383830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f92e8f-e832-4d23-ae7f-b989bdca940b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:57.510452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f92e8f-e832-4d23-ae7f-b989bdca940b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:57.549152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abab34-d068-4310-b1d9-fd16001bced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:57.549798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abab34-d068-4310-b1d9-fd16001bced1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:57.550057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abab34-d068-4310-b1d9-fd16001bced1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:57.550329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abab34-d068-4310-b1d9-fd16001bced1 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:57.551065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abab34-d068-4310-b1d9-fd16001bced1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:53:57.551364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abab34-d068-4310-b1d9-fd16001bced1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:57.553024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abab34-d068-4310-b1d9-fd16001bced1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:57.566094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 617/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:53:57.572329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80bd43-bf7f-47f5-8630-b11f28916c62 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:57.680518 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:57.691141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80bd43-bf7f-47f5-8630-b11f28916c62 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:57.732634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de9b66-307a-49c4-85a3-e02e197d1ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:57.733268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de9b66-307a-49c4-85a3-e02e197d1ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:57.734427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de9b66-307a-49c4-85a3-e02e197d1ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:57.734427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de9b66-307a-49c4-85a3-e02e197d1ca8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:57.742902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de9b66-307a-49c4-85a3-e02e197d1ca8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:57.744505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de9b66-307a-49c4-85a3-e02e197d1ca8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-63de9b66-307a-49c4-85a3-e02e197d1ca8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:53:57.758597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:53:57.759704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:53:57.760890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:53:57.760890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:53:57.760890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:53:57.760890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:53:57.760890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:53:57.760890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:53:57.760890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:53:57.760890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:53:57.760890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 07:53:57.760890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:53:57.760890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 609/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:53:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:53:57.766133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abab34-d068-4310-b1d9-fd16001bced1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:57.823664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:57.894326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abab34-d068-4310-b1d9-fd16001bced1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:57.936141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103602a-2f5a-4a2e-a845-d43318da570d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:57.936755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103602a-2f5a-4a2e-a845-d43318da570d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:57.937088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103602a-2f5a-4a2e-a845-d43318da570d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:57.937362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103602a-2f5a-4a2e-a845-d43318da570d None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:57.938086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103602a-2f5a-4a2e-a845-d43318da570d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:53:57.938394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103602a-2f5a-4a2e-a845-d43318da570d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:57.940070 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103602a-2f5a-4a2e-a845-d43318da570d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:57.961207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 618/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Aug 10 07:53:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:53:57.967792 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de9b66-307a-49c4-85a3-e02e197d1ca8 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:58.088144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de9b66-307a-49c4-85a3-e02e197d1ca8 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:58.132267 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6631f-bfde-4628-9f24-b690526d7dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:58.133181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6631f-bfde-4628-9f24-b690526d7dbe None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:58.133346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6631f-bfde-4628-9f24-b690526d7dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:58.133689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6631f-bfde-4628-9f24-b690526d7dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:58.146905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6631f-bfde-4628-9f24-b690526d7dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:58.148607 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6631f-bfde-4628-9f24-b690526d7dbe None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-4be6631f-bfde-4628-9f24-b690526d7dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:53:58.166240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:53:58.167473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:53:58.168567 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:53:58.168567 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:53:58.168567 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:53:58.174446 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 610/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:53:58.176215 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103602a-2f5a-4a2e-a845-d43318da570d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:58.309264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103602a-2f5a-4a2e-a845-d43318da570d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:58.311927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:58.355717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c147d-e835-43b1-b63f-49e8ed62b932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:58.356626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c147d-e835-43b1-b63f-49e8ed62b932 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:58.356999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c147d-e835-43b1-b63f-49e8ed62b932 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:58.357437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c147d-e835-43b1-b63f-49e8ed62b932 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:58.358160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c147d-e835-43b1-b63f-49e8ed62b932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:53:58.358547 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c147d-e835-43b1-b63f-49e8ed62b932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:58.360222 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c147d-e835-43b1-b63f-49e8ed62b932 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:58.373891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 619/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:53:58.381704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6631f-bfde-4628-9f24-b690526d7dbe None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:58.393080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:58.516841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6631f-bfde-4628-9f24-b690526d7dbe None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:58.558656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bdce9-dad1-4eb4-84d9-3c625675f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:58.559290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bdce9-dad1-4eb4-84d9-3c625675f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:58.559567 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bdce9-dad1-4eb4-84d9-3c625675f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:58.559907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bdce9-dad1-4eb4-84d9-3c625675f9b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:58.567783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bdce9-dad1-4eb4-84d9-3c625675f9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:58.569290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bdce9-dad1-4eb4-84d9-3c625675f9b0 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-d49bdce9-dad1-4eb4-84d9-3c625675f9b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:53:58.582087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:53:58.583261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:53:58.585129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:53:58.585129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:53:58.585129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:53:58.585129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:53:58.585129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:53:58.585129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:53:58.585129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:53:58.585129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:53:58.588364 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 611/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:53:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:53:58.589725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c147d-e835-43b1-b63f-49e8ed62b932 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:58.716071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c147d-e835-43b1-b63f-49e8ed62b932 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:58.757977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97589d-cfae-4f14-b834-815cc293bfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:58.758591 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97589d-cfae-4f14-b834-815cc293bfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:58.758910 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97589d-cfae-4f14-b834-815cc293bfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:58.759201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97589d-cfae-4f14-b834-815cc293bfc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:58.759937 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97589d-cfae-4f14-b834-815cc293bfc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:53:58.760240 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97589d-cfae-4f14-b834-815cc293bfc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:58.761854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97589d-cfae-4f14-b834-815cc293bfc9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:58.777442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 620/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:53:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:53:58.783474 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bdce9-dad1-4eb4-84d9-3c625675f9b0 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:53:58.865828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:53:58.904236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bdce9-dad1-4eb4-84d9-3c625675f9b0 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:53:58.949233 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9c457-6aa7-48e2-b3f5-139a298b574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:53:58.950995 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9c457-6aa7-48e2-b3f5-139a298b574c None admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:53:58.950995 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9c457-6aa7-48e2-b3f5-139a298b574c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:53:58.951238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9c457-6aa7-48e2-b3f5-139a298b574c None admin] PATH_INFO: `/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/ccab7239a2474aa093e685d5da97f1a9/roles/6a4c16cbe590427c8b82f03b71c9a2c0` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:53:58.973329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9c457-6aa7-48e2-b3f5-139a298b574c None admin] RBAC: Authorizing `identity:create_grant(project_id=bad7eba8964f4acf9c6c1397df7cd1dd, user_id=ccab7239a2474aa093e685d5da97f1a9, role_id=6a4c16cbe590427c8b82f03b71c9a2c0)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:53:58.975003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9c457-6aa7-48e2-b3f5-139a298b574c None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:53:58.991683 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 612/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:53:58 2022] PUT /identity/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/ccab7239a2474aa093e685d5da97f1a9/roles/6a4c16cbe590427c8b82f03b71c9a2c0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:54:01.154193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960774db-b32c-47ff-8398-4b9d749d062d None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:01.154734 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960774db-b32c-47ff-8398-4b9d749d062d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:01.154734 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960774db-b32c-47ff-8398-4b9d749d062d None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:01.156886 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 621/1233] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:54:01.162929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84e07f-2eb0-4d7a-8f97-581f3fefa859 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:01.163425 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84e07f-2eb0-4d7a-8f97-581f3fefa859 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:01.163898 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84e07f-2eb0-4d7a-8f97-581f3fefa859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:01.191985 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-5b84e07f-2eb0-4d7a-8f97-581f3fefa859 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:54:01.193234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5b84e07f-2eb0-4d7a-8f97-581f3fefa859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:54:01.271238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 613/1234] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:54:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:54:01.313220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960774db-b32c-47ff-8398-4b9d749d062d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:01.341025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:01.424360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960774db-b32c-47ff-8398-4b9d749d062d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:01.476683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ec292-21c4-43ed-94ac-0cd24c8f8223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:01.477517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ec292-21c4-43ed-94ac-0cd24c8f8223 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:01.477982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ec292-21c4-43ed-94ac-0cd24c8f8223 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:01.478437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ec292-21c4-43ed-94ac-0cd24c8f8223 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:01.496001 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ec292-21c4-43ed-94ac-0cd24c8f8223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-961ec292-21c4-43ed-94ac-0cd24c8f8223 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:54:01.501302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:01.502579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:01.503540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:01.503540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:01.503540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:01.503540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:01.503540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:54:01.503540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:54:01.503540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:54:01.503540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:54:01.503540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:54:01.503540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:54:01.503540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:54:01.503540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:54:01.503540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 622/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 10 07:54:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:01.508597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84e07f-2eb0-4d7a-8f97-581f3fefa859 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:01.559430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:01.619826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84e07f-2eb0-4d7a-8f97-581f3fefa859 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:01.657185 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e735-0f41-4ba0-8eac-2e0503c2a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:01.658132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e735-0f41-4ba0-8eac-2e0503c2a27d None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:01.658132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e735-0f41-4ba0-8eac-2e0503c2a27d None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:01.658422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e735-0f41-4ba0-8eac-2e0503c2a27d None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:01.659428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e735-0f41-4ba0-8eac-2e0503c2a27d None admin] RBAC: Adding query filter params (name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:01.659428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e735-0f41-4ba0-8eac-2e0503c2a27d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:01.660811 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e735-0f41-4ba0-8eac-2e0503c2a27d None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:01.670472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 614/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 10 07:54:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:01.676723 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ec292-21c4-43ed-94ac-0cd24c8f8223 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:01.776485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:01.795820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ec292-21c4-43ed-94ac-0cd24c8f8223 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:01.835484 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bd0d7-23e2-4e94-b37a-249182962e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:01.836153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bd0d7-23e2-4e94-b37a-249182962e6e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:01.836438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bd0d7-23e2-4e94-b37a-249182962e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:01.836713 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bd0d7-23e2-4e94-b37a-249182962e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:01.849153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bd0d7-23e2-4e94-b37a-249182962e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:01.850937 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bd0d7-23e2-4e94-b37a-249182962e6e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-8e1bd0d7-23e2-4e94-b37a-249182962e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:54:01.867038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:01.868260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:54:01.869162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:54:01.869162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:01.869162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:54:01.869162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 623/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:54:01.876095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e735-0f41-4ba0-8eac-2e0503c2a27d None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:02.006414 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e735-0f41-4ba0-8eac-2e0503c2a27d None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:02.016838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:02.044393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7153f-6d18-481c-8c4e-89ffa2cad418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:02.044920 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7153f-6d18-481c-8c4e-89ffa2cad418 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:02.045204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7153f-6d18-481c-8c4e-89ffa2cad418 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:02.045478 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7153f-6d18-481c-8c4e-89ffa2cad418 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:02.046648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7153f-6d18-481c-8c4e-89ffa2cad418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:02.047051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7153f-6d18-481c-8c4e-89ffa2cad418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:02.048348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7153f-6d18-481c-8c4e-89ffa2cad418 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:02.061660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 615/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:02.068995 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bd0d7-23e2-4e94-b37a-249182962e6e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:02.208872 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bd0d7-23e2-4e94-b37a-249182962e6e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:02.245896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4f12c-b35c-49ee-b932-d11813c4ab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:02.246544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f12c-b35c-49ee-b932-d11813c4ab33 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:02.246846 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f12c-b35c-49ee-b932-d11813c4ab33 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:02.247106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f12c-b35c-49ee-b932-d11813c4ab33 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:02.250691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:02.256590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4f12c-b35c-49ee-b932-d11813c4ab33 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:02.258415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4f12c-b35c-49ee-b932-d11813c4ab33 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-bed4f12c-b35c-49ee-b932-d11813c4ab33 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:54:02.273025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:02.274451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:02.275874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:02.275874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:02.275874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:54:02.275874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:54:02.275874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:54:02.275874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:54:02.275874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:54:02.275874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:54:02.275874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 07:54:02.275874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:54:02.275874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 624/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:54:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:02.281224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7153f-6d18-481c-8c4e-89ffa2cad418 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:02.399194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7153f-6d18-481c-8c4e-89ffa2cad418 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:02.442368 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a14b5-91c3-46aa-a3fb-e26beac3cd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:02.443145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a14b5-91c3-46aa-a3fb-e26beac3cd76 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:02.443495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a14b5-91c3-46aa-a3fb-e26beac3cd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:02.444171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a14b5-91c3-46aa-a3fb-e26beac3cd76 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:02.445167 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a14b5-91c3-46aa-a3fb-e26beac3cd76 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:02.445775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a14b5-91c3-46aa-a3fb-e26beac3cd76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:02.447689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a14b5-91c3-46aa-a3fb-e26beac3cd76 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:02.474966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 616/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Aug 10 07:54:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:02.484206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4f12c-b35c-49ee-b932-d11813c4ab33 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:02.608275 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4f12c-b35c-49ee-b932-d11813c4ab33 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:02.649670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80de763-0857-4f64-a822-51b7ac43fb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:02.650227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80de763-0857-4f64-a822-51b7ac43fb26 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:02.650467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80de763-0857-4f64-a822-51b7ac43fb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:02.650755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80de763-0857-4f64-a822-51b7ac43fb26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:02.728365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:02.738002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80de763-0857-4f64-a822-51b7ac43fb26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:02.739623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80de763-0857-4f64-a822-51b7ac43fb26 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:02.869036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 625/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:54:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:54:02.875755 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a14b5-91c3-46aa-a3fb-e26beac3cd76 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:02.917706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:03.016081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a14b5-91c3-46aa-a3fb-e26beac3cd76 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:03.055590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c980b1-0ff1-43db-9ecf-44f566288ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:03.056749 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c980b1-0ff1-43db-9ecf-44f566288ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:03.057179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c980b1-0ff1-43db-9ecf-44f566288ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:03.057618 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c980b1-0ff1-43db-9ecf-44f566288ab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:03.073874 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c980b1-0ff1-43db-9ecf-44f566288ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:03.075433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c980b1-0ff1-43db-9ecf-44f566288ab3 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-f5c980b1-0ff1-43db-9ecf-44f566288ab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:54:03.092374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:03.094191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:54:03.095272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:54:03.095272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:03.095272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:03.095272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 617/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:54:03.100380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80de763-0857-4f64-a822-51b7ac43fb26 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:03.210850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:03.218187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80de763-0857-4f64-a822-51b7ac43fb26 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:03.269454 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8028af-9941-4bc5-8c6f-0369ab4139c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:03.270616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8028af-9941-4bc5-8c6f-0369ab4139c5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:03.271044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8028af-9941-4bc5-8c6f-0369ab4139c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:03.271615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8028af-9941-4bc5-8c6f-0369ab4139c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:03.272628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8028af-9941-4bc5-8c6f-0369ab4139c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:03.273369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8028af-9941-4bc5-8c6f-0369ab4139c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:03.275901 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8028af-9941-4bc5-8c6f-0369ab4139c5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:03.294857 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 626/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:54:03.304978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c980b1-0ff1-43db-9ecf-44f566288ab3 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:03.403583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:03.435825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c980b1-0ff1-43db-9ecf-44f566288ab3 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:03.477994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981f359-e17e-42b6-adf0-aad131608d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:03.478522 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f359-e17e-42b6-adf0-aad131608d46 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:03.478801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f359-e17e-42b6-adf0-aad131608d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:03.479072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f359-e17e-42b6-adf0-aad131608d46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:03.486991 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981f359-e17e-42b6-adf0-aad131608d46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:03.488513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981f359-e17e-42b6-adf0-aad131608d46 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-f981f359-e17e-42b6-adf0-aad131608d46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:54:03.502849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:03.511419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:03.512564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:54:03.512564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:54:03.512564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:54:03.512564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:54:03.512564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:54:03.512564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:54:03.512564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:54:03.512564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:03.512564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 618/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:54:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:03.513160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8028af-9941-4bc5-8c6f-0369ab4139c5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:03.638683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8028af-9941-4bc5-8c6f-0369ab4139c5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:03.682034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002cfe7-4017-4c1c-8d7b-710105dcd4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:03.682695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002cfe7-4017-4c1c-8d7b-710105dcd4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:03.682983 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002cfe7-4017-4c1c-8d7b-710105dcd4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:03.683452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002cfe7-4017-4c1c-8d7b-710105dcd4e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:03.684314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002cfe7-4017-4c1c-8d7b-710105dcd4e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:03.684757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002cfe7-4017-4c1c-8d7b-710105dcd4e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:03.686333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002cfe7-4017-4c1c-8d7b-710105dcd4e2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:03.701235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 627/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:54:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:54:03.707894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981f359-e17e-42b6-adf0-aad131608d46 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:03.841183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981f359-e17e-42b6-adf0-aad131608d46 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:03.877475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c892daa-f9db-4a79-b196-2e79b2427a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:03.878063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c892daa-f9db-4a79-b196-2e79b2427a50 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:03.878343 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c892daa-f9db-4a79-b196-2e79b2427a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:03.878662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c892daa-f9db-4a79-b196-2e79b2427a50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:03.879423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c892daa-f9db-4a79-b196-2e79b2427a50 None admin] RBAC: Adding query filter params (role.id=6a4c16cbe590427c8b82f03b71c9a2c0, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=ccab7239a2474aa093e685d5da97f1a9) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:03.879783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c892daa-f9db-4a79-b196-2e79b2427a50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:03.881259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c892daa-f9db-4a79-b196-2e79b2427a50 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:03.888581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 619/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:54:03 2022] GET /identity/v3/role_assignments?user.id=ccab7239a2474aa093e685d5da97f1a9&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=6a4c16cbe590427c8b82f03b71c9a2c0 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:54:06.105060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475636cf-dd04-43ca-988e-d4e4416a9afe None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:06.105676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475636cf-dd04-43ca-988e-d4e4416a9afe None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:06.105676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475636cf-dd04-43ca-988e-d4e4416a9afe None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:06.106944 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 628/1247] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:54:06.112456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff27a21-77fb-4fc6-9edd-cb0ddfc52641 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:06.112925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff27a21-77fb-4fc6-9edd-cb0ddfc52641 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:06.113023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff27a21-77fb-4fc6-9edd-cb0ddfc52641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:06.119821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:06.136874 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-fff27a21-77fb-4fc6-9edd-cb0ddfc52641 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:54:06.138098 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-fff27a21-77fb-4fc6-9edd-cb0ddfc52641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:54:06.225617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 620/1248] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:54:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:54:06.250517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475636cf-dd04-43ca-988e-d4e4416a9afe None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:06.286102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:06.394255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475636cf-dd04-43ca-988e-d4e4416a9afe None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:06.437533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b61f7f-d416-4bb2-b6d6-1fe680b49739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:06.438257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b61f7f-d416-4bb2-b6d6-1fe680b49739 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:06.438698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b61f7f-d416-4bb2-b6d6-1fe680b49739 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:06.438859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b61f7f-d416-4bb2-b6d6-1fe680b49739 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:06.452061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b61f7f-d416-4bb2-b6d6-1fe680b49739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-60b61f7f-d416-4bb2-b6d6-1fe680b49739 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:54:06.458344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:06.459891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:06.462025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:06.462025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:06.462025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:06.462025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:06.462025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:54:06.462025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:54:06.462025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:54:06.462025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:54:06.462025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:54:06.462025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:54:06.462025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:54:06.462025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:54:06.462025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 629/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:54:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:06.466659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff27a21-77fb-4fc6-9edd-cb0ddfc52641 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:06.597562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff27a21-77fb-4fc6-9edd-cb0ddfc52641 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:06.638855 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:06.646000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2bd0f-4512-4a4a-b3a8-4bfed8023eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:06.646710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2bd0f-4512-4a4a-b3a8-4bfed8023eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:06.646992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2bd0f-4512-4a4a-b3a8-4bfed8023eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:06.647263 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2bd0f-4512-4a4a-b3a8-4bfed8023eb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:06.648056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2bd0f-4512-4a4a-b3a8-4bfed8023eb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:06.648460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2bd0f-4512-4a4a-b3a8-4bfed8023eb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:06.649985 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2bd0f-4512-4a4a-b3a8-4bfed8023eb8 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:06.661637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 621/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:54:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:06.669079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b61f7f-d416-4bb2-b6d6-1fe680b49739 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:06.780496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:06.811433 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b61f7f-d416-4bb2-b6d6-1fe680b49739 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:06.853144 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8592d-d7ca-4d5b-a3e8-2bac7a9c580c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:06.853717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8592d-d7ca-4d5b-a3e8-2bac7a9c580c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:06.854000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8592d-d7ca-4d5b-a3e8-2bac7a9c580c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:06.854261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8592d-d7ca-4d5b-a3e8-2bac7a9c580c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:06.864750 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8592d-d7ca-4d5b-a3e8-2bac7a9c580c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:06.866207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8592d-d7ca-4d5b-a3e8-2bac7a9c580c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-07e8592d-d7ca-4d5b-a3e8-2bac7a9c580c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:54:06.882117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:06.883444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:54:06.884600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:54:06.884600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:06.884600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:54:06.884600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 630/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:06.893241 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2bd0f-4512-4a4a-b3a8-4bfed8023eb8 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:07.024736 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2bd0f-4512-4a4a-b3a8-4bfed8023eb8 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:07.077356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730934ab-c5e5-426d-a485-426c71b4f8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:07.082329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730934ab-c5e5-426d-a485-426c71b4f8ab None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:07.082329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730934ab-c5e5-426d-a485-426c71b4f8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:07.082329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730934ab-c5e5-426d-a485-426c71b4f8ab None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:07.082329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730934ab-c5e5-426d-a485-426c71b4f8ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:07.082329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730934ab-c5e5-426d-a485-426c71b4f8ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:07.082329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730934ab-c5e5-426d-a485-426c71b4f8ab None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:07.098555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 622/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:07.105143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8592d-d7ca-4d5b-a3e8-2bac7a9c580c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:07.237628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8592d-d7ca-4d5b-a3e8-2bac7a9c580c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:07.270689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:07.282418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654ba87-b13f-4be8-b871-2ce7228f3a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:07.283130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654ba87-b13f-4be8-b871-2ce7228f3a9e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:07.283408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654ba87-b13f-4be8-b871-2ce7228f3a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:07.283831 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654ba87-b13f-4be8-b871-2ce7228f3a9e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:07.294334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654ba87-b13f-4be8-b871-2ce7228f3a9e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:07.295807 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654ba87-b13f-4be8-b871-2ce7228f3a9e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e654ba87-b13f-4be8-b871-2ce7228f3a9e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:54:07.311056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:07.314003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:07.316483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:07.316483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:07.316483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:54:07.316483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:54:07.316483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:54:07.316483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:54:07.316483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:54:07.316483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:54:07.316483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 07:54:07.316483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:54:07.316483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 631/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:54:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:07.327703 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730934ab-c5e5-426d-a485-426c71b4f8ab None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:07.393490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:07.454138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730934ab-c5e5-426d-a485-426c71b4f8ab None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:07.497549 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcfc42-31ba-4918-b451-5ab1674b47dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:07.498354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcfc42-31ba-4918-b451-5ab1674b47dc None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:07.498649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcfc42-31ba-4918-b451-5ab1674b47dc None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:07.498925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcfc42-31ba-4918-b451-5ab1674b47dc None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:07.499950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcfc42-31ba-4918-b451-5ab1674b47dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:07.500265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcfc42-31ba-4918-b451-5ab1674b47dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:07.501934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcfc42-31ba-4918-b451-5ab1674b47dc None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:07.524425 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 623/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Aug 10 07:54:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:07.531146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654ba87-b13f-4be8-b871-2ce7228f3a9e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:07.649775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654ba87-b13f-4be8-b871-2ce7228f3a9e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:07.688550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3352a31-3727-4a06-b9b1-7f98134fbef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:07.689159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3352a31-3727-4a06-b9b1-7f98134fbef4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:07.689441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3352a31-3727-4a06-b9b1-7f98134fbef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:07.689714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3352a31-3727-4a06-b9b1-7f98134fbef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:07.762864 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:07.778182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3352a31-3727-4a06-b9b1-7f98134fbef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:07.779833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3352a31-3727-4a06-b9b1-7f98134fbef4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:07.906170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 632/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:54:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:54:07.916794 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcfc42-31ba-4918-b451-5ab1674b47dc None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:08.040419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcfc42-31ba-4918-b451-5ab1674b47dc None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:08.059801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:08.085157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc04217-319a-4557-b1ed-330d1738e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:08.085803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc04217-319a-4557-b1ed-330d1738e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:08.086079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc04217-319a-4557-b1ed-330d1738e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:08.086422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc04217-319a-4557-b1ed-330d1738e2a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:08.098122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc04217-319a-4557-b1ed-330d1738e2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:08.099589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc04217-319a-4557-b1ed-330d1738e2a6 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-0fc04217-319a-4557-b1ed-330d1738e2a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:54:08.117380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:08.118489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:54:08.124654 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:54:08.124654 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:08.124654 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:08.124654 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 624/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:08.125283 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3352a31-3727-4a06-b9b1-7f98134fbef4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:08.237461 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:08.254857 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3352a31-3727-4a06-b9b1-7f98134fbef4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:08.296608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17f890-45f7-4969-b797-28e0ed490788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:08.297612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17f890-45f7-4969-b797-28e0ed490788 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:08.298099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17f890-45f7-4969-b797-28e0ed490788 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:08.298580 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17f890-45f7-4969-b797-28e0ed490788 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:08.299774 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17f890-45f7-4969-b797-28e0ed490788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:08.300280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17f890-45f7-4969-b797-28e0ed490788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:08.302692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17f890-45f7-4969-b797-28e0ed490788 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:08.319872 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 633/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:08.325721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc04217-319a-4557-b1ed-330d1738e2a6 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:08.445814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc04217-319a-4557-b1ed-330d1738e2a6 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:08.494493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463a193-6afe-4dc8-8290-e8faff04732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:08.495382 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a193-6afe-4dc8-8290-e8faff04732f None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:08.495671 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a193-6afe-4dc8-8290-e8faff04732f None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:08.496027 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a193-6afe-4dc8-8290-e8faff04732f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:08.503669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463a193-6afe-4dc8-8290-e8faff04732f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:08.505205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463a193-6afe-4dc8-8290-e8faff04732f None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-0463a193-6afe-4dc8-8290-e8faff04732f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:54:08.518838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:08.528147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:08.529587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:54:08.529587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:54:08.529587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:54:08.529587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:54:08.529587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:54:08.529587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:54:08.529587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:54:08.529587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:08.529587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 625/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:54:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:08.531075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17f890-45f7-4969-b797-28e0ed490788 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:08.664196 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17f890-45f7-4969-b797-28e0ed490788 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:08.710813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe412da0-931d-4941-a3eb-7d42a0cd5392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:08.711456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe412da0-931d-4941-a3eb-7d42a0cd5392 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:08.711809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe412da0-931d-4941-a3eb-7d42a0cd5392 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:08.712153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe412da0-931d-4941-a3eb-7d42a0cd5392 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:08.712909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe412da0-931d-4941-a3eb-7d42a0cd5392 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:08.713245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe412da0-931d-4941-a3eb-7d42a0cd5392 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:08.714828 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe412da0-931d-4941-a3eb-7d42a0cd5392 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:08.730464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 634/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:54:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:54:08.737382 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463a193-6afe-4dc8-8290-e8faff04732f None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:08.769031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:08.861283 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463a193-6afe-4dc8-8290-e8faff04732f None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:08.916991 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8a01a-a00d-4b97-81e4-26a6b144b9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:08.918548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8a01a-a00d-4b97-81e4-26a6b144b9ed None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:08.918548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8a01a-a00d-4b97-81e4-26a6b144b9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:08.918548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8a01a-a00d-4b97-81e4-26a6b144b9ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:08.918912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8a01a-a00d-4b97-81e4-26a6b144b9ed None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=ccab7239a2474aa093e685d5da97f1a9) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:08.919178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8a01a-a00d-4b97-81e4-26a6b144b9ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:08.920667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8a01a-a00d-4b97-81e4-26a6b144b9ed None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:08.944568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 626/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:54:08 2022] GET /identity/v3/role_assignments?user.id=ccab7239a2474aa093e685d5da97f1a9&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:11.088467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bafc37-8d53-407a-ae62-8f0276c831df None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:11.091290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bafc37-8d53-407a-ae62-8f0276c831df None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:11.091290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bafc37-8d53-407a-ae62-8f0276c831df None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:11.091290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 635/1261] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:54:11.095990 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e154-ace1-499f-b97f-087c428b063d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:11.096468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e154-ace1-499f-b97f-087c428b063d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:11.096571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e154-ace1-499f-b97f-087c428b063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:11.115266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-2a91e154-ace1-499f-b97f-087c428b063d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:54:11.116516 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2a91e154-ace1-499f-b97f-087c428b063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:54:11.184884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 627/1262] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:54:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:54:11.207551 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bafc37-8d53-407a-ae62-8f0276c831df None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:11.219043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:11.336096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bafc37-8d53-407a-ae62-8f0276c831df None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:11.372824 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b836d1-d62d-436e-be35-484c0780d7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:11.373452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b836d1-d62d-436e-be35-484c0780d7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:11.373729 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b836d1-d62d-436e-be35-484c0780d7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:11.374039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b836d1-d62d-436e-be35-484c0780d7f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:11.384420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b836d1-d62d-436e-be35-484c0780d7f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-d9b836d1-d62d-436e-be35-484c0780d7f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:54:11.389206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:11.390286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:11.391130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:11.391130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:11.391130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:11.391130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:11.391130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:54:11.391130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:54:11.391130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:54:11.391130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:54:11.391130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:54:11.391130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:54:11.391130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:54:11.391130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:54:11.391130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 636/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:54:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:11.397089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91e154-ace1-499f-b97f-087c428b063d None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:11.415402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:11.509017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91e154-ace1-499f-b97f-087c428b063d None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:11.551326 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896c2a5-36ef-4414-ad0f-0a58e9f0b81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:11.551958 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896c2a5-36ef-4414-ad0f-0a58e9f0b81e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:11.552491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896c2a5-36ef-4414-ad0f-0a58e9f0b81e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:11.552769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896c2a5-36ef-4414-ad0f-0a58e9f0b81e None admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:11.553442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896c2a5-36ef-4414-ad0f-0a58e9f0b81e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:11.553743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896c2a5-36ef-4414-ad0f-0a58e9f0b81e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:11.555094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896c2a5-36ef-4414-ad0f-0a58e9f0b81e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:11.563575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 628/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:54:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:11.569623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b836d1-d62d-436e-be35-484c0780d7f0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:11.646131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:11.680155 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b836d1-d62d-436e-be35-484c0780d7f0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:11.714640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30df9d-9d00-4d24-b79b-97a8c8581768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:11.715269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30df9d-9d00-4d24-b79b-97a8c8581768 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:11.715555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30df9d-9d00-4d24-b79b-97a8c8581768 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:11.715857 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30df9d-9d00-4d24-b79b-97a8c8581768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:11.726851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30df9d-9d00-4d24-b79b-97a8c8581768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:11.728330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30df9d-9d00-4d24-b79b-97a8c8581768 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-fd30df9d-9d00-4d24-b79b-97a8c8581768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:54:11.744133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:11.745280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:54:11.746417 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:54:11.746417 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:11.746417 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:54:11.746417 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 637/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:11.751299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896c2a5-36ef-4414-ad0f-0a58e9f0b81e None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:11.834041 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:11.853463 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896c2a5-36ef-4414-ad0f-0a58e9f0b81e None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:11.887380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c738d-07c3-490c-b6a4-31ea441dd6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:11.888008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c738d-07c3-490c-b6a4-31ea441dd6ff None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:11.888290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c738d-07c3-490c-b6a4-31ea441dd6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:11.888559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c738d-07c3-490c-b6a4-31ea441dd6ff None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:11.889201 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c738d-07c3-490c-b6a4-31ea441dd6ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:11.890184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c738d-07c3-490c-b6a4-31ea441dd6ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:11.891546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c738d-07c3-490c-b6a4-31ea441dd6ff None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:11.906408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 629/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:11.912183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30df9d-9d00-4d24-b79b-97a8c8581768 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:12.012325 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30df9d-9d00-4d24-b79b-97a8c8581768 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:12.032195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:12.046017 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec6b97-4eb7-4243-a5dd-08d2c3b58922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:12.046656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec6b97-4eb7-4243-a5dd-08d2c3b58922 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:12.046933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec6b97-4eb7-4243-a5dd-08d2c3b58922 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:12.047204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec6b97-4eb7-4243-a5dd-08d2c3b58922 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:12.056327 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec6b97-4eb7-4243-a5dd-08d2c3b58922 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:12.057793 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec6b97-4eb7-4243-a5dd-08d2c3b58922 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-08ec6b97-4eb7-4243-a5dd-08d2c3b58922 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:54:12.069708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:12.070861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:12.072350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:12.072350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:12.072350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:54:12.072350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:54:12.072350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:54:12.072350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:54:12.072350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:54:12.072350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:54:12.072350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 07:54:12.072350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:54:12.072350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 638/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:54:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:12.076797 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c738d-07c3-490c-b6a4-31ea441dd6ff None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:12.178422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c738d-07c3-490c-b6a4-31ea441dd6ff None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:12.213669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446c1d6-2682-43fa-b7ee-a223427af233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:12.214276 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446c1d6-2682-43fa-b7ee-a223427af233 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:12.214557 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446c1d6-2682-43fa-b7ee-a223427af233 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:12.214830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446c1d6-2682-43fa-b7ee-a223427af233 None admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:12.215559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446c1d6-2682-43fa-b7ee-a223427af233 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:12.215897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446c1d6-2682-43fa-b7ee-a223427af233 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:12.217308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446c1d6-2682-43fa-b7ee-a223427af233 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:12.226024 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:12.234851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 630/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Aug 10 07:54:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:12.240613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec6b97-4eb7-4243-a5dd-08d2c3b58922 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:12.349446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec6b97-4eb7-4243-a5dd-08d2c3b58922 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:12.384513 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f15fd-2175-4911-bbbb-170b6033b2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:12.385142 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f15fd-2175-4911-bbbb-170b6033b2ee None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:12.385421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f15fd-2175-4911-bbbb-170b6033b2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:12.385687 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f15fd-2175-4911-bbbb-170b6033b2ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:12.396403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f15fd-2175-4911-bbbb-170b6033b2ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:12.397850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f15fd-2175-4911-bbbb-170b6033b2ee None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-883f15fd-2175-4911-bbbb-170b6033b2ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:54:12.414309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:12.415485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:54:12.416791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:54:12.416791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:12.416791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:54:12.416791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 639/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:12.421826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446c1d6-2682-43fa-b7ee-a223427af233 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:12.530793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446c1d6-2682-43fa-b7ee-a223427af233 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:12.572125 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe9f2f-68d3-4505-9e4d-09792e07a4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:12.572725 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe9f2f-68d3-4505-9e4d-09792e07a4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:12.573006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe9f2f-68d3-4505-9e4d-09792e07a4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:12.573277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe9f2f-68d3-4505-9e4d-09792e07a4c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:12.573924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe9f2f-68d3-4505-9e4d-09792e07a4c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:12.574225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe9f2f-68d3-4505-9e4d-09792e07a4c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:12.575579 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe9f2f-68d3-4505-9e4d-09792e07a4c9 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:12.590969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 631/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:12.597242 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f15fd-2175-4911-bbbb-170b6033b2ee None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:12.631338 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:12.700883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f15fd-2175-4911-bbbb-170b6033b2ee None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:12.737203 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f3f13-9d9e-45b4-ac27-b0387e5209f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:12.737853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f3f13-9d9e-45b4-ac27-b0387e5209f6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:12.738183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f3f13-9d9e-45b4-ac27-b0387e5209f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:12.738505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f3f13-9d9e-45b4-ac27-b0387e5209f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:12.749288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f3f13-9d9e-45b4-ac27-b0387e5209f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:12.751650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f3f13-9d9e-45b4-ac27-b0387e5209f6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2a9f3f13-9d9e-45b4-ac27-b0387e5209f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:54:12.771695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:12.777863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:12.778952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:54:12.778952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:54:12.778952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:54:12.778952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:54:12.778952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:54:12.778952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:54:12.778952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:54:12.778952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:54:12.778952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 640/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:54:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:12.780187 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe9f2f-68d3-4505-9e4d-09792e07a4c9 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:12.840804 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:12.883556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe9f2f-68d3-4505-9e4d-09792e07a4c9 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:12.917626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98d6bd-b3dd-4772-9943-997471087039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:12.918231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98d6bd-b3dd-4772-9943-997471087039 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:12.918513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98d6bd-b3dd-4772-9943-997471087039 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:12.918786 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98d6bd-b3dd-4772-9943-997471087039 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:12.919477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98d6bd-b3dd-4772-9943-997471087039 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:12.919815 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98d6bd-b3dd-4772-9943-997471087039 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:12.921238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98d6bd-b3dd-4772-9943-997471087039 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:12.933143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 632/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:54:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:12.939653 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f3f13-9d9e-45b4-ac27-b0387e5209f6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:13.028903 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:13.038171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f3f13-9d9e-45b4-ac27-b0387e5209f6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:13.071384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cbfa9-2955-4585-81c4-ebec8e3010c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:13.072053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cbfa9-2955-4585-81c4-ebec8e3010c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:13.072336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cbfa9-2955-4585-81c4-ebec8e3010c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:13.072610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cbfa9-2955-4585-81c4-ebec8e3010c8 None admin] PATH_INFO: `/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/ccab7239a2474aa093e685d5da97f1a9/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:13.074475 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cbfa9-2955-4585-81c4-ebec8e3010c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=bad7eba8964f4acf9c6c1397df7cd1dd, user_id=ccab7239a2474aa093e685d5da97f1a9, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:13.075930 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cbfa9-2955-4585-81c4-ebec8e3010c8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:13.087799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 641/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 10 07:54:12 2022] PUT /identity/v3/projects/bad7eba8964f4acf9c6c1397df7cd1dd/users/ccab7239a2474aa093e685d5da97f1a9/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:54:15.075075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5f184-3780-4fd6-bbdc-a1671e70a179 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:15.075595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5f184-3780-4fd6-bbdc-a1671e70a179 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:15.075721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5f184-3780-4fd6-bbdc-a1671e70a179 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:15.076998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 633/1274] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:54:15.082353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e301d0-d7b3-4475-94d8-d5011f6ba3b3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:15.082783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e301d0-d7b3-4475-94d8-d5011f6ba3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:15.082891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e301d0-d7b3-4475-94d8-d5011f6ba3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:15.101196 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e3e301d0-d7b3-4475-94d8-d5011f6ba3b3 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:54:15.102389 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e3e301d0-d7b3-4475-94d8-d5011f6ba3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:54:15.173895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 642/1275] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:54:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:54:15.197682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5f184-3780-4fd6-bbdc-a1671e70a179 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:15.299003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5f184-3780-4fd6-bbdc-a1671e70a179 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:15.317506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:15.335756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7399670-59ad-407c-8b3b-2c2117771465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:15.336390 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7399670-59ad-407c-8b3b-2c2117771465 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:15.336676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7399670-59ad-407c-8b3b-2c2117771465 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:15.336952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7399670-59ad-407c-8b3b-2c2117771465 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:15.347594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7399670-59ad-407c-8b3b-2c2117771465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-d7399670-59ad-407c-8b3b-2c2117771465 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:54:15.352311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:15.353410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:15.354453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:15.354453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:15.354453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:15.354453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:15.354453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:54:15.354453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:54:15.354453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:54:15.354453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:54:15.354453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:54:15.354453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:54:15.354453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:54:15.354453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:15.354453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 634/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 10 07:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:15.359517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e301d0-d7b3-4475-94d8-d5011f6ba3b3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:15.441758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:15.463577 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e301d0-d7b3-4475-94d8-d5011f6ba3b3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:15.500742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e56b02-6303-4e5a-94e9-cf1586b192a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:15.501353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e56b02-6303-4e5a-94e9-cf1586b192a3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:15.501634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e56b02-6303-4e5a-94e9-cf1586b192a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:15.501906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e56b02-6303-4e5a-94e9-cf1586b192a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:15.502570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e56b02-6303-4e5a-94e9-cf1586b192a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:15.502871 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e56b02-6303-4e5a-94e9-cf1586b192a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:15.504272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e56b02-6303-4e5a-94e9-cf1586b192a3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:15.512292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 643/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 10 07:54:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:15.518465 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7399670-59ad-407c-8b3b-2c2117771465 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:15.615622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7399670-59ad-407c-8b3b-2c2117771465 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:15.650790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a094702-4b7d-4aa1-9b1f-76a08e542fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:15.651404 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a094702-4b7d-4aa1-9b1f-76a08e542fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:15.651685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a094702-4b7d-4aa1-9b1f-76a08e542fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:15.651984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a094702-4b7d-4aa1-9b1f-76a08e542fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:15.662136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a094702-4b7d-4aa1-9b1f-76a08e542fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:15.663567 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a094702-4b7d-4aa1-9b1f-76a08e542fc5 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-7a094702-4b7d-4aa1-9b1f-76a08e542fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:54:15.681441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:15.682606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:54:15.683592 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:54:15.683592 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:15.683592 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:15.683592 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 635/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:15.689007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e56b02-6303-4e5a-94e9-cf1586b192a3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:15.788231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e56b02-6303-4e5a-94e9-cf1586b192a3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:15.821711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d4c5b-b9b1-41f4-a17e-cba84d3cec8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:15.822320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d4c5b-b9b1-41f4-a17e-cba84d3cec8a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:15.822600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d4c5b-b9b1-41f4-a17e-cba84d3cec8a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:15.822873 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d4c5b-b9b1-41f4-a17e-cba84d3cec8a None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:15.823511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d4c5b-b9b1-41f4-a17e-cba84d3cec8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:15.823840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d4c5b-b9b1-41f4-a17e-cba84d3cec8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:15.825207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d4c5b-b9b1-41f4-a17e-cba84d3cec8a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:15.837297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 644/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:15.843201 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a094702-4b7d-4aa1-9b1f-76a08e542fc5 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:15.873550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:15.946612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a094702-4b7d-4aa1-9b1f-76a08e542fc5 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:15.981646 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb319c-b28d-47d1-b7f6-69b289bb44a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:15.982270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb319c-b28d-47d1-b7f6-69b289bb44a7 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:15.982548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb319c-b28d-47d1-b7f6-69b289bb44a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:15.982817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb319c-b28d-47d1-b7f6-69b289bb44a7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:15.994144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb319c-b28d-47d1-b7f6-69b289bb44a7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:15.995908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb319c-b28d-47d1-b7f6-69b289bb44a7 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-18eb319c-b28d-47d1-b7f6-69b289bb44a7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:54:16.006848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:16.008036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:16.009183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:16.009183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:16.009183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:54:16.009183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:54:16.009183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:54:16.009183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:54:16.009183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:54:16.009183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:54:16.009183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 07:54:16.009183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:16.009183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 636/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:54:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:16.013831 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d4c5b-b9b1-41f4-a17e-cba84d3cec8a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:16.018136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:16.110728 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d4c5b-b9b1-41f4-a17e-cba84d3cec8a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:16.144085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc457416-ea86-4245-ad13-11139b9fe7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:16.144691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc457416-ea86-4245-ad13-11139b9fe7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:16.144970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc457416-ea86-4245-ad13-11139b9fe7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:16.145238 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc457416-ea86-4245-ad13-11139b9fe7c9 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:16.145963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc457416-ea86-4245-ad13-11139b9fe7c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:16.146293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc457416-ea86-4245-ad13-11139b9fe7c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:16.147708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc457416-ea86-4245-ad13-11139b9fe7c9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:16.165611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 645/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Aug 10 07:54:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:16.171406 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb319c-b28d-47d1-b7f6-69b289bb44a7 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:16.267015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:16.278958 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb319c-b28d-47d1-b7f6-69b289bb44a7 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:16.315747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d78bc4-4909-4cd3-8718-ad8fd52c5c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:16.316369 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78bc4-4909-4cd3-8718-ad8fd52c5c77 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:16.316649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78bc4-4909-4cd3-8718-ad8fd52c5c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:16.316966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78bc4-4909-4cd3-8718-ad8fd52c5c77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:16.398701 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d78bc4-4909-4cd3-8718-ad8fd52c5c77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:16.400084 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d78bc4-4909-4cd3-8718-ad8fd52c5c77 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:16.492003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:16.503147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 637/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 10 07:54:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:54:16.509043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc457416-ea86-4245-ad13-11139b9fe7c9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:16.571264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:16.611514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc457416-ea86-4245-ad13-11139b9fe7c9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:16.647465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56225c6-2430-4898-8c02-4c009a444f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:16.648133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56225c6-2430-4898-8c02-4c009a444f6f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:16.648420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56225c6-2430-4898-8c02-4c009a444f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:16.648698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56225c6-2430-4898-8c02-4c009a444f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:16.659119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56225c6-2430-4898-8c02-4c009a444f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:16.660559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56225c6-2430-4898-8c02-4c009a444f6f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-d56225c6-2430-4898-8c02-4c009a444f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:54:16.674732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:16.675887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:54:16.676779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:54:16.676779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:54:16.676779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:54:16.676779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 646/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:16.681854 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d78bc4-4909-4cd3-8718-ad8fd52c5c77 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:16.781747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d78bc4-4909-4cd3-8718-ad8fd52c5c77 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:16.815925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fb5e6-bfae-4eac-924d-fd504a0bf68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:16.816526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fb5e6-bfae-4eac-924d-fd504a0bf68a None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:16.816811 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fb5e6-bfae-4eac-924d-fd504a0bf68a None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:16.817085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fb5e6-bfae-4eac-924d-fd504a0bf68a None admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:16.817732 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fb5e6-bfae-4eac-924d-fd504a0bf68a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:16.818037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fb5e6-bfae-4eac-924d-fd504a0bf68a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:16.819407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fb5e6-bfae-4eac-924d-fd504a0bf68a None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:16.830362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 638/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 10 07:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:16.836188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56225c6-2430-4898-8c02-4c009a444f6f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:16.934709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56225c6-2430-4898-8c02-4c009a444f6f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:16.948677 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:16.968804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c08c7-c6ed-46d2-b9d5-7efc36c138b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:16.969428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c08c7-c6ed-46d2-b9d5-7efc36c138b5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:16.969710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c08c7-c6ed-46d2-b9d5-7efc36c138b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:16.969982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c08c7-c6ed-46d2-b9d5-7efc36c138b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:16.976586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c08c7-c6ed-46d2-b9d5-7efc36c138b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:16.978025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c08c7-c6ed-46d2-b9d5-7efc36c138b5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-061c08c7-c6ed-46d2-b9d5-7efc36c138b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:54:16.990448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:16.991510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:16.992524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:54:16.992524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:54:16.992524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:54:16.992524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:54:16.992524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:54:16.992524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:54:16.992524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:54:16.992524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Aug 10 07:54:16.992524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 647/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 10 07:54:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:16.997582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fb5e6-bfae-4eac-924d-fd504a0bf68a None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:17.046530 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:17.101259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fb5e6-bfae-4eac-924d-fd504a0bf68a None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:17.134317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200dc36-0003-4427-ac34-48876d70da00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:17.134983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200dc36-0003-4427-ac34-48876d70da00 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:17.135199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200dc36-0003-4427-ac34-48876d70da00 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:17.135471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200dc36-0003-4427-ac34-48876d70da00 None admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:17.136189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200dc36-0003-4427-ac34-48876d70da00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:17.136495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200dc36-0003-4427-ac34-48876d70da00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:17.137897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200dc36-0003-4427-ac34-48876d70da00 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:17.150293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 639/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 10 07:54:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:54:17.156926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c08c7-c6ed-46d2-b9d5-7efc36c138b5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:17.256386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c08c7-c6ed-46d2-b9d5-7efc36c138b5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:17.288663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f5610-59b1-4b0c-82e6-e3e7bdc17442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:17.289264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f5610-59b1-4b0c-82e6-e3e7bdc17442 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:17.289539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f5610-59b1-4b0c-82e6-e3e7bdc17442 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:17.289808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f5610-59b1-4b0c-82e6-e3e7bdc17442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:17.290519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f5610-59b1-4b0c-82e6-e3e7bdc17442 None admin] RBAC: Adding query filter params (role.id=a0a09ee010c441c88c25f7a1b6cac40c, scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd, user.id=ccab7239a2474aa093e685d5da97f1a9) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:17.290826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f5610-59b1-4b0c-82e6-e3e7bdc17442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:17.292269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f5610-59b1-4b0c-82e6-e3e7bdc17442 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:17.298549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 648/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 10 07:54:17 2022] GET /identity/v3/role_assignments?user.id=ccab7239a2474aa093e685d5da97f1a9&scope.project.id=bad7eba8964f4acf9c6c1397df7cd1dd&role.id=a0a09ee010c441c88c25f7a1b6cac40c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:19.304304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768129-600b-4317-b03d-2d0572753804 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:19.304867 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768129-600b-4317-b03d-2d0572753804 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:19.304867 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768129-600b-4317-b03d-2d0572753804 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:19.306238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 640/1288] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:54:19.311914 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefe42d-0071-4828-a9f5-1263e021a9cb None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:19.312292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefe42d-0071-4828-a9f5-1263e021a9cb None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:19.312456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefe42d-0071-4828-a9f5-1263e021a9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:19.329960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1cefe42d-0071-4828-a9f5-1263e021a9cb None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:54:19.331138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1cefe42d-0071-4828-a9f5-1263e021a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:54:19.361389 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:19.406813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 649/1289] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:54:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:54:19.430879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a768129-600b-4317-b03d-2d0572753804 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:19.584526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a768129-600b-4317-b03d-2d0572753804 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:19.596536 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:19.621321 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23d95d-1c45-412f-8f86-72ca5f9fb5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:19.621957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23d95d-1c45-412f-8f86-72ca5f9fb5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:19.622243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23d95d-1c45-412f-8f86-72ca5f9fb5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:19.622522 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23d95d-1c45-412f-8f86-72ca5f9fb5b3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:19.623116 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23d95d-1c45-412f-8f86-72ca5f9fb5b3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:19.624911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23d95d-1c45-412f-8f86-72ca5f9fb5b3 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-6c23d95d-1c45-412f-8f86-72ca5f9fb5b3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:19.634136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:19.635442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:19.636417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 641/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Aug 10 07:54:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:19.641421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefe42d-0071-4828-a9f5-1263e021a9cb None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:19.740303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefe42d-0071-4828-a9f5-1263e021a9cb None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:19.773669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d68e7f-4ce9-464e-8465-974ef2e1bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:19.774273 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d68e7f-4ce9-464e-8465-974ef2e1bc79 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:19.774552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d68e7f-4ce9-464e-8465-974ef2e1bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:19.774823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d68e7f-4ce9-464e-8465-974ef2e1bc79 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:19.775453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d68e7f-4ce9-464e-8465-974ef2e1bc79 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:19.775783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d68e7f-4ce9-464e-8465-974ef2e1bc79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:19.777138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d68e7f-4ce9-464e-8465-974ef2e1bc79 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:19.782366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 650/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Aug 10 07:54:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:19.788383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23d95d-1c45-412f-8f86-72ca5f9fb5b3 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:19.886096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23d95d-1c45-412f-8f86-72ca5f9fb5b3 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:19.925904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531824d2-8146-4e1c-9eba-608c7dbb1063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:19.926512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531824d2-8146-4e1c-9eba-608c7dbb1063 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:19.926804 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531824d2-8146-4e1c-9eba-608c7dbb1063 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:19.927067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531824d2-8146-4e1c-9eba-608c7dbb1063 None admin] PATH_INFO: `/v3/services` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:19.927995 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531824d2-8146-4e1c-9eba-608c7dbb1063 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:19.928300 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531824d2-8146-4e1c-9eba-608c7dbb1063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:19.929652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531824d2-8146-4e1c-9eba-608c7dbb1063 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:19.934084 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 642/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Aug 10 07:54:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:21.935097 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16723d6d-f190-40ad-b652-f82e96fa9958 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:21.935535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16723d6d-f190-40ad-b652-f82e96fa9958 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:21.935646 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16723d6d-f190-40ad-b652-f82e96fa9958 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:21.937028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 651/1293] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:54:21.942074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9ae4-0f59-4473-9f6d-2d119adc6c25 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:21.942521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9ae4-0f59-4473-9f6d-2d119adc6c25 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:21.942622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9ae4-0f59-4473-9f6d-2d119adc6c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:21.961044 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-5cab9ae4-0f59-4473-9f6d-2d119adc6c25 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:54:21.962238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5cab9ae4-0f59-4473-9f6d-2d119adc6c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:54:21.993027 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:22.033397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 643/1294] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:54:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:54:22.055954 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16723d6d-f190-40ad-b652-f82e96fa9958 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:22.086642 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:22.158344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16723d6d-f190-40ad-b652-f82e96fa9958 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:22.192016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d67ce-7fc8-4a47-82a1-901349641fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:22.192630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d67ce-7fc8-4a47-82a1-901349641fd9 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:22.192912 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d67ce-7fc8-4a47-82a1-901349641fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:22.193183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d67ce-7fc8-4a47-82a1-901349641fd9 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:22.193840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d67ce-7fc8-4a47-82a1-901349641fd9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:22.195209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d67ce-7fc8-4a47-82a1-901349641fd9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:22.209843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 652/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 10 07:54:22 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:54:24.237169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07943-4558-431d-8f02-4eb08a26a57b None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:24.237700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07943-4558-431d-8f02-4eb08a26a57b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:24.237700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07943-4558-431d-8f02-4eb08a26a57b None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:24.239059 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 644/1296] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:54:24.244232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7665-0b3f-4960-9da5-3a9cabf373d1 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:24.244637 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7665-0b3f-4960-9da5-3a9cabf373d1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:24.244785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7665-0b3f-4960-9da5-3a9cabf373d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:24.263156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-175d7665-0b3f-4960-9da5-3a9cabf373d1 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:54:24.265035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-175d7665-0b3f-4960-9da5-3a9cabf373d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:54:24.350798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 653/1297] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:54:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:54:24.374171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b07943-4558-431d-8f02-4eb08a26a57b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:24.478089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b07943-4558-431d-8f02-4eb08a26a57b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:24.513451 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8835621-f3cf-44dc-a919-3d38d3292a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:24.514023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8835621-f3cf-44dc-a919-3d38d3292a10 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:24.514308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8835621-f3cf-44dc-a919-3d38d3292a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:24.514584 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8835621-f3cf-44dc-a919-3d38d3292a10 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:24.515172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8835621-f3cf-44dc-a919-3d38d3292a10 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:24.516584 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8835621-f3cf-44dc-a919-3d38d3292a10 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-a8835621-f3cf-44dc-a919-3d38d3292a10 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:24.525258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:24.526442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:24.527651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 645/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Aug 10 07:54:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:24.532626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d7665-0b3f-4960-9da5-3a9cabf373d1 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:24.551441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:24.637176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d7665-0b3f-4960-9da5-3a9cabf373d1 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:24.678549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368be0a-3141-411d-8cec-2546f3329cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:24.679166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368be0a-3141-411d-8cec-2546f3329cbe None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:24.679450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368be0a-3141-411d-8cec-2546f3329cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:24.679759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368be0a-3141-411d-8cec-2546f3329cbe None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:24.680392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368be0a-3141-411d-8cec-2546f3329cbe None admin] RBAC: Adding query filter params (name=placement) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:24.680698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368be0a-3141-411d-8cec-2546f3329cbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:24.682078 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368be0a-3141-411d-8cec-2546f3329cbe None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:24.687308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 654/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Aug 10 07:54:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:24.693289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8835621-f3cf-44dc-a919-3d38d3292a10 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:24.725493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:24.793260 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8835621-f3cf-44dc-a919-3d38d3292a10 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:24.826657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371b586-d679-4da3-88da-f05ef6ba571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:24.827262 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371b586-d679-4da3-88da-f05ef6ba571e None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:24.827545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371b586-d679-4da3-88da-f05ef6ba571e None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:24.827848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371b586-d679-4da3-88da-f05ef6ba571e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:24.828560 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371b586-d679-4da3-88da-f05ef6ba571e None admin] RBAC: Adding query filter params (interface=public, service_id=ba932a027ecc4965a9a922a9dd364bfe, region_id=RegionOne) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:24.828871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371b586-d679-4da3-88da-f05ef6ba571e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:24.830224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371b586-d679-4da3-88da-f05ef6ba571e None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:24.835278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 646/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 10 07:54:24 2022] GET /identity/v3/endpoints?service_id=ba932a027ecc4965a9a922a9dd364bfe&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:24.840914 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368be0a-3141-411d-8cec-2546f3329cbe None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:24.923467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:24.942120 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368be0a-3141-411d-8cec-2546f3329cbe None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:24.975155 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eeb262-7946-4989-bab0-964bfbd8e4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:24.975770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeb262-7946-4989-bab0-964bfbd8e4fb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:24.976073 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeb262-7946-4989-bab0-964bfbd8e4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:24.976338 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeb262-7946-4989-bab0-964bfbd8e4fb None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:24.976932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eeb262-7946-4989-bab0-964bfbd8e4fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:24.978289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eeb262-7946-4989-bab0-964bfbd8e4fb None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:24.985425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 655/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 10 07:54:24 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:54:26.995043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60710-019b-4a67-b4da-14d2c2d5a9d7 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:26.995594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60710-019b-4a67-b4da-14d2c2d5a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:26.995594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60710-019b-4a67-b4da-14d2c2d5a9d7 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:26.996981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 647/1302] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:54:27.002189 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836e0d5-2051-443a-959b-d6407d9780b9 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:27.002608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836e0d5-2051-443a-959b-d6407d9780b9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:27.002716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836e0d5-2051-443a-959b-d6407d9780b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:27.022239 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a836e0d5-2051-443a-959b-d6407d9780b9 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:54:27.023997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a836e0d5-2051-443a-959b-d6407d9780b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:54:27.098553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 656/1303] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:54:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:54:27.121411 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b60710-019b-4a67-b4da-14d2c2d5a9d7 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:27.217735 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:27.224931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b60710-019b-4a67-b4da-14d2c2d5a9d7 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:27.257251 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765bccc-fb79-4a8b-9847-3f474122f2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:27.257871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765bccc-fb79-4a8b-9847-3f474122f2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:27.258148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765bccc-fb79-4a8b-9847-3f474122f2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:27.258417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765bccc-fb79-4a8b-9847-3f474122f2c0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:27.258990 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765bccc-fb79-4a8b-9847-3f474122f2c0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:27.260367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765bccc-fb79-4a8b-9847-3f474122f2c0 None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application [None req-5765bccc-fb79-4a8b-9847-3f474122f2c0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:54:27.269317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:54:27.270619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application with Lock( Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: ERROR keystone.server.flask.application Aug 10 07:54:27.271904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 648/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Aug 10 07:54:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:54:27.276439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836e0d5-2051-443a-959b-d6407d9780b9 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:27.353617 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:27.377681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836e0d5-2051-443a-959b-d6407d9780b9 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:27.412692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f10d98-714d-4f89-b364-ef1c12627421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:27.413289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f10d98-714d-4f89-b364-ef1c12627421 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:27.413579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f10d98-714d-4f89-b364-ef1c12627421 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:27.413854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f10d98-714d-4f89-b364-ef1c12627421 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:27.414484 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f10d98-714d-4f89-b364-ef1c12627421 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:54:27.414789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f10d98-714d-4f89-b364-ef1c12627421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:27.416287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f10d98-714d-4f89-b364-ef1c12627421 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:27.421467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 657/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Aug 10 07:54:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:54:27.427965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765bccc-fb79-4a8b-9847-3f474122f2c0 None admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:54:27.542669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765bccc-fb79-4a8b-9847-3f474122f2c0 None admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:54:27.577421 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdf3dd-f178-487b-8557-01ba5dc60a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:54:27.578024 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdf3dd-f178-487b-8557-01ba5dc60a8c None admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:54:27.578308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdf3dd-f178-487b-8557-01ba5dc60a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:54:27.578585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdf3dd-f178-487b-8557-01ba5dc60a8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:54:27.579242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdf3dd-f178-487b-8557-01ba5dc60a8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:54:27.580728 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdf3dd-f178-487b-8557-01ba5dc60a8c None admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:54:27.600190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 649/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 07:54:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:54:37.418365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=30 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:54:37.596162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:32.450558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b75a8-e7df-4b8b-9dc6-ed477fbfac93 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:32.451130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b75a8-e7df-4b8b-9dc6-ed477fbfac93 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:32.451389 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b75a8-e7df-4b8b-9dc6-ed477fbfac93 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:32.458741 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5171b3-f2a3-425b-8ad5-9e848bcdb9f0 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:32.459270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5171b3-f2a3-425b-8ad5-9e848bcdb9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:32.459545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5171b3-f2a3-425b-8ad5-9e848bcdb9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:32.463416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 658/1307] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:55:32 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:55:32.622919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-3d5171b3-f2a3-425b-8ad5-9e848bcdb9f0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:55:32.625281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-3d5171b3-f2a3-425b-8ad5-9e848bcdb9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:32.847901 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 650/1308] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:55:32.901015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319691b9-ebc5-4382-95dc-b3a3276f2de2 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:32.901464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319691b9-ebc5-4382-95dc-b3a3276f2de2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:32.901839 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319691b9-ebc5-4382-95dc-b3a3276f2de2 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:32.903344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 659/1309] 10.222.0.30 () {54 vars in 965 bytes} [Wed Aug 10 07:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:55:32.909887 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6bc1d-93cc-4388-95d8-b430b3cc02f9 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:32.910190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6bc1d-93cc-4388-95d8-b430b3cc02f9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:32.910449 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6bc1d-93cc-4388-95d8-b430b3cc02f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:33.001358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-16b6bc1d-93cc-4388-95d8-b430b3cc02f9 None None] MFA Rules not processed for user `bb3537ce04d24347b155855d2e29cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:55:33.002591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-16b6bc1d-93cc-4388-95d8-b430b3cc02f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:33.024815 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:33.095773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 651/1310] 10.222.0.30 () {58 vars in 1062 bytes} [Wed Aug 10 07:55:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:55:33.105429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319691b9-ebc5-4382-95dc-b3a3276f2de2 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:55:33.107201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-319691b9-ebc5-4382-95dc-b3a3276f2de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:33.234054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319691b9-ebc5-4382-95dc-b3a3276f2de2 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:55:33.331833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93069e62-7e10-47ed-b9a6-51a8d705e73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:55:33.332594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93069e62-7e10-47ed-b9a6-51a8d705e73e service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:33.332939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93069e62-7e10-47ed-b9a6-51a8d705e73e service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:33.333281 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93069e62-7e10-47ed-b9a6-51a8d705e73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:33.335113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-93069e62-7e10-47ed-b9a6-51a8d705e73e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:33.405248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:33.473882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93069e62-7e10-47ed-b9a6-51a8d705e73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:55:33.475572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93069e62-7e10-47ed-b9a6-51a8d705e73e service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:55:33.498882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 660/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:55:35.892358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62a112-aced-4e3c-8014-a11094014d03 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:35.892872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62a112-aced-4e3c-8014-a11094014d03 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:35.892966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62a112-aced-4e3c-8014-a11094014d03 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:35.894442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 652/1312] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:55:35.900037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee249f-b20d-4eb0-b5ca-a8446722f908 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:35.900550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee249f-b20d-4eb0-b5ca-a8446722f908 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:35.900671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee249f-b20d-4eb0-b5ca-a8446722f908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:35.982297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-bfee249f-b20d-4eb0-b5ca-a8446722f908 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:55:35.983541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-bfee249f-b20d-4eb0-b5ca-a8446722f908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:36.093935 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 661/1313] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:55:36.132511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62a112-aced-4e3c-8014-a11094014d03 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:55:36.134086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-cb62a112-aced-4e3c-8014-a11094014d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:36.238800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62a112-aced-4e3c-8014-a11094014d03 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:55:36.314977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:36.317813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee076c-715e-495c-a3dd-34781200cf6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:55:36.318973 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee076c-715e-495c-a3dd-34781200cf6b service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:36.319429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee076c-715e-495c-a3dd-34781200cf6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:36.319908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee076c-715e-495c-a3dd-34781200cf6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:36.321764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-87ee076c-715e-495c-a3dd-34781200cf6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:36.435845 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee076c-715e-495c-a3dd-34781200cf6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:55:36.437660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee076c-715e-495c-a3dd-34781200cf6b service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:55:36.457481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 653/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:55:38.866022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee87ba6-a45f-4db0-b69b-386780fd71ff None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:38.866589 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee87ba6-a45f-4db0-b69b-386780fd71ff None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:38.866685 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee87ba6-a45f-4db0-b69b-386780fd71ff None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:38.868195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 662/1315] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:55:38.874539 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36cdd8-dd72-4a42-84ef-bca7d5462b25 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:38.874953 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36cdd8-dd72-4a42-84ef-bca7d5462b25 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:38.875095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36cdd8-dd72-4a42-84ef-bca7d5462b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:38.946248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-6b36cdd8-dd72-4a42-84ef-bca7d5462b25 None None] MFA Rules not processed for user `6e48447e02b346eea64eb71c1e6414e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:55:38.947952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6b36cdd8-dd72-4a42-84ef-bca7d5462b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:39.001456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:39.047951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 654/1316] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:55:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:55:39.087332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee87ba6-a45f-4db0-b69b-386780fd71ff None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:55:39.089527 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cee87ba6-a45f-4db0-b69b-386780fd71ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:39.099380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:39.194922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee87ba6-a45f-4db0-b69b-386780fd71ff None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:55:39.269918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75308c-13ec-4716-a407-a24d169948a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:55:39.270521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75308c-13ec-4716-a407-a24d169948a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:39.270799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75308c-13ec-4716-a407-a24d169948a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:39.271069 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75308c-13ec-4716-a407-a24d169948a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:39.272720 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-af75308c-13ec-4716-a407-a24d169948a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:39.341939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:39.390074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75308c-13ec-4716-a407-a24d169948a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:55:39.391462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75308c-13ec-4716-a407-a24d169948a3 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:55:39.413533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 663/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:55:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:55:42.020304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20291cd3-76ee-42fa-b146-31febdfc4b48 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:42.020888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20291cd3-76ee-42fa-b146-31febdfc4b48 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:42.020888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20291cd3-76ee-42fa-b146-31febdfc4b48 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:42.022224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 655/1318] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:55:42.028304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daa3e0-9765-4676-afec-59628eb9b1cc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:42.028783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daa3e0-9765-4676-afec-59628eb9b1cc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:42.028896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daa3e0-9765-4676-afec-59628eb9b1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:42.096321 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-40daa3e0-9765-4676-afec-59628eb9b1cc None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:55:42.097543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-40daa3e0-9765-4676-afec-59628eb9b1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:42.206802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 664/1319] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:55:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:55:42.246071 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20291cd3-76ee-42fa-b146-31febdfc4b48 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:55:42.247647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-20291cd3-76ee-42fa-b146-31febdfc4b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:42.356380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20291cd3-76ee-42fa-b146-31febdfc4b48 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:55:42.429700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5863bb-f60f-4cbf-94a9-477b7f082b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:55:42.430207 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5863bb-f60f-4cbf-94a9-477b7f082b1e service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:42.430496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5863bb-f60f-4cbf-94a9-477b7f082b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:42.430770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5863bb-f60f-4cbf-94a9-477b7f082b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:42.432495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1a5863bb-f60f-4cbf-94a9-477b7f082b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:42.440837 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:42.550638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5863bb-f60f-4cbf-94a9-477b7f082b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:55:42.552292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5863bb-f60f-4cbf-94a9-477b7f082b1e service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:55:42.570718 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 656/1320] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:55:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:55:45.329895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b989505-0710-4a9c-ab12-710277dc6589 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:45.330442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b989505-0710-4a9c-ab12-710277dc6589 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:45.330570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b989505-0710-4a9c-ab12-710277dc6589 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:45.331957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 665/1321] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:55:45.337817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9193b30-ad15-42a4-bc07-ed29c387a7e2 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:45.338899 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9193b30-ad15-42a4-bc07-ed29c387a7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:45.339054 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9193b30-ad15-42a4-bc07-ed29c387a7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:45.410353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e9193b30-ad15-42a4-bc07-ed29c387a7e2 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:55:45.413522 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e9193b30-ad15-42a4-bc07-ed29c387a7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:45.477702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:45.524465 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 657/1322] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:55:45.575963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5f58a-420a-4a1c-93e9-c8a772a2ac22 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:45.576248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5f58a-420a-4a1c-93e9-c8a772a2ac22 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:45.576522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5f58a-420a-4a1c-93e9-c8a772a2ac22 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:45.577932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 666/1323] 10.222.0.30 () {54 vars in 965 bytes} [Wed Aug 10 07:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:55:45.584793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27657611-b3d2-4e83-9331-6e448c309bbf None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:45.584985 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27657611-b3d2-4e83-9331-6e448c309bbf None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:45.585261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27657611-b3d2-4e83-9331-6e448c309bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:45.685172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-27657611-b3d2-4e83-9331-6e448c309bbf None None] MFA Rules not processed for user `bb3537ce04d24347b155855d2e29cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:55:45.686385 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-27657611-b3d2-4e83-9331-6e448c309bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:45.901346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 658/1324] 10.222.0.30 () {58 vars in 1062 bytes} [Wed Aug 10 07:55:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:55:45.912473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5f58a-420a-4a1c-93e9-c8a772a2ac22 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:55:45.914279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e9b5f58a-420a-4a1c-93e9-c8a772a2ac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:45.940909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:46.042450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5f58a-420a-4a1c-93e9-c8a772a2ac22 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:55:46.128667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a18b0-109e-4b29-9e04-c8c4acfd84a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:55:46.129277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a18b0-109e-4b29-9e04-c8c4acfd84a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:46.129553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a18b0-109e-4b29-9e04-c8c4acfd84a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:46.129819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a18b0-109e-4b29-9e04-c8c4acfd84a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:46.131423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f57a18b0-109e-4b29-9e04-c8c4acfd84a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:46.206780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:46.246789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a18b0-109e-4b29-9e04-c8c4acfd84a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:55:46.248277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a18b0-109e-4b29-9e04-c8c4acfd84a3 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:55:46.266858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 667/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:55:48.588964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059f5a3-eacd-4b59-8761-16ae83d3f663 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:48.589483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059f5a3-eacd-4b59-8761-16ae83d3f663 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:48.589483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059f5a3-eacd-4b59-8761-16ae83d3f663 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:48.590851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 659/1326] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:55:48.596499 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52161df3-628d-4cca-b9d5-c3bf2de1b769 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:48.596996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52161df3-628d-4cca-b9d5-c3bf2de1b769 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:48.597109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52161df3-628d-4cca-b9d5-c3bf2de1b769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:48.681432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-52161df3-628d-4cca-b9d5-c3bf2de1b769 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:55:48.683149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-52161df3-628d-4cca-b9d5-c3bf2de1b769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:48.782864 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 668/1327] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:55:48.819159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059f5a3-eacd-4b59-8761-16ae83d3f663 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:55:48.820753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6059f5a3-eacd-4b59-8761-16ae83d3f663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:48.885645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:48.944283 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059f5a3-eacd-4b59-8761-16ae83d3f663 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:55:49.020659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee5d9b-8330-49fb-94d0-f6cfa1614d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:55:49.021277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee5d9b-8330-49fb-94d0-f6cfa1614d33 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:49.021553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee5d9b-8330-49fb-94d0-f6cfa1614d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:49.021825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee5d9b-8330-49fb-94d0-f6cfa1614d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:49.023419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6fee5d9b-8330-49fb-94d0-f6cfa1614d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:49.134468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:49.140072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee5d9b-8330-49fb-94d0-f6cfa1614d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:55:49.141440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee5d9b-8330-49fb-94d0-f6cfa1614d33 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:55:49.160411 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 660/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:55:51.282247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f58a80-800f-4b41-9ce4-b32c29c909cb None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:51.282768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f58a80-800f-4b41-9ce4-b32c29c909cb None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:51.282861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f58a80-800f-4b41-9ce4-b32c29c909cb None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:51.284516 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 669/1329] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:55:51.289605 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d85135-68be-44a4-a763-b607c3af7d24 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:51.290074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d85135-68be-44a4-a763-b607c3af7d24 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:51.290181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d85135-68be-44a4-a763-b607c3af7d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:51.373115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e4d85135-68be-44a4-a763-b607c3af7d24 None None] MFA Rules not processed for user `6e48447e02b346eea64eb71c1e6414e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:55:51.374509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e4d85135-68be-44a4-a763-b607c3af7d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:51.479870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 661/1330] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:55:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 07:55:51.518611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f58a80-800f-4b41-9ce4-b32c29c909cb None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:55:51.520208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-22f58a80-800f-4b41-9ce4-b32c29c909cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:51.553387 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:51.633298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f58a80-800f-4b41-9ce4-b32c29c909cb None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:55:51.716511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664902dc-1439-43ef-8abd-1ed8fffff9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:55:51.717119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664902dc-1439-43ef-8abd-1ed8fffff9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:51.717397 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664902dc-1439-43ef-8abd-1ed8fffff9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:51.717665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664902dc-1439-43ef-8abd-1ed8fffff9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:51.719270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-664902dc-1439-43ef-8abd-1ed8fffff9c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:51.801435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:51.838607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664902dc-1439-43ef-8abd-1ed8fffff9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:55:51.840113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664902dc-1439-43ef-8abd-1ed8fffff9c2 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:55:51.859877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 670/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:55:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:55:54.377889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518bd2a-8bf7-49c6-8880-ae773f4ab1a5 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:54.378426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518bd2a-8bf7-49c6-8880-ae773f4ab1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:54.378683 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518bd2a-8bf7-49c6-8880-ae773f4ab1a5 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:54.380760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 662/1332] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:55:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:55:54.386274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24cc22-c3e5-4b5c-b96a-67c9193cff1f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:54.386760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24cc22-c3e5-4b5c-b96a-67c9193cff1f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:54.386854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24cc22-c3e5-4b5c-b96a-67c9193cff1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:54.456243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-aa24cc22-c3e5-4b5c-b96a-67c9193cff1f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:55:54.457470 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-aa24cc22-c3e5-4b5c-b96a-67c9193cff1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:54.562548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 671/1333] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:55:54.599010 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518bd2a-8bf7-49c6-8880-ae773f4ab1a5 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:55:54.600582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8518bd2a-8bf7-49c6-8880-ae773f4ab1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:54.677891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:54.712570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518bd2a-8bf7-49c6-8880-ae773f4ab1a5 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:55:54.792100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f91fb9-eb7c-494c-a5ea-6eb846278158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:55:54.792720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f91fb9-eb7c-494c-a5ea-6eb846278158 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:54.793000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f91fb9-eb7c-494c-a5ea-6eb846278158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:54.793307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f91fb9-eb7c-494c-a5ea-6eb846278158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:54.795186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b5f91fb9-eb7c-494c-a5ea-6eb846278158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:54.907608 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f91fb9-eb7c-494c-a5ea-6eb846278158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:55:54.909008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f91fb9-eb7c-494c-a5ea-6eb846278158 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:55:54.920270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:54.930237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 663/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:55:57.023531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43593bec-3b5e-4a4b-963b-cb1d36e90455 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:57.024127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43593bec-3b5e-4a4b-963b-cb1d36e90455 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:57.024127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43593bec-3b5e-4a4b-963b-cb1d36e90455 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:57.025522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 672/1335] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:55:57.030948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c8419-2cb0-438b-a43e-0042ec0b41b1 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:57.031428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c8419-2cb0-438b-a43e-0042ec0b41b1 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:57.031521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c8419-2cb0-438b-a43e-0042ec0b41b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:57.101443 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-df9c8419-2cb0-438b-a43e-0042ec0b41b1 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:55:57.102925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-df9c8419-2cb0-438b-a43e-0042ec0b41b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:57.206279 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 664/1336] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:55:57.246695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43593bec-3b5e-4a4b-963b-cb1d36e90455 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:55:57.248313 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-43593bec-3b5e-4a4b-963b-cb1d36e90455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:57.289082 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:57.357626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43593bec-3b5e-4a4b-963b-cb1d36e90455 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:55:57.436563 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cf781-1c2f-4db3-949b-17704be5827f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:55:57.437447 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cf781-1c2f-4db3-949b-17704be5827f service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:57.437729 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cf781-1c2f-4db3-949b-17704be5827f service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:57.437996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cf781-1c2f-4db3-949b-17704be5827f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:57.439602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-377cf781-1c2f-4db3-949b-17704be5827f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:55:57.526783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:55:57.553457 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cf781-1c2f-4db3-949b-17704be5827f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:55:57.554908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cf781-1c2f-4db3-949b-17704be5827f service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:55:57.573987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 673/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:55:59.968738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5b52f-718a-4a3f-90b3-7f948926f510 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:59.969309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5b52f-718a-4a3f-90b3-7f948926f510 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:59.969309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5b52f-718a-4a3f-90b3-7f948926f510 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:55:59.970643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 665/1338] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:55:59.976147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8182f-e474-478e-ada0-67dee333b903 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:55:59.976608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8182f-e474-478e-ada0-67dee333b903 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:55:59.976785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8182f-e474-478e-ada0-67dee333b903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:00.044384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-82f8182f-e474-478e-ada0-67dee333b903 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:00.045589 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-82f8182f-e474-478e-ada0-67dee333b903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:00.157767 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 674/1339] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:55:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:00.193730 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5b52f-718a-4a3f-90b3-7f948926f510 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:00.195274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-64e5b52f-718a-4a3f-90b3-7f948926f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:00.271912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:00.301784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5b52f-718a-4a3f-90b3-7f948926f510 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:00.377961 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45233467-86ab-4628-979c-0daac56ae280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:00.378566 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45233467-86ab-4628-979c-0daac56ae280 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:00.378847 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45233467-86ab-4628-979c-0daac56ae280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:00.379119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45233467-86ab-4628-979c-0daac56ae280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:00.380781 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-45233467-86ab-4628-979c-0daac56ae280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:00.501777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45233467-86ab-4628-979c-0daac56ae280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:00.503404 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45233467-86ab-4628-979c-0daac56ae280 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:00.522409 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 666/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:56:04.584781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173da3-79ba-4818-8390-7fbbe7d4b19f None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:04.585307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173da3-79ba-4818-8390-7fbbe7d4b19f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:04.585307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173da3-79ba-4818-8390-7fbbe7d4b19f None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:04.586675 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 675/1341] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:04.592372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad09fd-592f-4e37-96d4-472080967a4d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:04.592847 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad09fd-592f-4e37-96d4-472080967a4d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:04.592847 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad09fd-592f-4e37-96d4-472080967a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:04.598485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:04.666442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-61ad09fd-592f-4e37-96d4-472080967a4d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:04.667657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-61ad09fd-592f-4e37-96d4-472080967a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:04.773718 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 667/1342] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:04.813887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6173da3-79ba-4818-8390-7fbbe7d4b19f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:04.815542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e6173da3-79ba-4818-8390-7fbbe7d4b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:04.870286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:04.937767 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6173da3-79ba-4818-8390-7fbbe7d4b19f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:05.020590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad72be8-a36a-4446-bfc7-18d917985949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:05.021206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad72be8-a36a-4446-bfc7-18d917985949 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:05.021487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad72be8-a36a-4446-bfc7-18d917985949 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:05.021760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad72be8-a36a-4446-bfc7-18d917985949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:05.023392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4ad72be8-a36a-4446-bfc7-18d917985949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:05.129205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:05.146497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad72be8-a36a-4446-bfc7-18d917985949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:05.147975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad72be8-a36a-4446-bfc7-18d917985949 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:05.167715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 676/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:56:07.885276 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef2b1f-baa7-41eb-9aec-6d7f2d5c4014 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:07.885859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef2b1f-baa7-41eb-9aec-6d7f2d5c4014 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:07.885859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef2b1f-baa7-41eb-9aec-6d7f2d5c4014 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:07.887354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 668/1344] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:07.893156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3322325-9df4-460c-b82f-374af533ee20 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:07.893721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3322325-9df4-460c-b82f-374af533ee20 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:07.893721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3322325-9df4-460c-b82f-374af533ee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:07.963987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d3322325-9df4-460c-b82f-374af533ee20 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:07.965216 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d3322325-9df4-460c-b82f-374af533ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:08.067520 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 677/1345] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:08.104931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef2b1f-baa7-41eb-9aec-6d7f2d5c4014 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:08.106460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-edef2b1f-baa7-41eb-9aec-6d7f2d5c4014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:08.204299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:08.222839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef2b1f-baa7-41eb-9aec-6d7f2d5c4014 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:08.302267 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab392544-4324-4851-8a02-97990e9bf9bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:08.302871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab392544-4324-4851-8a02-97990e9bf9bb service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:08.303149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab392544-4324-4851-8a02-97990e9bf9bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:08.303419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab392544-4324-4851-8a02-97990e9bf9bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:08.305070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ab392544-4324-4851-8a02-97990e9bf9bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:08.428702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab392544-4324-4851-8a02-97990e9bf9bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:08.430156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab392544-4324-4851-8a02-97990e9bf9bb service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:08.452002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 669/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 07:56:12.562080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5c4a-3fc5-4b69-84a5-5cafc1476fc8 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:12.562590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5c4a-3fc5-4b69-84a5-5cafc1476fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:12.562590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5c4a-3fc5-4b69-84a5-5cafc1476fc8 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:12.563899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 678/1347] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:12.569615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d729113-a96f-4975-a3bd-9019f0c5de75 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:12.570144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d729113-a96f-4975-a3bd-9019f0c5de75 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:12.570144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d729113-a96f-4975-a3bd-9019f0c5de75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:12.586779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:12.647875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-4d729113-a96f-4975-a3bd-9019f0c5de75 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:12.649105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4d729113-a96f-4975-a3bd-9019f0c5de75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:12.782986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 670/1348] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 07:56:12.822871 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f5c4a-3fc5-4b69-84a5-5cafc1476fc8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:12.824461 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ee7f5c4a-3fc5-4b69-84a5-5cafc1476fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:12.890578 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:12.953821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f5c4a-3fc5-4b69-84a5-5cafc1476fc8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:13.040528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c23fb8-8578-442a-8b8b-5085425b221e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:13.041148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c23fb8-8578-442a-8b8b-5085425b221e service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:13.041422 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c23fb8-8578-442a-8b8b-5085425b221e service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:13.041691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c23fb8-8578-442a-8b8b-5085425b221e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:13.043325 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-76c23fb8-8578-442a-8b8b-5085425b221e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:13.166489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:13.170236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c23fb8-8578-442a-8b8b-5085425b221e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:13.172380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c23fb8-8578-442a-8b8b-5085425b221e service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:13.193179 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 679/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:56:18.326318 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3ea22-3a41-4acb-b1e0-e54974843e0b None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:18.326742 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3ea22-3a41-4acb-b1e0-e54974843e0b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:18.326742 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3ea22-3a41-4acb-b1e0-e54974843e0b None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:18.328433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 671/1350] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 07:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:56:18.334763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0b0e1-2697-4509-ac40-47692c899bec None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:18.335233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0b0e1-2697-4509-ac40-47692c899bec None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:18.335324 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0b0e1-2697-4509-ac40-47692c899bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:18.445008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c9d0b0e1-2697-4509-ac40-47692c899bec None None] MFA Rules not processed for user `ccab7239a2474aa093e685d5da97f1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:18.447008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c9d0b0e1-2697-4509-ac40-47692c899bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:18.603143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 680/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 07:56:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:22.781233 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=59 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:22.921227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866504f-e149-44aa-8d46-5d7e515aaa18 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:22.921513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866504f-e149-44aa-8d46-5d7e515aaa18 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:22.921786 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866504f-e149-44aa-8d46-5d7e515aaa18 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:22.923148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 672/1352] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 07:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:22.929246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a16a3-ec69-48d2-9db1-d64c95fdb92b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:22.929755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a16a3-ec69-48d2-9db1-d64c95fdb92b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:22.929854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a16a3-ec69-48d2-9db1-d64c95fdb92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:23.002131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:23.029183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f76a16a3-ec69-48d2-9db1-d64c95fdb92b None None] MFA Rules not processed for user `ccab7239a2474aa093e685d5da97f1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:23.030590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f76a16a3-ec69-48d2-9db1-d64c95fdb92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:23.167830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 681/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 07:56:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:24.449368 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b6bc4-22e3-4ceb-80a5-e3303be122cc None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:24.449914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b6bc4-22e3-4ceb-80a5-e3303be122cc None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:24.450061 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b6bc4-22e3-4ceb-80a5-e3303be122cc None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:24.451561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 673/1354] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 07:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:56:24.458335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6a842-a648-445d-a118-a10a48500cdb None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:24.458335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6a842-a648-445d-a118-a10a48500cdb None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:24.458335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6a842-a648-445d-a118-a10a48500cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:24.541291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6ad6a842-a648-445d-a118-a10a48500cdb None None] MFA Rules not processed for user `ccab7239a2474aa093e685d5da97f1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:24.542609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6ad6a842-a648-445d-a118-a10a48500cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:24.585608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:24.655741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 682/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 07:56:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:28.077231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe91553-3e69-449f-bdd3-e7f300fafe89 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:28.078350 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe91553-3e69-449f-bdd3-e7f300fafe89 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:28.078690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe91553-3e69-449f-bdd3-e7f300fafe89 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:28.081408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 674/1356] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:28.087347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf47bec-0033-464e-b03d-80112e68e50b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:28.088366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf47bec-0033-464e-b03d-80112e68e50b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:28.088798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf47bec-0033-464e-b03d-80112e68e50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:28.191519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3bf47bec-0033-464e-b03d-80112e68e50b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:28.192915 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3bf47bec-0033-464e-b03d-80112e68e50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:28.309726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 683/1357] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:28.364980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40002635-8517-4a57-8ebe-836c022c41d8 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:28.365801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40002635-8517-4a57-8ebe-836c022c41d8 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:28.366328 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40002635-8517-4a57-8ebe-836c022c41d8 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:28.368506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 675/1358] 10.222.0.30 () {54 vars in 962 bytes} [Wed Aug 10 07:56:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:28.376252 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1b49-b4f3-4f6e-bed7-771079ec2d40 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:28.376875 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1b49-b4f3-4f6e-bed7-771079ec2d40 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:28.377493 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1b49-b4f3-4f6e-bed7-771079ec2d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:28.400905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:28.477529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-dafc1b49-b4f3-4f6e-bed7-771079ec2d40 None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:28.478968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dafc1b49-b4f3-4f6e-bed7-771079ec2d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:28.620669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 684/1359] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Aug 10 07:56:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 07:56:28.628555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40002635-8517-4a57-8ebe-836c022c41d8 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:28.630295 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-40002635-8517-4a57-8ebe-836c022c41d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:28.799812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40002635-8517-4a57-8ebe-836c022c41d8 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:28.882179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:28.937652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f56465-7ff1-4a24-ae94-f99c13fabcea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:28.938453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f56465-7ff1-4a24-ae94-f99c13fabcea service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:28.938846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f56465-7ff1-4a24-ae94-f99c13fabcea service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:28.939209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f56465-7ff1-4a24-ae94-f99c13fabcea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:28.940998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-82f56465-7ff1-4a24-ae94-f99c13fabcea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:29.047689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f56465-7ff1-4a24-ae94-f99c13fabcea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:29.049434 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f56465-7ff1-4a24-ae94-f99c13fabcea service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:29.070468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 676/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:56:31.390928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c212cea-0cd5-4f97-a13a-83a2e8c46703 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:31.391945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c212cea-0cd5-4f97-a13a-83a2e8c46703 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:31.391945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c212cea-0cd5-4f97-a13a-83a2e8c46703 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:31.392854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 685/1361] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:31.398619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd823fb-c47e-4a03-84fd-f015a1bf8872 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:31.399099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd823fb-c47e-4a03-84fd-f015a1bf8872 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:31.399228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd823fb-c47e-4a03-84fd-f015a1bf8872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:31.480762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-afd823fb-c47e-4a03-84fd-f015a1bf8872 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:31.482617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-afd823fb-c47e-4a03-84fd-f015a1bf8872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:31.529186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:31.608217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 677/1362] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:31.670456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c212cea-0cd5-4f97-a13a-83a2e8c46703 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:31.672027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8c212cea-0cd5-4f97-a13a-83a2e8c46703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:31.772020 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:31.906874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c212cea-0cd5-4f97-a13a-83a2e8c46703 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:32.041238 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529ec5d-3f1c-4938-b56a-747aadd9cef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:32.041854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529ec5d-3f1c-4938-b56a-747aadd9cef5 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:32.042132 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529ec5d-3f1c-4938-b56a-747aadd9cef5 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:32.042396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529ec5d-3f1c-4938-b56a-747aadd9cef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:32.044122 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0529ec5d-3f1c-4938-b56a-747aadd9cef5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:32.075581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:32.160330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529ec5d-3f1c-4938-b56a-747aadd9cef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:32.161943 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529ec5d-3f1c-4938-b56a-747aadd9cef5 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:32.184099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 686/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:56:34.598982 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688c929-a46a-4297-a862-383e0eff5cbf None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:34.599506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688c929-a46a-4297-a862-383e0eff5cbf None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:34.600225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688c929-a46a-4297-a862-383e0eff5cbf None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:34.602305 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 678/1364] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:34.608244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdc995-16ba-4bf8-ac56-d81c93db2f5f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:34.608747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdc995-16ba-4bf8-ac56-d81c93db2f5f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:34.608842 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdc995-16ba-4bf8-ac56-d81c93db2f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:34.694454 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c3cdc995-16ba-4bf8-ac56-d81c93db2f5f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:34.696355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c3cdc995-16ba-4bf8-ac56-d81c93db2f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:34.806830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:34.815766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 687/1365] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:34.861194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0269f-2555-415d-be48-72820e175717 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:34.861413 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0269f-2555-415d-be48-72820e175717 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:34.861650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0269f-2555-415d-be48-72820e175717 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:34.862982 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 679/1366] 10.222.0.30 () {54 vars in 962 bytes} [Wed Aug 10 07:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:34.869149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a8169-1994-4934-8142-5ab1278d55d4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:34.869433 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a8169-1994-4934-8142-5ab1278d55d4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:34.869704 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a8169-1994-4934-8142-5ab1278d55d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:34.961805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-918a8169-1994-4934-8142-5ab1278d55d4 None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:34.963148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-918a8169-1994-4934-8142-5ab1278d55d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:35.114166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 688/1367] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Aug 10 07:56:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:35.123126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0269f-2555-415d-be48-72820e175717 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:35.125006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f9b0269f-2555-415d-be48-72820e175717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:35.301695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0269f-2555-415d-be48-72820e175717 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:35.326900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:35.444307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfe470-d2e6-49e2-9f23-ff3e8fd2161d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:35.444929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfe470-d2e6-49e2-9f23-ff3e8fd2161d service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:35.445308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfe470-d2e6-49e2-9f23-ff3e8fd2161d service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:35.445626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfe470-d2e6-49e2-9f23-ff3e8fd2161d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:35.447400 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1edfe470-d2e6-49e2-9f23-ff3e8fd2161d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:35.557735 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfe470-d2e6-49e2-9f23-ff3e8fd2161d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:35.559317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfe470-d2e6-49e2-9f23-ff3e8fd2161d service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:35.580576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 680/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 07:56:36.510722 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988782d-5b98-4fac-86b4-cb8eafd0f08d None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:36.511289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988782d-5b98-4fac-86b4-cb8eafd0f08d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:36.511289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988782d-5b98-4fac-86b4-cb8eafd0f08d None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:36.512820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 689/1369] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:36.518047 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed487-9cb4-4cb3-831d-5c234301b0f9 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:36.518501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed487-9cb4-4cb3-831d-5c234301b0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:36.518606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed487-9cb4-4cb3-831d-5c234301b0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:36.553297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:36.594770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-7a3ed487-9cb4-4cb3-831d-5c234301b0f9 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:36.596038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7a3ed487-9cb4-4cb3-831d-5c234301b0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:36.711755 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 681/1370] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:37.049383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7927cc-2527-4b57-bcb5-1283d3f98f53 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:37.049674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7927cc-2527-4b57-bcb5-1283d3f98f53 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:37.050210 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7927cc-2527-4b57-bcb5-1283d3f98f53 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:37.052165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 690/1371] 10.222.0.30 () {54 vars in 964 bytes} [Wed Aug 10 07:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:37.059581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0dada-ba53-47c9-b134-670b4a7faa13 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:37.059581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0dada-ba53-47c9-b134-670b4a7faa13 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:37.059581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0dada-ba53-47c9-b134-670b4a7faa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:37.151943 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-7ec0dada-ba53-47c9-b134-670b4a7faa13 None None] MFA Rules not processed for user `ab0470979f1643a390c667efc55c4069`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:37.153161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7ec0dada-ba53-47c9-b134-670b4a7faa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:37.215861 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:37.253572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 682/1372] 10.222.0.30 () {58 vars in 1061 bytes} [Wed Aug 10 07:56:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:37.262049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7927cc-2527-4b57-bcb5-1283d3f98f53 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:37.264021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7a7927cc-2527-4b57-bcb5-1283d3f98f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:37.324721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:37.397292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7927cc-2527-4b57-bcb5-1283d3f98f53 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:37.499433 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf39bca-319c-451d-ae87-397fe510a52c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:37.500175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf39bca-319c-451d-ae87-397fe510a52c service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:37.500777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf39bca-319c-451d-ae87-397fe510a52c service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:37.501061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf39bca-319c-451d-ae87-397fe510a52c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:37.502728 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ddf39bca-319c-451d-ae87-397fe510a52c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:37.624273 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:37.641145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf39bca-319c-451d-ae87-397fe510a52c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:37.643272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf39bca-319c-451d-ae87-397fe510a52c service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:37.668922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 691/1373] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:56:37.730067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df3105-e828-4ce4-adf8-46dd4ab23e11 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:37.730972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df3105-e828-4ce4-adf8-46dd4ab23e11 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:37.730972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df3105-e828-4ce4-adf8-46dd4ab23e11 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:37.732751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 683/1374] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:37.741700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a00799-0ebb-4a07-8b90-f22a68b02c89 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:37.742826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a00799-0ebb-4a07-8b90-f22a68b02c89 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:37.743188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a00799-0ebb-4a07-8b90-f22a68b02c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:37.835567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-88a00799-0ebb-4a07-8b90-f22a68b02c89 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:37.837068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-88a00799-0ebb-4a07-8b90-f22a68b02c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:37.982690 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 692/1375] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:38.028101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df3105-e828-4ce4-adf8-46dd4ab23e11 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:38.029768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f1df3105-e828-4ce4-adf8-46dd4ab23e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:38.183504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df3105-e828-4ce4-adf8-46dd4ab23e11 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:38.235275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:38.299464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a0e6e-7d65-4398-9436-13f4b933b8ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:38.300237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0e6e-7d65-4398-9436-13f4b933b8ce service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:38.300511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0e6e-7d65-4398-9436-13f4b933b8ce service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:38.300779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0e6e-7d65-4398-9436-13f4b933b8ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:38.302384 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6e3a0e6e-7d65-4398-9436-13f4b933b8ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:38.401676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a0e6e-7d65-4398-9436-13f4b933b8ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:38.403271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a0e6e-7d65-4398-9436-13f4b933b8ce service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:38.422482 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 684/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:56:40.480345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4007e-2435-49b4-9290-19dffb41b4c5 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:40.480897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4007e-2435-49b4-9290-19dffb41b4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:40.481127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4007e-2435-49b4-9290-19dffb41b4c5 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:40.482965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 693/1377] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:40.488648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991da72-c979-4e91-87bc-de01fe4b7659 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:40.489152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991da72-c979-4e91-87bc-de01fe4b7659 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:40.489258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991da72-c979-4e91-87bc-de01fe4b7659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:40.558348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b991da72-c979-4e91-87bc-de01fe4b7659 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:40.559573 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b991da72-c979-4e91-87bc-de01fe4b7659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:40.566844 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:40.670508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 685/1378] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:40.719992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4007e-2435-49b4-9290-19dffb41b4c5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:40.719992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3fa4007e-2435-49b4-9290-19dffb41b4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:40.814492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:40.905777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4007e-2435-49b4-9290-19dffb41b4c5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:41.028233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda622f2-5147-41f9-856d-927fe8c6afb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:41.028851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda622f2-5147-41f9-856d-927fe8c6afb6 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:41.029133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda622f2-5147-41f9-856d-927fe8c6afb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:41.029405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda622f2-5147-41f9-856d-927fe8c6afb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:41.031051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dda622f2-5147-41f9-856d-927fe8c6afb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:41.051625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:41.150155 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda622f2-5147-41f9-856d-927fe8c6afb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:41.152048 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda622f2-5147-41f9-856d-927fe8c6afb6 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:41.176208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 694/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:56:43.272986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a76cf-9a2f-45b4-a24d-45715c6c5921 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:43.273616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a76cf-9a2f-45b4-a24d-45715c6c5921 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:43.273616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a76cf-9a2f-45b4-a24d-45715c6c5921 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:43.275277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 686/1380] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:43.281391 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbab7f2-d191-4d6e-8a81-d38639b0bca0 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:43.282011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbab7f2-d191-4d6e-8a81-d38639b0bca0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:43.282011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbab7f2-d191-4d6e-8a81-d38639b0bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:43.358307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-cbbab7f2-d191-4d6e-8a81-d38639b0bca0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:43.360008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cbbab7f2-d191-4d6e-8a81-d38639b0bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:43.466649 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:43.475758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 695/1381] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:43.519126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a76cf-9a2f-45b4-a24d-45715c6c5921 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:43.521517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8b4a76cf-9a2f-45b4-a24d-45715c6c5921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:43.678965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:43.691152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a76cf-9a2f-45b4-a24d-45715c6c5921 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:43.816706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b49807-28c2-48f2-bb50-e753888c463a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:43.817406 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b49807-28c2-48f2-bb50-e753888c463a service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:43.817929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b49807-28c2-48f2-bb50-e753888c463a service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:43.818282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b49807-28c2-48f2-bb50-e753888c463a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:43.820553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d3b49807-28c2-48f2-bb50-e753888c463a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:43.930361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b49807-28c2-48f2-bb50-e753888c463a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:43.932159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b49807-28c2-48f2-bb50-e753888c463a service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:43.945689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:43.956238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 687/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:56:46.289297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5a54f-effc-40df-a6be-18942f0ab4a0 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:46.289884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5a54f-effc-40df-a6be-18942f0ab4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:46.289884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5a54f-effc-40df-a6be-18942f0ab4a0 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:46.291196 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 696/1383] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:46.297175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b459d9-3259-4919-9cc5-3f1443d71f6f None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:46.297660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b459d9-3259-4919-9cc5-3f1443d71f6f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:46.297761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b459d9-3259-4919-9cc5-3f1443d71f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:46.380153 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-f4b459d9-3259-4919-9cc5-3f1443d71f6f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:46.382028 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f4b459d9-3259-4919-9cc5-3f1443d71f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:46.509216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 688/1384] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:46.555093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5a54f-effc-40df-a6be-18942f0ab4a0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:46.557284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b5c5a54f-effc-40df-a6be-18942f0ab4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:46.731338 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5a54f-effc-40df-a6be-18942f0ab4a0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:46.813325 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:46.874447 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b66c60-3ef2-44bc-981d-2500ece57bda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:46.875207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b66c60-3ef2-44bc-981d-2500ece57bda service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:46.875589 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b66c60-3ef2-44bc-981d-2500ece57bda service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:46.875912 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b66c60-3ef2-44bc-981d-2500ece57bda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:46.877689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-50b66c60-3ef2-44bc-981d-2500ece57bda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:46.988400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b66c60-3ef2-44bc-981d-2500ece57bda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:46.992730 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b66c60-3ef2-44bc-981d-2500ece57bda service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:47.011929 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 697/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:56:49.162616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70234105-1280-48d0-866a-1bfa1cde7e41 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:49.163217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70234105-1280-48d0-866a-1bfa1cde7e41 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:49.163217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70234105-1280-48d0-866a-1bfa1cde7e41 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:49.165293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 689/1386] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:49.174993 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da22e-95c9-4b6d-a817-82aa127959c4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:49.175531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da22e-95c9-4b6d-a817-82aa127959c4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:49.176026 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da22e-95c9-4b6d-a817-82aa127959c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:49.257853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ff8da22e-95c9-4b6d-a817-82aa127959c4 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:49.259096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ff8da22e-95c9-4b6d-a817-82aa127959c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:49.295695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:49.363896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 698/1387] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:49.420498 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70234105-1280-48d0-866a-1bfa1cde7e41 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:49.423275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-70234105-1280-48d0-866a-1bfa1cde7e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:49.513669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:49.600934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70234105-1280-48d0-866a-1bfa1cde7e41 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:49.742734 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712a594-be30-4032-96b8-07b64ec95ef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:49.743350 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712a594-be30-4032-96b8-07b64ec95ef6 service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:49.743630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712a594-be30-4032-96b8-07b64ec95ef6 service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:49.743937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712a594-be30-4032-96b8-07b64ec95ef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:49.745720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5712a594-be30-4032-96b8-07b64ec95ef6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:49.789833 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:49.847162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712a594-be30-4032-96b8-07b64ec95ef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:49.848857 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712a594-be30-4032-96b8-07b64ec95ef6 service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:49.869667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 690/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:56:52.134509 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28d9b7-2578-4b2d-89a0-46adc16c3a63 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:52.135301 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28d9b7-2578-4b2d-89a0-46adc16c3a63 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:52.135492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28d9b7-2578-4b2d-89a0-46adc16c3a63 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:52.136944 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 699/1389] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:52.142593 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15821d48-84ae-4cf1-a91b-8ca4939839b2 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:52.143090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15821d48-84ae-4cf1-a91b-8ca4939839b2 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:52.143200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15821d48-84ae-4cf1-a91b-8ca4939839b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:52.217035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-15821d48-84ae-4cf1-a91b-8ca4939839b2 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:52.218262 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-15821d48-84ae-4cf1-a91b-8ca4939839b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:52.331516 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 691/1390] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:52.376602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28d9b7-2578-4b2d-89a0-46adc16c3a63 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:52.378173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dd28d9b7-2578-4b2d-89a0-46adc16c3a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:52.540215 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28d9b7-2578-4b2d-89a0-46adc16c3a63 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:52.559615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:52.667530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da3e68-e338-4092-a257-35d10a0d09b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:52.668873 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da3e68-e338-4092-a257-35d10a0d09b7 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:52.668873 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da3e68-e338-4092-a257-35d10a0d09b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:52.669123 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da3e68-e338-4092-a257-35d10a0d09b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:52.672412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-37da3e68-e338-4092-a257-35d10a0d09b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:52.777996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da3e68-e338-4092-a257-35d10a0d09b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:52.779940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da3e68-e338-4092-a257-35d10a0d09b7 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:52.800432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 700/1391] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:56:53.110947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a95d-7fa6-4680-94c2-fe0b7ebcbd8d None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:53.111235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a95d-7fa6-4680-94c2-fe0b7ebcbd8d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:53.111446 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a95d-7fa6-4680-94c2-fe0b7ebcbd8d None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:53.113057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 692/1392] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:53.120777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966b9f7-b296-42c0-bae9-d5a2ee79193d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:53.121064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966b9f7-b296-42c0-bae9-d5a2ee79193d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:53.121368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966b9f7-b296-42c0-bae9-d5a2ee79193d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:53.149047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:53.197274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0966b9f7-b296-42c0-bae9-d5a2ee79193d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:53.200142 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0966b9f7-b296-42c0-bae9-d5a2ee79193d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:53.318944 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 701/1393] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:53.376924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903aebb-d5e8-412e-8db9-9d85023d3591 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:53.377468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903aebb-d5e8-412e-8db9-9d85023d3591 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:53.377468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903aebb-d5e8-412e-8db9-9d85023d3591 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:53.378820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 693/1394] 10.222.0.30 () {54 vars in 967 bytes} [Wed Aug 10 07:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:53.385292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0890c31-b2c5-449b-8511-bc9550296ee6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:53.385585 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0890c31-b2c5-449b-8511-bc9550296ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:53.385865 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0890c31-b2c5-449b-8511-bc9550296ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:53.470678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f0890c31-b2c5-449b-8511-bc9550296ee6 None None] MFA Rules not processed for user `553916344aaf40ae8abb050540f10559`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:53.472264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f0890c31-b2c5-449b-8511-bc9550296ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:53.521035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:53.561869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 702/1395] 10.222.0.30 () {58 vars in 1064 bytes} [Wed Aug 10 07:56:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:53.569512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903aebb-d5e8-412e-8db9-9d85023d3591 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:53.571075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a903aebb-d5e8-412e-8db9-9d85023d3591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:53.586019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:53.684537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903aebb-d5e8-412e-8db9-9d85023d3591 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:53.762107 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a818bf2-b981-429e-b9bc-9a9103fd2e65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553916344aaf40ae8abb050540f10559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:53.762717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a818bf2-b981-429e-b9bc-9a9103fd2e65 service glance] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:53.763000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a818bf2-b981-429e-b9bc-9a9103fd2e65 service glance] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:53.763270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a818bf2-b981-429e-b9bc-9a9103fd2e65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:53.764947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4a818bf2-b981-429e-b9bc-9a9103fd2e65 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:53.836066 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:53.881590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a818bf2-b981-429e-b9bc-9a9103fd2e65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:53.883066 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a818bf2-b981-429e-b9bc-9a9103fd2e65 service glance] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:53.904232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 694/1396] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:56:54.672151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b01c01-a71a-4a51-a3d2-2b1cd488a52f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:54.672696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b01c01-a71a-4a51-a3d2-2b1cd488a52f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:54.672696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b01c01-a71a-4a51-a3d2-2b1cd488a52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:54.743618 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a4b01c01-a71a-4a51-a3d2-2b1cd488a52f None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:54.744882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a4b01c01-a71a-4a51-a3d2-2b1cd488a52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:54.834044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 703/1397] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 07:56:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:54.882866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e3458-c38f-41aa-80ac-a8e187deefac None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:54.883405 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e3458-c38f-41aa-80ac-a8e187deefac None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:54.883405 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e3458-c38f-41aa-80ac-a8e187deefac None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:54.884828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 695/1398] 10.222.0.30 () {54 vars in 943 bytes} [Wed Aug 10 07:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:54.893401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112997d-78fe-4041-a13c-f562d97047bc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:54.893690 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112997d-78fe-4041-a13c-f562d97047bc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:54.893966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112997d-78fe-4041-a13c-f562d97047bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:54.933121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeffdb-615b-48af-9328-722d132ad1bd None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:54.933410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeffdb-615b-48af-9328-722d132ad1bd None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:54.933683 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeffdb-615b-48af-9328-722d132ad1bd None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:54.935038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 696/1399] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:56:54.940410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2fe30-b1e1-4fb3-bb91-bda6511954f7 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:54.940696 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2fe30-b1e1-4fb3-bb91-bda6511954f7 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:54.940972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2fe30-b1e1-4fb3-bb91-bda6511954f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:54.973661 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:54.984225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2112997d-78fe-4041-a13c-f562d97047bc None None] MFA Rules not processed for user `867485ce37eb41359a8e53b2b78061f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:54.985459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2112997d-78fe-4041-a13c-f562d97047bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:55.015812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-64e2fe30-b1e1-4fb3-bb91-bda6511954f7 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:55.017051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-64e2fe30-b1e1-4fb3-bb91-bda6511954f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:55.101901 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 704/1400] 10.222.0.30 () {58 vars in 1040 bytes} [Wed Aug 10 07:56:54 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:55.111452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112997d-78fe-4041-a13c-f562d97047bc None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:55.122287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112997d-78fe-4041-a13c-f562d97047bc None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:55.125408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 697/1401] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 07:56:55.171430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2fe30-b1e1-4fb3-bb91-bda6511954f7 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:55.172693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-64e2fe30-b1e1-4fb3-bb91-bda6511954f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:55.200141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:55.236501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094e718-07a8-4825-9d8f-a63a96d83655 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:55.237105 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094e718-07a8-4825-9d8f-a63a96d83655 service swift] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:55.237384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094e718-07a8-4825-9d8f-a63a96d83655 service swift] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:55.237655 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094e718-07a8-4825-9d8f-a63a96d83655 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:55.239341 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0094e718-07a8-4825-9d8f-a63a96d83655 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:55.242068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:55.294022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2fe30-b1e1-4fb3-bb91-bda6511954f7 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:55.341692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094e718-07a8-4825-9d8f-a63a96d83655 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:55.343318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094e718-07a8-4825-9d8f-a63a96d83655 service swift] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:55.351971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 705/1402] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 07:56:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 07:56:55.433318 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ef28d-ff57-4a5d-9332-4f9f7903553f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:55.433934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ef28d-ff57-4a5d-9332-4f9f7903553f service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:55.434217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ef28d-ff57-4a5d-9332-4f9f7903553f service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:55.434503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ef28d-ff57-4a5d-9332-4f9f7903553f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:55.436239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f34ef28d-ff57-4a5d-9332-4f9f7903553f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:55.464068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:55.586794 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ef28d-ff57-4a5d-9332-4f9f7903553f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:55.590445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ef28d-ff57-4a5d-9332-4f9f7903553f service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:55.615821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 698/1403] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 07:56:57.725250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06448050-4723-471f-abfa-7b26efbecbda None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:57.726477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06448050-4723-471f-abfa-7b26efbecbda None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:57.726477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06448050-4723-471f-abfa-7b26efbecbda None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:57.728710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 706/1404] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:56:57.733490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d593a02-7248-45ee-a256-ba1a36afceca None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:57.733965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d593a02-7248-45ee-a256-ba1a36afceca None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:57.734053 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d593a02-7248-45ee-a256-ba1a36afceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:57.811301 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-1d593a02-7248-45ee-a256-ba1a36afceca None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:57.812579 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1d593a02-7248-45ee-a256-ba1a36afceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:57.935758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:57.950130 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 699/1405] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:56:58.006236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06448050-4723-471f-abfa-7b26efbecbda None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:56:58.008830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-06448050-4723-471f-abfa-7b26efbecbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:58.188910 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:56:58.191289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06448050-4723-471f-abfa-7b26efbecbda None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:56:58.326520 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628aabe-7001-427c-8dce-7c53e69afd36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:56:58.327545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628aabe-7001-427c-8dce-7c53e69afd36 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:58.327924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628aabe-7001-427c-8dce-7c53e69afd36 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:58.328212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628aabe-7001-427c-8dce-7c53e69afd36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:58.330008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a628aabe-7001-427c-8dce-7c53e69afd36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:58.442525 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628aabe-7001-427c-8dce-7c53e69afd36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:56:58.444245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628aabe-7001-427c-8dce-7c53e69afd36 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:56:58.475250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 707/1406] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:00.605193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f035d8-5a24-420d-bbec-13f031aa925d None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:00.605773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f035d8-5a24-420d-bbec-13f031aa925d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:00.605773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f035d8-5a24-420d-bbec-13f031aa925d None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:00.607078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 700/1407] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:00.612739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fbc7e-7ecf-4913-b2a5-b84ef195b28d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:00.613177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fbc7e-7ecf-4913-b2a5-b84ef195b28d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:00.613670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fbc7e-7ecf-4913-b2a5-b84ef195b28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:00.618935 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:00.692712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5c4fbc7e-7ecf-4913-b2a5-b84ef195b28d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:00.693952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5c4fbc7e-7ecf-4913-b2a5-b84ef195b28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:00.811768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 708/1408] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:00.854351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f035d8-5a24-420d-bbec-13f031aa925d None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:00.856178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-56f035d8-5a24-420d-bbec-13f031aa925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:01.054889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f035d8-5a24-420d-bbec-13f031aa925d None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:01.151179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:01.226435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cfc63-2209-4bc8-8875-f6c32b7e3fb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:01.227053 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cfc63-2209-4bc8-8875-f6c32b7e3fb6 service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:01.227335 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cfc63-2209-4bc8-8875-f6c32b7e3fb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:01.227609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cfc63-2209-4bc8-8875-f6c32b7e3fb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:01.229420 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b62cfc63-2209-4bc8-8875-f6c32b7e3fb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:01.333784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cfc63-2209-4bc8-8875-f6c32b7e3fb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:01.335448 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cfc63-2209-4bc8-8875-f6c32b7e3fb6 service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:01.356662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 701/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:10.806071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=64 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:11.353985 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=64 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:17.673640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed64c5-ce5f-4a07-bed2-28f4cd6c0fce None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:17.674187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed64c5-ce5f-4a07-bed2-28f4cd6c0fce None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:17.674187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed64c5-ce5f-4a07-bed2-28f4cd6c0fce None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:17.675809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 709/1410] 10.222.0.30 () {54 vars in 918 bytes} [Wed Aug 10 07:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:17.681040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9da61f-c080-46d7-a430-c1ce9803dfd6 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:17.681453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9da61f-c080-46d7-a430-c1ce9803dfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:17.681614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9da61f-c080-46d7-a430-c1ce9803dfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:17.757629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-aa9da61f-c080-46d7-a430-c1ce9803dfd6 None None] MFA Rules not processed for user `ccab7239a2474aa093e685d5da97f1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:17.758846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-aa9da61f-c080-46d7-a430-c1ce9803dfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:17.864581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 702/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Aug 10 07:57:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 07:57:17.879388 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbeef3-78b3-4614-918f-3c506876cd1a None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:17.879669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbeef3-78b3-4614-918f-3c506876cd1a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:17.879973 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbeef3-78b3-4614-918f-3c506876cd1a None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:17.881380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 710/1412] 10.222.0.30 () {54 vars in 918 bytes} [Wed Aug 10 07:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:17.886095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bb5bc-62f7-43eb-9758-3e3fbe4605ff None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:17.886414 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bb5bc-62f7-43eb-9758-3e3fbe4605ff None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:17.886719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bb5bc-62f7-43eb-9758-3e3fbe4605ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:17.960767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:17.963496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-701bb5bc-62f7-43eb-9758-3e3fbe4605ff None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:17.965342 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-701bb5bc-62f7-43eb-9758-3e3fbe4605ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:18.080976 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 703/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Aug 10 07:57:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:20.552290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ab80-6e2a-4d2d-a952-26357fe6ca4d None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:20.552833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ab80-6e2a-4d2d-a952-26357fe6ca4d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:20.552955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ab80-6e2a-4d2d-a952-26357fe6ca4d None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:20.554249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 07:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:20.559368 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec73f-ca81-4e53-b0bc-01689117c483 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:20.559819 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec73f-ca81-4e53-b0bc-01689117c483 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:20.559932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec73f-ca81-4e53-b0bc-01689117c483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:20.624379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e6aec73f-ca81-4e53-b0bc-01689117c483 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:20.625583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e6aec73f-ca81-4e53-b0bc-01689117c483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:20.680492 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:20.722532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 07:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:20.765603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ab80-6e2a-4d2d-a952-26357fe6ca4d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:20.768144 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-55b5ab80-6e2a-4d2d-a952-26357fe6ca4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:20.915269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ab80-6e2a-4d2d-a952-26357fe6ca4d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:20.987101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:21.026977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2973d23-c95c-40ae-8883-50bdf5d75c5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:21.027585 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973d23-c95c-40ae-8883-50bdf5d75c5b service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:21.027897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973d23-c95c-40ae-8883-50bdf5d75c5b service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:21.028170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973d23-c95c-40ae-8883-50bdf5d75c5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:21.029822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e2973d23-c95c-40ae-8883-50bdf5d75c5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:21.118330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2973d23-c95c-40ae-8883-50bdf5d75c5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:21.119958 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2973d23-c95c-40ae-8883-50bdf5d75c5b service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:21.137531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 712/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:22.025949 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec97c-dae8-45c3-b961-42bf14ff4804 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:22.026495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec97c-dae8-45c3-b961-42bf14ff4804 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:22.026495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec97c-dae8-45c3-b961-42bf14ff4804 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:22.027884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 07:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:22.032715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3c529-4870-4068-9d94-8edb772e5a1e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:22.033140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3c529-4870-4068-9d94-8edb772e5a1e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:22.033262 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3c529-4870-4068-9d94-8edb772e5a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:22.109771 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-95d3c529-4870-4068-9d94-8edb772e5a1e None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:22.110972 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-95d3c529-4870-4068-9d94-8edb772e5a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:22.137210 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:22.207423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 07:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:22.356634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ec97c-dae8-45c3-b961-42bf14ff4804 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:22.358250 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0e1ec97c-dae8-45c3-b961-42bf14ff4804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:22.505103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ec97c-dae8-45c3-b961-42bf14ff4804 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:22.545816 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:22.618034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b4572-5661-49c7-afb4-0384d65cf0cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:22.618630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b4572-5661-49c7-afb4-0384d65cf0cd service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:22.618913 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b4572-5661-49c7-afb4-0384d65cf0cd service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:22.619180 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b4572-5661-49c7-afb4-0384d65cf0cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:22.620818 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-386b4572-5661-49c7-afb4-0384d65cf0cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:22.709538 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b4572-5661-49c7-afb4-0384d65cf0cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:22.711098 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b4572-5661-49c7-afb4-0384d65cf0cd service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:22.729093 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 706/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:23.617193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3724c9-f21c-4049-9a39-50f2c064a0de None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:23.617768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3724c9-f21c-4049-9a39-50f2c064a0de None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:23.617768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3724c9-f21c-4049-9a39-50f2c064a0de None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:23.619084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 07:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:23.624130 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f703ee-6b52-4a04-bc48-8b56df884471 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:23.624556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f703ee-6b52-4a04-bc48-8b56df884471 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:23.624688 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f703ee-6b52-4a04-bc48-8b56df884471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:23.679901 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:23.701812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-00f703ee-6b52-4a04-bc48-8b56df884471 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:23.703014 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-00f703ee-6b52-4a04-bc48-8b56df884471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:23.796677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 07:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:23.949053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3724c9-f21c-4049-9a39-50f2c064a0de None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:23.950601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fd3724c9-f21c-4049-9a39-50f2c064a0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:24.092693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3724c9-f21c-4049-9a39-50f2c064a0de None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:24.105420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:24.206630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff8ac8-6e4c-4f9d-ba83-80b0545f07d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:24.207234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff8ac8-6e4c-4f9d-ba83-80b0545f07d4 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.207513 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff8ac8-6e4c-4f9d-ba83-80b0545f07d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.207812 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff8ac8-6e4c-4f9d-ba83-80b0545f07d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.209442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-00ff8ac8-6e4c-4f9d-ba83-80b0545f07d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:24.297466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff8ac8-6e4c-4f9d-ba83-80b0545f07d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:24.299201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff8ac8-6e4c-4f9d-ba83-80b0545f07d4 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:24.317919 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 715/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:25.179361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9cb04-6ba5-4b99-856f-54f751560692 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:25.179941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9cb04-6ba5-4b99-856f-54f751560692 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:25.179941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9cb04-6ba5-4b99-856f-54f751560692 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:25.181295 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 07:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:25.186242 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf0ab6-ef27-4a4f-a582-fc1a69f822a3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:25.186649 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf0ab6-ef27-4a4f-a582-fc1a69f822a3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:25.186791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf0ab6-ef27-4a4f-a582-fc1a69f822a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:25.206200 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:25.260754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1caf0ab6-ef27-4a4f-a582-fc1a69f822a3 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:25.261960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1caf0ab6-ef27-4a4f-a582-fc1a69f822a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:25.355566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 07:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 07:57:25.506039 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9cb04-6ba5-4b99-856f-54f751560692 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:25.507514 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-88e9cb04-6ba5-4b99-856f-54f751560692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:25.615794 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:25.652218 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9cb04-6ba5-4b99-856f-54f751560692 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:25.763658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbeffaa-2e70-4e9b-987e-1301fd25948d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:25.764234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeffaa-2e70-4e9b-987e-1301fd25948d service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:25.764515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeffaa-2e70-4e9b-987e-1301fd25948d service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:25.764785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeffaa-2e70-4e9b-987e-1301fd25948d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:25.766392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4cbeffaa-2e70-4e9b-987e-1301fd25948d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:25.843386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:25.856734 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbeffaa-2e70-4e9b-987e-1301fd25948d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:25.858385 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbeffaa-2e70-4e9b-987e-1301fd25948d service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:25.876083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 709/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:26.733026 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bb6a7-e11f-4ce3-ab7e-414efe1f962c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:26.733594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bb6a7-e11f-4ce3-ab7e-414efe1f962c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:26.733594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bb6a7-e11f-4ce3-ab7e-414efe1f962c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:26.734928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 07:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:26.739868 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5f7a-fd37-4f91-92c1-bbb3ef5d85f2 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:26.740859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5f7a-fd37-4f91-92c1-bbb3ef5d85f2 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:26.741005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5f7a-fd37-4f91-92c1-bbb3ef5d85f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:26.816841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-0b8d5f7a-fd37-4f91-92c1-bbb3ef5d85f2 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:26.818058 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0b8d5f7a-fd37-4f91-92c1-bbb3ef5d85f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:26.914389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 07:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:27.061828 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bb6a7-e11f-4ce3-ab7e-414efe1f962c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:27.063344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f46bb6a7-e11f-4ce3-ab7e-414efe1f962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:27.149136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:27.210504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bb6a7-e11f-4ce3-ab7e-414efe1f962c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:27.322460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3082-ca69-443f-9e9b-57b9046d0fdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:27.322994 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3082-ca69-443f-9e9b-57b9046d0fdb service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:27.323274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3082-ca69-443f-9e9b-57b9046d0fdb service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:27.323557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3082-ca69-443f-9e9b-57b9046d0fdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:27.325200 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e6dc3082-ca69-443f-9e9b-57b9046d0fdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:27.373335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:27.415003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc3082-ca69-443f-9e9b-57b9046d0fdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:27.416653 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc3082-ca69-443f-9e9b-57b9046d0fdb service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:27.434941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 718/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:28.247814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4cfdf-5d1e-4a23-b984-7216a3d155a9 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:28.248371 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4cfdf-5d1e-4a23-b984-7216a3d155a9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:28.248371 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4cfdf-5d1e-4a23-b984-7216a3d155a9 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:28.249732 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 07:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:28.254897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08330ebd-0d54-445e-9f29-5251952f5df9 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:28.255297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08330ebd-0d54-445e-9f29-5251952f5df9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:28.255438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08330ebd-0d54-445e-9f29-5251952f5df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:28.330523 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-08330ebd-0d54-445e-9f29-5251952f5df9 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:28.331759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-08330ebd-0d54-445e-9f29-5251952f5df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:28.425227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 07:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:28.580747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4cfdf-5d1e-4a23-b984-7216a3d155a9 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:28.582265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-76e4cfdf-5d1e-4a23-b984-7216a3d155a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:28.631906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:28.730119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4cfdf-5d1e-4a23-b984-7216a3d155a9 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:28.841754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee901c0d-74ff-4b2a-bb31-de873a582162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:28.842330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee901c0d-74ff-4b2a-bb31-de873a582162 service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:28.842607 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee901c0d-74ff-4b2a-bb31-de873a582162 service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:28.842878 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee901c0d-74ff-4b2a-bb31-de873a582162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:28.844509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ee901c0d-74ff-4b2a-bb31-de873a582162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:28.851847 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:28.935612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee901c0d-74ff-4b2a-bb31-de873a582162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:28.937238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee901c0d-74ff-4b2a-bb31-de873a582162 service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:28.955096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 712/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:29.752188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e246-32cf-479f-bd59-6e72fbfad480 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:29.752876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e246-32cf-479f-bd59-6e72fbfad480 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:29.752876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e246-32cf-479f-bd59-6e72fbfad480 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:29.754073 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 07:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:29.759095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bd5d7-caff-4fd5-95c0-21e98e98221c None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:29.759551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bd5d7-caff-4fd5-95c0-21e98e98221c None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:29.759776 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bd5d7-caff-4fd5-95c0-21e98e98221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:29.835934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-858bd5d7-caff-4fd5-95c0-21e98e98221c None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:29.837135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-858bd5d7-caff-4fd5-95c0-21e98e98221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:29.902942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:29.933257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 07:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:30.082141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6e246-32cf-479f-bd59-6e72fbfad480 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:30.083656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-17d6e246-32cf-479f-bd59-6e72fbfad480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:30.103111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:30.230159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6e246-32cf-479f-bd59-6e72fbfad480 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:30.318880 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:30.344228 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18a722-a318-43ad-8c88-fda62e7787b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:30.344832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18a722-a318-43ad-8c88-fda62e7787b9 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:30.345110 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18a722-a318-43ad-8c88-fda62e7787b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:30.345382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18a722-a318-43ad-8c88-fda62e7787b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:30.346981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5a18a722-a318-43ad-8c88-fda62e7787b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:30.435524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18a722-a318-43ad-8c88-fda62e7787b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:30.437158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18a722-a318-43ad-8c88-fda62e7787b9 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:30.455223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 721/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:31.262528 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ef755-4a8a-4a98-bc10-ebd55ad106d6 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:31.263096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ef755-4a8a-4a98-bc10-ebd55ad106d6 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:31.263096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ef755-4a8a-4a98-bc10-ebd55ad106d6 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:31.264481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 07:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:31.269372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268241f-a8a5-4e27-b496-f3afb2215fd2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:31.269814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268241f-a8a5-4e27-b496-f3afb2215fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:31.269919 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268241f-a8a5-4e27-b496-f3afb2215fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:31.344756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4268241f-a8a5-4e27-b496-f3afb2215fd2 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:31.345954 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4268241f-a8a5-4e27-b496-f3afb2215fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:31.385927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:31.439768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 07:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:31.589357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ef755-4a8a-4a98-bc10-ebd55ad106d6 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:31.590810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-cc6ef755-4a8a-4a98-bc10-ebd55ad106d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:31.742537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ef755-4a8a-4a98-bc10-ebd55ad106d6 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:31.797578 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:31.857905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197956a-7510-4de3-ae37-174bd1c6ca1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:31.858437 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197956a-7510-4de3-ae37-174bd1c6ca1f service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:31.858720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197956a-7510-4de3-ae37-174bd1c6ca1f service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:31.858994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197956a-7510-4de3-ae37-174bd1c6ca1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:31.860677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-9197956a-7510-4de3-ae37-174bd1c6ca1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:31.956525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197956a-7510-4de3-ae37-174bd1c6ca1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:31.958416 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197956a-7510-4de3-ae37-174bd1c6ca1f service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:31.977290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 715/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:32.783933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87d987-81f5-4187-bc6f-fc70817d4c49 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:32.784376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87d987-81f5-4187-bc6f-fc70817d4c49 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:32.784491 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87d987-81f5-4187-bc6f-fc70817d4c49 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:32.785839 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 07:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:32.791145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c2267-3712-4e9a-8ca8-a156a41be6f0 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:32.791542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c2267-3712-4e9a-8ca8-a156a41be6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:32.791699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c2267-3712-4e9a-8ca8-a156a41be6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:32.868143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-108c2267-3712-4e9a-8ca8-a156a41be6f0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:32.869360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-108c2267-3712-4e9a-8ca8-a156a41be6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:32.871596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:32.969575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 07:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:33.117971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87d987-81f5-4187-bc6f-fc70817d4c49 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:33.119439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8d87d987-81f5-4187-bc6f-fc70817d4c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:33.264344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87d987-81f5-4187-bc6f-fc70817d4c49 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:33.291874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:33.377988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6014478-df72-44d7-aed9-29b2534122bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:33.378505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6014478-df72-44d7-aed9-29b2534122bc service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:33.378785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6014478-df72-44d7-aed9-29b2534122bc service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:33.379053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6014478-df72-44d7-aed9-29b2534122bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:33.380689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a6014478-df72-44d7-aed9-29b2534122bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:33.470587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6014478-df72-44d7-aed9-29b2534122bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:33.472222 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6014478-df72-44d7-aed9-29b2534122bc service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:33.490090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 724/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:35.381978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12641550-680a-47ba-95a9-c827e0909b3c None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:35.382564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12641550-680a-47ba-95a9-c827e0909b3c None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:35.382564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12641550-680a-47ba-95a9-c827e0909b3c None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:35.383947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 07:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:35.389178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37884f12-c5f2-4954-8fc4-b0cad4d8a5f7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:35.389575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37884f12-c5f2-4954-8fc4-b0cad4d8a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:35.389736 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37884f12-c5f2-4954-8fc4-b0cad4d8a5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:35.429944 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:35.455904 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-37884f12-c5f2-4954-8fc4-b0cad4d8a5f7 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:35.457108 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-37884f12-c5f2-4954-8fc4-b0cad4d8a5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:35.552591 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 07:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:35.592841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12641550-680a-47ba-95a9-c827e0909b3c None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:35.594984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-12641550-680a-47ba-95a9-c827e0909b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:35.701572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12641550-680a-47ba-95a9-c827e0909b3c None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:35.733481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:35.775047 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072db4c0-ece8-4e08-8153-f63086a37f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:35.775657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db4c0-ece8-4e08-8153-f63086a37f1e service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:35.775976 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db4c0-ece8-4e08-8153-f63086a37f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:35.776251 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db4c0-ece8-4e08-8153-f63086a37f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:35.777901 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-072db4c0-ece8-4e08-8153-f63086a37f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:35.888086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072db4c0-ece8-4e08-8153-f63086a37f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:35.889526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072db4c0-ece8-4e08-8153-f63086a37f1e service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:35.908102 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 718/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:38.065619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10a48d-712b-4399-8685-c9beb74157c4 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:38.066173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10a48d-712b-4399-8685-c9beb74157c4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:38.066173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10a48d-712b-4399-8685-c9beb74157c4 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:38.067507 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 07:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:38.072754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536664bb-8299-4ab8-b62f-e5ed3c112680 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:38.073196 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536664bb-8299-4ab8-b62f-e5ed3c112680 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:38.073309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536664bb-8299-4ab8-b62f-e5ed3c112680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:38.140859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-536664bb-8299-4ab8-b62f-e5ed3c112680 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:38.142096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-536664bb-8299-4ab8-b62f-e5ed3c112680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:38.155298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:38.239296 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 07:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 07:57:38.277297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10a48d-712b-4399-8685-c9beb74157c4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:38.278863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6a10a48d-712b-4399-8685-c9beb74157c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:38.381171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10a48d-712b-4399-8685-c9beb74157c4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:38.393195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:38.462126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0299e2-cf43-4246-a07b-c3cd07f3db38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:38.462735 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0299e2-cf43-4246-a07b-c3cd07f3db38 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:38.463035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0299e2-cf43-4246-a07b-c3cd07f3db38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:38.463305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0299e2-cf43-4246-a07b-c3cd07f3db38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:38.464942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3e0299e2-cf43-4246-a07b-c3cd07f3db38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:38.573868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0299e2-cf43-4246-a07b-c3cd07f3db38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:38.575261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0299e2-cf43-4246-a07b-c3cd07f3db38 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:38.595097 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 727/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:40.913038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c61781-2348-40d3-9dd2-449d3dae53fd None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.913613 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c61781-2348-40d3-9dd2-449d3dae53fd None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.913613 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c61781-2348-40d3-9dd2-449d3dae53fd None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.914939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 07:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:40.920542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80f64b-0341-42a9-945b-adced070707e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.920982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80f64b-0341-42a9-945b-adced070707e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.921089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80f64b-0341-42a9-945b-adced070707e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.969080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:40.987525 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fa80f64b-0341-42a9-945b-adced070707e None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:40.988768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fa80f64b-0341-42a9-945b-adced070707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:41.082965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 07:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:41.122885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c61781-2348-40d3-9dd2-449d3dae53fd None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:41.124497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-63c61781-2348-40d3-9dd2-449d3dae53fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:41.227533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c61781-2348-40d3-9dd2-449d3dae53fd None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:41.276257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:41.310354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5e6db-5cc7-4395-869c-2d0635c26b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:41.310964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5e6db-5cc7-4395-869c-2d0635c26b93 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:41.311244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5e6db-5cc7-4395-869c-2d0635c26b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:41.311512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5e6db-5cc7-4395-869c-2d0635c26b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:41.313138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-96f5e6db-5cc7-4395-869c-2d0635c26b93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:41.420147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5e6db-5cc7-4395-869c-2d0635c26b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:41.421589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5e6db-5cc7-4395-869c-2d0635c26b93 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:41.441427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 721/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:43.566036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a1127-23c7-4999-ad59-5ce1599e923c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:43.566644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a1127-23c7-4999-ad59-5ce1599e923c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:43.566644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a1127-23c7-4999-ad59-5ce1599e923c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:43.567965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 07:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:43.574161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5eb12-d341-4712-87f5-82c11ce03d4c None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:43.574665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5eb12-d341-4712-87f5-82c11ce03d4c None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:43.574808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5eb12-d341-4712-87f5-82c11ce03d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:43.643624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-eef5eb12-d341-4712-87f5-82c11ce03d4c None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:43.644890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-eef5eb12-d341-4712-87f5-82c11ce03d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:43.668666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:43.754074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 07:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:43.793957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a1127-23c7-4999-ad59-5ce1599e923c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:43.795524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-927a1127-23c7-4999-ad59-5ce1599e923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:43.910913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a1127-23c7-4999-ad59-5ce1599e923c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:43.935170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:43.990717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da69049-818b-4aab-88a2-636efcfe930d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:43.991326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da69049-818b-4aab-88a2-636efcfe930d service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:43.991602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da69049-818b-4aab-88a2-636efcfe930d service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:43.991908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da69049-818b-4aab-88a2-636efcfe930d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:43.993544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1da69049-818b-4aab-88a2-636efcfe930d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:44.105835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da69049-818b-4aab-88a2-636efcfe930d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:44.107716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da69049-818b-4aab-88a2-636efcfe930d service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:44.128177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 730/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:46.194740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f1271-94a3-4fb3-98a7-1ac7ed0a0838 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:46.195267 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f1271-94a3-4fb3-98a7-1ac7ed0a0838 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:46.195406 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f1271-94a3-4fb3-98a7-1ac7ed0a0838 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:46.196694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 07:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:46.201996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55974c7d-09b5-4889-a344-d2ea79536a25 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:46.202414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55974c7d-09b5-4889-a344-d2ea79536a25 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:46.202548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55974c7d-09b5-4889-a344-d2ea79536a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:46.266689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:46.269364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-55974c7d-09b5-4889-a344-d2ea79536a25 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:46.271140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-55974c7d-09b5-4889-a344-d2ea79536a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:46.493455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 07:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:46.542175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f1271-94a3-4fb3-98a7-1ac7ed0a0838 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:46.543752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-de4f1271-94a3-4fb3-98a7-1ac7ed0a0838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:46.652967 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f1271-94a3-4fb3-98a7-1ac7ed0a0838 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:46.702626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:46.727237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2a17f-31c1-49fa-bd6c-70060abb7946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:46.727867 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a17f-31c1-49fa-bd6c-70060abb7946 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:46.728147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a17f-31c1-49fa-bd6c-70060abb7946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:46.728414 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a17f-31c1-49fa-bd6c-70060abb7946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:46.730006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8eb2a17f-31c1-49fa-bd6c-70060abb7946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:46.845936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2a17f-31c1-49fa-bd6c-70060abb7946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:46.847269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2a17f-31c1-49fa-bd6c-70060abb7946 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:46.865850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 724/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:49.026926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d231eec-f034-4296-a374-4c3f99e1f9d3 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:49.027481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d231eec-f034-4296-a374-4c3f99e1f9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:49.027481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d231eec-f034-4296-a374-4c3f99e1f9d3 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:49.028768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 07:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:49.033951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba394af3-632e-4ecc-8afa-96c6ccd1d881 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:49.034396 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba394af3-632e-4ecc-8afa-96c6ccd1d881 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:49.034543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba394af3-632e-4ecc-8afa-96c6ccd1d881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:49.101912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-ba394af3-632e-4ecc-8afa-96c6ccd1d881 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:49.103123 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ba394af3-632e-4ecc-8afa-96c6ccd1d881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:49.132318 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:49.200407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 07:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:49.238076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d231eec-f034-4296-a374-4c3f99e1f9d3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:49.239589 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1d231eec-f034-4296-a374-4c3f99e1f9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:49.341731 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d231eec-f034-4296-a374-4c3f99e1f9d3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:49.369440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:49.417333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10676148-f5c4-4b53-ac35-a4ae69dc6855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:49.417942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10676148-f5c4-4b53-ac35-a4ae69dc6855 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:49.418220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10676148-f5c4-4b53-ac35-a4ae69dc6855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:49.418490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10676148-f5c4-4b53-ac35-a4ae69dc6855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:49.420168 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-10676148-f5c4-4b53-ac35-a4ae69dc6855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:49.530262 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10676148-f5c4-4b53-ac35-a4ae69dc6855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:49.531686 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10676148-f5c4-4b53-ac35-a4ae69dc6855 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:49.549229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 733/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:51.612695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d3d29-6183-45c1-a008-33246a6b1c87 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:51.613236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d3d29-6183-45c1-a008-33246a6b1c87 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:51.613236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d3d29-6183-45c1-a008-33246a6b1c87 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:51.614611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 07:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:51.620572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46ee1-4279-4e56-a51a-bc2e067ed11d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:51.620975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46ee1-4279-4e56-a51a-bc2e067ed11d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:51.621126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46ee1-4279-4e56-a51a-bc2e067ed11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:51.686963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-64d46ee1-4279-4e56-a51a-bc2e067ed11d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:51.688193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-64d46ee1-4279-4e56-a51a-bc2e067ed11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:51.696418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:51.785166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 07:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 07:57:51.824541 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d3d29-6183-45c1-a008-33246a6b1c87 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:51.826099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e05d3d29-6183-45c1-a008-33246a6b1c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:51.930763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d3d29-6183-45c1-a008-33246a6b1c87 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:51.988629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:52.013578 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887b2af-ed30-4bf3-8cc4-6ccdc6d548ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:52.014178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887b2af-ed30-4bf3-8cc4-6ccdc6d548ca service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:52.014456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887b2af-ed30-4bf3-8cc4-6ccdc6d548ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:52.014729 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887b2af-ed30-4bf3-8cc4-6ccdc6d548ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:52.016347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b887b2af-ed30-4bf3-8cc4-6ccdc6d548ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:52.125870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887b2af-ed30-4bf3-8cc4-6ccdc6d548ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:52.127306 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887b2af-ed30-4bf3-8cc4-6ccdc6d548ca service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:52.146182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 727/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:54.211760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9e690-8dbe-47f0-94d1-f4950a9087db None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:54.212329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9e690-8dbe-47f0-94d1-f4950a9087db None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:54.212329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9e690-8dbe-47f0-94d1-f4950a9087db None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:54.213687 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 07:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:54.219456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffc110-f0d3-4aaa-8770-c9bf61275d89 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:54.219921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffc110-f0d3-4aaa-8770-c9bf61275d89 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:54.220043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffc110-f0d3-4aaa-8770-c9bf61275d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:54.291102 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d7ffc110-f0d3-4aaa-8770-c9bf61275d89 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:54.292391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d7ffc110-f0d3-4aaa-8770-c9bf61275d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:54.331853 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:54.392652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 07:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:54.431583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9e690-8dbe-47f0-94d1-f4950a9087db None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:54.433177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-15d9e690-8dbe-47f0-94d1-f4950a9087db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:54.540964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9e690-8dbe-47f0-94d1-f4950a9087db None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:54.579121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:54.616261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba21533-e457-4ee0-9158-29f70b58c648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:54.616993 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba21533-e457-4ee0-9158-29f70b58c648 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:54.617149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba21533-e457-4ee0-9158-29f70b58c648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:54.617425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba21533-e457-4ee0-9158-29f70b58c648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:54.619059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6ba21533-e457-4ee0-9158-29f70b58c648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:54.734329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba21533-e457-4ee0-9158-29f70b58c648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:54.735837 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba21533-e457-4ee0-9158-29f70b58c648 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:54.753797 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 736/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:57:56.817406 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856ac18-1885-46c6-915f-47854bda9115 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:56.818005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856ac18-1885-46c6-915f-47854bda9115 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:56.818113 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856ac18-1885-46c6-915f-47854bda9115 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:56.819502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 07:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:56.825375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4da16-ca35-4fd4-baf7-386da9b110e5 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:56.825856 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4da16-ca35-4fd4-baf7-386da9b110e5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:56.825966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4da16-ca35-4fd4-baf7-386da9b110e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:56.900009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6ae4da16-ca35-4fd4-baf7-386da9b110e5 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:56.901696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6ae4da16-ca35-4fd4-baf7-386da9b110e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:56.922338 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:57.000957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 07:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:57.042450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856ac18-1885-46c6-915f-47854bda9115 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:57.044080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0856ac18-1885-46c6-915f-47854bda9115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:57.153282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856ac18-1885-46c6-915f-47854bda9115 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:57.226479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:57.234017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71551f3-0881-49df-af3b-5b5c78f5503b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:57.234568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71551f3-0881-49df-af3b-5b5c78f5503b service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:57.234838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71551f3-0881-49df-af3b-5b5c78f5503b service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:57.235112 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71551f3-0881-49df-af3b-5b5c78f5503b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:57.236752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d71551f3-0881-49df-af3b-5b5c78f5503b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:57.346071 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71551f3-0881-49df-af3b-5b5c78f5503b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:57.347493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71551f3-0881-49df-af3b-5b5c78f5503b service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:57.366867 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 730/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 07:57:59.449396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1af5b-1386-4b70-bcc6-1493bd31d091 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:59.450569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1af5b-1386-4b70-bcc6-1493bd31d091 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:59.450569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1af5b-1386-4b70-bcc6-1493bd31d091 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:59.452457 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 07:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:59.457921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb9452-0af2-404c-ab65-2d42fb32b45b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:59.459158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb9452-0af2-404c-ab65-2d42fb32b45b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:59.459158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb9452-0af2-404c-ab65-2d42fb32b45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:59.525809 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-44cb9452-0af2-404c-ab65-2d42fb32b45b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:59.526956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-44cb9452-0af2-404c-ab65-2d42fb32b45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:59.578487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:59.628672 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 07:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:57:59.665452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1af5b-1386-4b70-bcc6-1493bd31d091 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:59.667042 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b0f1af5b-1386-4b70-bcc6-1493bd31d091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:59.774458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1af5b-1386-4b70-bcc6-1493bd31d091 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:59.822492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:59.851463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6df40-de13-4b06-a449-c04c257758ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:59.852099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6df40-de13-4b06-a449-c04c257758ca service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:59.852377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6df40-de13-4b06-a449-c04c257758ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:59.852651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6df40-de13-4b06-a449-c04c257758ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:59.854257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8ff6df40-de13-4b06-a449-c04c257758ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:59.964483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6df40-de13-4b06-a449-c04c257758ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:59.966002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6df40-de13-4b06-a449-c04c257758ca service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:59.984409 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 739/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:58:09.626888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=22 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:09.982202 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=66 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:19.667873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea576750-4994-4cc5-a8ee-89ebd14a3b12 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:19.668402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea576750-4994-4cc5-a8ee-89ebd14a3b12 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:19.668402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea576750-4994-4cc5-a8ee-89ebd14a3b12 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:19.669732 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 732/1471] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:19.675220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991c464-70e0-4286-a294-eee2db1e5ac8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:19.675910 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991c464-70e0-4286-a294-eee2db1e5ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:19.676060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991c464-70e0-4286-a294-eee2db1e5ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:19.761761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d991c464-70e0-4286-a294-eee2db1e5ac8 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:19.763017 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d991c464-70e0-4286-a294-eee2db1e5ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:19.859870 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 740/1472] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 07:58:19.947247 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f38583-e7e1-4b82-9d4b-e1711c7df6e5 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:19.947527 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f38583-e7e1-4b82-9d4b-e1711c7df6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:19.947835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f38583-e7e1-4b82-9d4b-e1711c7df6e5 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:19.949213 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 733/1473] 10.222.0.30 () {54 vars in 967 bytes} [Wed Aug 10 07:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:19.954057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ed0c2-d35d-4cd4-9997-35c5cc7efcb4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:19.954346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ed0c2-d35d-4cd4-9997-35c5cc7efcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:19.954621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ed0c2-d35d-4cd4-9997-35c5cc7efcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:20.042723 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9f1ed0c2-d35d-4cd4-9997-35c5cc7efcb4 None None] MFA Rules not processed for user `553916344aaf40ae8abb050540f10559`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:20.043972 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9f1ed0c2-d35d-4cd4-9997-35c5cc7efcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:20.071294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:20.130930 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 741/1474] 10.222.0.30 () {58 vars in 1064 bytes} [Wed Aug 10 07:58:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:58:20.139223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f38583-e7e1-4b82-9d4b-e1711c7df6e5 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:20.140854 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-86f38583-e7e1-4b82-9d4b-e1711c7df6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:20.245503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f38583-e7e1-4b82-9d4b-e1711c7df6e5 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:20.321135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d8668-96d3-483d-8167-884a7c2b25b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553916344aaf40ae8abb050540f10559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:20.321756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d8668-96d3-483d-8167-884a7c2b25b2 service glance] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:20.322041 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d8668-96d3-483d-8167-884a7c2b25b2 service glance] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:20.322322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d8668-96d3-483d-8167-884a7c2b25b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:20.324013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-578d8668-96d3-483d-8167-884a7c2b25b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:20.408614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:20.465645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d8668-96d3-483d-8167-884a7c2b25b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:20.467186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d8668-96d3-483d-8167-884a7c2b25b2 service glance] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:20.486653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 734/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:58:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:58:22.620194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d197f-c8b0-4663-8006-229d3915f25c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.620758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d197f-c8b0-4663-8006-229d3915f25c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.620758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d197f-c8b0-4663-8006-229d3915f25c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.622095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 742/1476] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:22.627354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32d6b0-d64d-4d62-a1e4-10f2724ea9a8 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.627809 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32d6b0-d64d-4d62-a1e4-10f2724ea9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.627920 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32d6b0-d64d-4d62-a1e4-10f2724ea9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.694195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-8b32d6b0-d64d-4d62-a1e4-10f2724ea9a8 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:22.695410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8b32d6b0-d64d-4d62-a1e4-10f2724ea9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:22.793677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 735/1477] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 07:58:22.818415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d197f-c8b0-4663-8006-229d3915f25c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:22.819996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-983d197f-c8b0-4663-8006-229d3915f25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:22.952891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d197f-c8b0-4663-8006-229d3915f25c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:23.001727 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:23.046202 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02997fc5-b4db-4442-a8cb-f82eed67d38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:23.046808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02997fc5-b4db-4442-a8cb-f82eed67d38f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:23.047086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02997fc5-b4db-4442-a8cb-f82eed67d38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:23.047357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02997fc5-b4db-4442-a8cb-f82eed67d38f admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:23.048021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02997fc5-b4db-4442-a8cb-f82eed67d38f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:23.049770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-02997fc5-b4db-4442-a8cb-f82eed67d38f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 07:58:23.049770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Aug 10 07:58:23.049770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: Aug 10 07:58:23.051144 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02997fc5-b4db-4442-a8cb-f82eed67d38f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:23.070052 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 743/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:22 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:58:25.167287 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476b9e9-3781-4642-b33c-38d5f78a4964 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.167967 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476b9e9-3781-4642-b33c-38d5f78a4964 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.168078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476b9e9-3781-4642-b33c-38d5f78a4964 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.169442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 736/1479] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:25.175262 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126029f-a341-4e4a-bc26-7327a914ec04 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.175998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126029f-a341-4e4a-bc26-7327a914ec04 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.176130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126029f-a341-4e4a-bc26-7327a914ec04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.240575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c126029f-a341-4e4a-bc26-7327a914ec04 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:25.241776 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c126029f-a341-4e4a-bc26-7327a914ec04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:25.336545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 744/1480] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:58:25.379392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476b9e9-3781-4642-b33c-38d5f78a4964 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:25.381630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6476b9e9-3781-4642-b33c-38d5f78a4964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:25.391659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:25.529016 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476b9e9-3781-4642-b33c-38d5f78a4964 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:25.607125 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:25.640701 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e735ba-9554-4629-87da-2bba0aaa5baf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:25.641400 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e735ba-9554-4629-87da-2bba0aaa5baf service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.641685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e735ba-9554-4629-87da-2bba0aaa5baf service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.641966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e735ba-9554-4629-87da-2bba0aaa5baf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.643577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-41e735ba-9554-4629-87da-2bba0aaa5baf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:25.733097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e735ba-9554-4629-87da-2bba0aaa5baf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:25.734700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e735ba-9554-4629-87da-2bba0aaa5baf service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:25.753017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 737/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:58:27.926800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9dba7-40ac-4005-a397-4ff9508c46ed None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.927794 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9dba7-40ac-4005-a397-4ff9508c46ed None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.927913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9dba7-40ac-4005-a397-4ff9508c46ed None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:27.929257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 745/1482] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:27.934321 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056151e7-59d4-4321-84b4-eb72ed24cc55 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.934755 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056151e7-59d4-4321-84b4-eb72ed24cc55 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.934860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056151e7-59d4-4321-84b4-eb72ed24cc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.000693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-056151e7-59d4-4321-84b4-eb72ed24cc55 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:28.001904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-056151e7-59d4-4321-84b4-eb72ed24cc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:28.049243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:28.100570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 738/1483] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:58:28.137344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9dba7-40ac-4005-a397-4ff9508c46ed None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:28.138879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4bd9dba7-40ac-4005-a397-4ff9508c46ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:28.164086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:28.244999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9dba7-40ac-4005-a397-4ff9508c46ed None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:28.317841 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b163b9f-d275-42e3-a4b4-2128f8883364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:28.318441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163b9f-d275-42e3-a4b4-2128f8883364 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:28.318720 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163b9f-d275-42e3-a4b4-2128f8883364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:28.318986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163b9f-d275-42e3-a4b4-2128f8883364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.320685 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4b163b9f-d275-42e3-a4b4-2128f8883364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:28.393990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:28.429640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b163b9f-d275-42e3-a4b4-2128f8883364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:28.431173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b163b9f-d275-42e3-a4b4-2128f8883364 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:28.449131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 746/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:58:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:58:30.514004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450739-9f9f-4753-86be-3d6092b41f37 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:30.514469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450739-9f9f-4753-86be-3d6092b41f37 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:30.514659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450739-9f9f-4753-86be-3d6092b41f37 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:30.516587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 739/1485] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:30.522249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed79e0-ecd4-438e-9573-9220fd4d5ae4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:30.522712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed79e0-ecd4-438e-9573-9220fd4d5ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:30.522817 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed79e0-ecd4-438e-9573-9220fd4d5ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:30.587904 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-32ed79e0-ecd4-438e-9573-9220fd4d5ae4 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:30.589118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-32ed79e0-ecd4-438e-9573-9220fd4d5ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:30.684687 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 747/1486] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:58:30.723184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f450739-9f9f-4753-86be-3d6092b41f37 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:30.725377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1f450739-9f9f-4753-86be-3d6092b41f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:30.828553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f450739-9f9f-4753-86be-3d6092b41f37 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:30.901108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:30.903349 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ad034-0794-4318-9f31-4bb6e76bbcca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:30.904199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad034-0794-4318-9f31-4bb6e76bbcca service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:30.904655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad034-0794-4318-9f31-4bb6e76bbcca service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:30.905119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad034-0794-4318-9f31-4bb6e76bbcca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:30.906741 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-dc8ad034-0794-4318-9f31-4bb6e76bbcca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:31.015910 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ad034-0794-4318-9f31-4bb6e76bbcca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:31.017334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ad034-0794-4318-9f31-4bb6e76bbcca service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:31.035963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 740/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:58:33.218887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d781445-6dba-4069-b01c-c1bc2f7ff79e None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:33.219473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d781445-6dba-4069-b01c-c1bc2f7ff79e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:33.219473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d781445-6dba-4069-b01c-c1bc2f7ff79e None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:33.220794 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 748/1488] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:33.226021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32176855-89c0-4775-a9b9-daee47ca0450 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:33.226438 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32176855-89c0-4775-a9b9-daee47ca0450 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:33.226675 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32176855-89c0-4775-a9b9-daee47ca0450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:33.295143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-32176855-89c0-4775-a9b9-daee47ca0450 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:33.296389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-32176855-89c0-4775-a9b9-daee47ca0450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:33.351128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:33.395313 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 741/1489] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:58:33.436090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d781445-6dba-4069-b01c-c1bc2f7ff79e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:33.437619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6d781445-6dba-4069-b01c-c1bc2f7ff79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:33.472644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:33.548246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d781445-6dba-4069-b01c-c1bc2f7ff79e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:33.630565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185e8ce-23a3-4ce1-a9e8-4f06a7cfca7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:33.631179 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185e8ce-23a3-4ce1-a9e8-4f06a7cfca7c service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:33.631455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185e8ce-23a3-4ce1-a9e8-4f06a7cfca7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:33.631740 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185e8ce-23a3-4ce1-a9e8-4f06a7cfca7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:33.633357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d185e8ce-23a3-4ce1-a9e8-4f06a7cfca7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:33.714554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:33.744149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185e8ce-23a3-4ce1-a9e8-4f06a7cfca7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:33.745522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185e8ce-23a3-4ce1-a9e8-4f06a7cfca7c service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:33.766503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 749/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:58:36.149074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ab219-d123-495c-80ad-71a605e33ba1 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:36.149528 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ab219-d123-495c-80ad-71a605e33ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:36.149636 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ab219-d123-495c-80ad-71a605e33ba1 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:36.150976 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 742/1491] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 10 07:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:36.156162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a720f6-a356-4b8f-91d2-c119e23cfc86 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:36.156582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a720f6-a356-4b8f-91d2-c119e23cfc86 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:36.156787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a720f6-a356-4b8f-91d2-c119e23cfc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:36.225243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-34a720f6-a356-4b8f-91d2-c119e23cfc86 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:36.226706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-34a720f6-a356-4b8f-91d2-c119e23cfc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:36.335066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 750/1492] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:58:36.373376 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ab219-d123-495c-80ad-71a605e33ba1 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:36.374977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-743ab219-d123-495c-80ad-71a605e33ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:36.485174 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ab219-d123-495c-80ad-71a605e33ba1 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:36.558203 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460b72f-c5ab-4557-917a-5a704ffbce66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:36.558803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460b72f-c5ab-4557-917a-5a704ffbce66 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:36.559084 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460b72f-c5ab-4557-917a-5a704ffbce66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:36.559355 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460b72f-c5ab-4557-917a-5a704ffbce66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:36.560979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-c460b72f-c5ab-4557-917a-5a704ffbce66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:36.570484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:36.670807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460b72f-c5ab-4557-917a-5a704ffbce66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:36.672289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460b72f-c5ab-4557-917a-5a704ffbce66 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:36.691439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 743/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:58:46.332599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=82 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:46.689199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=50 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:54.396229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270bb82-1951-4bc8-911b-5b3dbc992784 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:54.396851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270bb82-1951-4bc8-911b-5b3dbc992784 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:54.396851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270bb82-1951-4bc8-911b-5b3dbc992784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:54.473331 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e270bb82-1951-4bc8-911b-5b3dbc992784 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:54.474481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e270bb82-1951-4bc8-911b-5b3dbc992784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:54.570697 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 751/1494] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 07:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:59:54.578840 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6856e-7528-4d53-ad81-41f3ef975bae None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:54.579353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6856e-7528-4d53-ad81-41f3ef975bae None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:54.579459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6856e-7528-4d53-ad81-41f3ef975bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:54.654598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-faa6856e-7528-4d53-ad81-41f3ef975bae None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:54.655838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-faa6856e-7528-4d53-ad81-41f3ef975bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:54.754767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 744/1495] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 07:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 07:59:54.759382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270bb82-1951-4bc8-911b-5b3dbc992784 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:54.760621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e270bb82-1951-4bc8-911b-5b3dbc992784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:54.773074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270bb82-1951-4bc8-911b-5b3dbc992784 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:54.837276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:54.871255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacca5e-b71e-4aa0-a534-aff935f1b509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:54.871898 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacca5e-b71e-4aa0-a534-aff935f1b509 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:54.872181 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacca5e-b71e-4aa0-a534-aff935f1b509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:54.872451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacca5e-b71e-4aa0-a534-aff935f1b509 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:54.873095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacca5e-b71e-4aa0-a534-aff935f1b509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:54.873393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacca5e-b71e-4aa0-a534-aff935f1b509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:54.874409 dv-cinder-781032-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-9dacca5e-b71e-4aa0-a534-aff935f1b509 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 07:59:54.874409 dv-cinder-781032-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Aug 10 07:59:54.874409 dv-cinder-781032-4-smb devstack@keystone.service[80194]: Aug 10 07:59:54.875293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacca5e-b71e-4aa0-a534-aff935f1b509 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:54.886364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 752/1496] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 07:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:54.895349 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6856e-7528-4d53-ad81-41f3ef975bae None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:54.904604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6856e-7528-4d53-ad81-41f3ef975bae None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:54.966611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:55.001815 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7612d38-a98b-4f36-bbc1-7068c1be42d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:55.002423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7612d38-a98b-4f36-bbc1-7068c1be42d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:55.002706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7612d38-a98b-4f36-bbc1-7068c1be42d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:55.002982 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7612d38-a98b-4f36-bbc1-7068c1be42d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:55.004124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7612d38-a98b-4f36-bbc1-7068c1be42d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:55.005897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: WARNING py.warnings [None req-c7612d38-a98b-4f36-bbc1-7068c1be42d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 07:59:55.005897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: warnings.warn(msg) Aug 10 07:59:55.005897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: Aug 10 07:59:55.007066 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7612d38-a98b-4f36-bbc1-7068c1be42d0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:55.064756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 745/1497] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 07:59:54 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:59:55.069856 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacca5e-b71e-4aa0-a534-aff935f1b509 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:55.071377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9dacca5e-b71e-4aa0-a534-aff935f1b509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:55.104500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacca5e-b71e-4aa0-a534-aff935f1b509 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:55.200223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ce788-ce2b-4f64-ae14-9a01cc4dfe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:55.200835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ce788-ce2b-4f64-ae14-9a01cc4dfe80 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:55.201117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ce788-ce2b-4f64-ae14-9a01cc4dfe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:55.201392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ce788-ce2b-4f64-ae14-9a01cc4dfe80 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:55.202007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ce788-ce2b-4f64-ae14-9a01cc4dfe80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:55.203032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-939ce788-ce2b-4f64-ae14-9a01cc4dfe80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 07:59:55.203032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Aug 10 07:59:55.203032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: Aug 10 07:59:55.204257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ce788-ce2b-4f64-ae14-9a01cc4dfe80 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:55.246481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 753/1498] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 07:59:55 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:59:55.250665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7612d38-a98b-4f36-bbc1-7068c1be42d0 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:55.252219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-c7612d38-a98b-4f36-bbc1-7068c1be42d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:55.313530 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7612d38-a98b-4f36-bbc1-7068c1be42d0 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:55.397501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:55.409088 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69d2da-7354-42ce-b9bf-0dd5a841f388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:55.409682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69d2da-7354-42ce-b9bf-0dd5a841f388 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:55.409967 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69d2da-7354-42ce-b9bf-0dd5a841f388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:55.410234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69d2da-7354-42ce-b9bf-0dd5a841f388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:55.410871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69d2da-7354-42ce-b9bf-0dd5a841f388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:55.411911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: WARNING py.warnings [None req-2d69d2da-7354-42ce-b9bf-0dd5a841f388 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 07:59:55.411911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: warnings.warn(msg) Aug 10 07:59:55.411911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: Aug 10 07:59:55.412785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69d2da-7354-42ce-b9bf-0dd5a841f388 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:55.424894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 746/1499] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 07:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:59:55.430586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ce788-ce2b-4f64-ae14-9a01cc4dfe80 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:55.432587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-939ce788-ce2b-4f64-ae14-9a01cc4dfe80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:55.445607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ce788-ce2b-4f64-ae14-9a01cc4dfe80 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:55.471917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:55.543342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3e171-a593-409b-acac-e876f041c62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:55.543973 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3e171-a593-409b-acac-e876f041c62f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:55.544259 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3e171-a593-409b-acac-e876f041c62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:55.544562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3e171-a593-409b-acac-e876f041c62f admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:55.545203 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3e171-a593-409b-acac-e876f041c62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:55.546226 dv-cinder-781032-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-94a3e171-a593-409b-acac-e876f041c62f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 07:59:55.546226 dv-cinder-781032-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Aug 10 07:59:55.546226 dv-cinder-781032-4-smb devstack@keystone.service[80194]: Aug 10 07:59:55.547155 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3e171-a593-409b-acac-e876f041c62f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:55.560183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 754/1500] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 07:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:59:55.564535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69d2da-7354-42ce-b9bf-0dd5a841f388 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:55.566101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2d69d2da-7354-42ce-b9bf-0dd5a841f388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:55.603527 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69d2da-7354-42ce-b9bf-0dd5a841f388 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:55.700380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df260edf-3aae-46ca-9f41-254c863e43ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:55.701039 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df260edf-3aae-46ca-9f41-254c863e43ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:55.701320 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df260edf-3aae-46ca-9f41-254c863e43ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:55.701594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df260edf-3aae-46ca-9f41-254c863e43ce admin admin] PATH_INFO: `/v3/projects/d297456296cc486184050229334ebe08/users/5e229d3ee2ba4a15af6cabc6d6400d2b/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:55.724073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df260edf-3aae-46ca-9f41-254c863e43ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d297456296cc486184050229334ebe08, user_id=5e229d3ee2ba4a15af6cabc6d6400d2b, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:55.725099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: WARNING py.warnings [None req-df260edf-3aae-46ca-9f41-254c863e43ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 07:59:55.725099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: warnings.warn(msg) Aug 10 07:59:55.725099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: Aug 10 07:59:55.727079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df260edf-3aae-46ca-9f41-254c863e43ce admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:55.751767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 747/1501] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 07:59:55 2022] PUT /identity/v3/projects/d297456296cc486184050229334ebe08/users/5e229d3ee2ba4a15af6cabc6d6400d2b/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:59:55.764678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e936280-0cbd-4b93-aaaf-4b059fa7e3dd None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:55.764968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e936280-0cbd-4b93-aaaf-4b059fa7e3dd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:55.765243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e936280-0cbd-4b93-aaaf-4b059fa7e3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:55.823135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9e936280-0cbd-4b93-aaaf-4b059fa7e3dd None None] MFA Rules not processed for user `5e229d3ee2ba4a15af6cabc6d6400d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:55.824293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9e936280-0cbd-4b93-aaaf-4b059fa7e3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:55.902212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 755/1502] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 07:59:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:59:55.916346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cdba4-d4d7-44a9-985d-1b2c80bf33f0 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:55.916592 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cdba4-d4d7-44a9-985d-1b2c80bf33f0 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:55.916865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cdba4-d4d7-44a9-985d-1b2c80bf33f0 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:55.918214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 748/1503] 10.222.0.30 () {54 vars in 964 bytes} [Wed Aug 10 07:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:55.923130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a6e76-9b1b-4fb1-9408-3f341adae270 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:55.923421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a6e76-9b1b-4fb1-9408-3f341adae270 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:55.923703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a6e76-9b1b-4fb1-9408-3f341adae270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:55.955432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:56.001026 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-691a6e76-9b1b-4fb1-9408-3f341adae270 None None] MFA Rules not processed for user `ab0470979f1643a390c667efc55c4069`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:56.002250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-691a6e76-9b1b-4fb1-9408-3f341adae270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:56.079684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 756/1504] 10.222.0.30 () {58 vars in 1061 bytes} [Wed Aug 10 07:59:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:59:56.087435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cdba4-d4d7-44a9-985d-1b2c80bf33f0 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:56.089030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8a0cdba4-d4d7-44a9-985d-1b2c80bf33f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:56.140892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:56.213347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cdba4-d4d7-44a9-985d-1b2c80bf33f0 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:56.286688 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedf1a1-cd68-40fd-915e-8ba26045b7bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:56.287294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedf1a1-cd68-40fd-915e-8ba26045b7bc service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:56.287573 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedf1a1-cd68-40fd-915e-8ba26045b7bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:56.287877 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedf1a1-cd68-40fd-915e-8ba26045b7bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:56.289471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ceedf1a1-cd68-40fd-915e-8ba26045b7bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:56.386679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedf1a1-cd68-40fd-915e-8ba26045b7bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:56.388042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedf1a1-cd68-40fd-915e-8ba26045b7bc service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:56.391471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:56.406956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 749/1505] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:59:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:59:56.452268 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6e52b-a8d9-4a02-9f3b-0d66d3422b2b None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:56.452698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6e52b-a8d9-4a02-9f3b-0d66d3422b2b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:56.452864 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6e52b-a8d9-4a02-9f3b-0d66d3422b2b None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:56.454126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 757/1506] 10.222.0.30 () {52 vars in 830 bytes} [Wed Aug 10 07:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:56.458335 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedf1a1-cd68-40fd-915e-8ba26045b7bc service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:56.459546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ceedf1a1-cd68-40fd-915e-8ba26045b7bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:56.558661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedf1a1-cd68-40fd-915e-8ba26045b7bc service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:56.652851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:56.653517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:56.653671 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:56.653946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] PATH_INFO: `/v3/users/5e229d3ee2ba4a15af6cabc6d6400d2b` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:56.666315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e229d3ee2ba4a15af6cabc6d6400d2b)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:56.667348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: WARNING py.warnings [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 07:59:56.667348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: warnings.warn(msg) Aug 10 07:59:56.667348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: Aug 10 07:59:56.669026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:56.679012 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:56.738039 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e229d3ee2ba4a15af6cabc6d6400d2b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 07:59:56.747836 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e229d3ee2ba4a15af6cabc6d6400d2b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 07:59:56.748358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e229d3ee2ba4a15af6cabc6d6400d2b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 07:59:56.748790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e229d3ee2ba4a15af6cabc6d6400d2b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 07:59:56.772549 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e229d3ee2ba4a15af6cabc6d6400d2b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 07:59:56.790980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 750/1507] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 07:59:56 2022] DELETE /identity/v3/users/5e229d3ee2ba4a15af6cabc6d6400d2b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:59:56.795347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bc442-864e-4a7b-95c1-43c19c147024 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:56.795628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bc442-864e-4a7b-95c1-43c19c147024 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:56.795930 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bc442-864e-4a7b-95c1-43c19c147024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:56.853879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-717bc442-864e-4a7b-95c1-43c19c147024 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:56.855076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-717bc442-864e-4a7b-95c1-43c19c147024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:56.931492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:56.943557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 758/1508] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 07:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 07:59:56.953357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:56.954573 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:57.059128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741ddec-9ac2-4af5-882c-f69747a37cdf admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:57.117117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:57.137890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc90cf-8d64-4584-98c7-8c89ad3af3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:57.138501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc90cf-8d64-4584-98c7-8c89ad3af3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:57.138811 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc90cf-8d64-4584-98c7-8c89ad3af3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:57.139085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc90cf-8d64-4584-98c7-8c89ad3af3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:57.140735 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d5fc90cf-8d64-4584-98c7-8c89ad3af3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:57.249596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc90cf-8d64-4584-98c7-8c89ad3af3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:57.251025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc90cf-8d64-4584-98c7-8c89ad3af3c4 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:57.270391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 751/1509] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 07:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 07:59:57.635202 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bc442-864e-4a7b-95c1-43c19c147024 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:57.636717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-717bc442-864e-4a7b-95c1-43c19c147024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:57.649471 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bc442-864e-4a7b-95c1-43c19c147024 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:57.751931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:57.752562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:57.752839 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:57.753165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0 admin admin] PATH_INFO: `/v3/projects/d297456296cc486184050229334ebe08` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:57.765399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d297456296cc486184050229334ebe08)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:57.766718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 07:59:57.766718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Aug 10 07:59:57.766718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: Aug 10 07:59:57.768519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:57.846751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd297456296cc486184050229334ebe08', 'request_id': 'req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 07:59:57.853967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd297456296cc486184050229334ebe08', 'request_id': 'req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 07:59:57.869846 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd297456296cc486184050229334ebe08', 'request_id': 'req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 07:59:57.900951 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0 admin admin] The token cache is being invalidate because project d297456296cc486184050229334ebe08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 07:59:57.901241 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 07:59:57.901775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd151c8b-4e74-4458-bb11-c2ff8aede0b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 07:59:57.903771 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 759/1510] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 07:59:57 2022] DELETE /identity/v3/projects/d297456296cc486184050229334ebe08 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:00:07.267539 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=62 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:07.898494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:33.245817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e76573-ac2b-48a6-844f-66be2e8552d8 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:33.246417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e76573-ac2b-48a6-844f-66be2e8552d8 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:33.246417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e76573-ac2b-48a6-844f-66be2e8552d8 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:33.247782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:33.252985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6209170-d183-452f-9232-e907f6840379 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:33.253388 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6209170-d183-452f-9232-e907f6840379 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:33.253532 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6209170-d183-452f-9232-e907f6840379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:33.334410 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e6209170-d183-452f-9232-e907f6840379 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:33.335628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e6209170-d183-452f-9232-e907f6840379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:33.437814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:01:33.591250 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e76573-ac2b-48a6-844f-66be2e8552d8 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:33.593439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-34e76573-ac2b-48a6-844f-66be2e8552d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:33.714177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e76573-ac2b-48a6-844f-66be2e8552d8 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:33.720604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18423509-b675-426e-b262-a1858acfd266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:33.721206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18423509-b675-426e-b262-a1858acfd266 service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:33.721487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18423509-b675-426e-b262-a1858acfd266 service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:33.721757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18423509-b675-426e-b262-a1858acfd266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:33.730374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18423509-b675-426e-b262-a1858acfd266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:33.732058 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18423509-b675-426e-b262-a1858acfd266 service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:33.742467 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 753/1513] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:01:34.583805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9576-cbc2-4f05-877f-693ad4587f8f None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:34.584378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9576-cbc2-4f05-877f-693ad4587f8f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:34.584378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9576-cbc2-4f05-877f-693ad4587f8f None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:34.585699 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:34.590627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa84a8b-2368-43b2-86c6-58de1fd79fa9 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:34.591061 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa84a8b-2368-43b2-86c6-58de1fd79fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:34.591177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa84a8b-2368-43b2-86c6-58de1fd79fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:34.610651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-bfa84a8b-2368-43b2-86c6-58de1fd79fa9 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:34.611895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-bfa84a8b-2368-43b2-86c6-58de1fd79fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:34.619858 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:01:34.771513 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab9576-cbc2-4f05-877f-693ad4587f8f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:34.786122 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab9576-cbc2-4f05-877f-693ad4587f8f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:34.791629 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7453299-9b50-44e0-8bcd-f37e61bad1ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:34.792562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7453299-9b50-44e0-8bcd-f37e61bad1ec service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:34.792847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7453299-9b50-44e0-8bcd-f37e61bad1ec service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:34.793117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7453299-9b50-44e0-8bcd-f37e61bad1ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:34.801372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7453299-9b50-44e0-8bcd-f37e61bad1ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:34.803207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7453299-9b50-44e0-8bcd-f37e61bad1ec service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:34.812434 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 762/1516] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:01:34.984596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c87cd9-7b37-4d05-a587-e556afb4bd29 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:34.985018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c87cd9-7b37-4d05-a587-e556afb4bd29 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:34.985474 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c87cd9-7b37-4d05-a587-e556afb4bd29 None None] PATH_INFO: `/v3` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:34.986817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 755/1517] 10.222.0.20 () {54 vars in 925 bytes} [Wed Aug 10 08:01:34 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:34.992763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdb926-c0dd-4dce-bdd1-1dae17cae62d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:34.993057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdb926-c0dd-4dce-bdd1-1dae17cae62d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:34.993337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdb926-c0dd-4dce-bdd1-1dae17cae62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:35.051484 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-10cdb926-c0dd-4dce-bdd1-1dae17cae62d None None] MFA Rules not processed for user `ccab7239a2474aa093e685d5da97f1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:35.052984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-10cdb926-c0dd-4dce-bdd1-1dae17cae62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:35.069744 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:35.123509 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 763/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Aug 10 08:01:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:01:38.882726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640dd49-932a-4879-8a89-2e22d2767f26 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:38.883199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640dd49-932a-4879-8a89-2e22d2767f26 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:38.883284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640dd49-932a-4879-8a89-2e22d2767f26 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:38.884624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 756/1519] 10.222.0.30 () {54 vars in 961 bytes} [Wed Aug 10 08:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:01:38.889804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7612b4c-9634-4760-bec6-616fd866b582 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:38.890228 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7612b4c-9634-4760-bec6-616fd866b582 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:38.890362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7612b4c-9634-4760-bec6-616fd866b582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:38.909507 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b7612b4c-9634-4760-bec6-616fd866b582 None None] MFA Rules not processed for user `ccab7239a2474aa093e685d5da97f1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:38.910703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b7612b4c-9634-4760-bec6-616fd866b582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:38.919316 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 764/1520] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Aug 10 08:01:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:01:38.927697 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640dd49-932a-4879-8a89-2e22d2767f26 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:38.942318 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640dd49-932a-4879-8a89-2e22d2767f26 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:38.947321 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d39160-4903-40c9-9460-ca5c48eab47a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccab7239a2474aa093e685d5da97f1a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:38.947976 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d39160-4903-40c9-9460-ca5c48eab47a service placement] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:38.948265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d39160-4903-40c9-9460-ca5c48eab47a service placement] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:38.948544 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d39160-4903-40c9-9460-ca5c48eab47a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:38.956651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d39160-4903-40c9-9460-ca5c48eab47a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:38.958216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d39160-4903-40c9-9460-ca5c48eab47a service placement] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:38.969210 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 757/1521] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:01:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:01:46.037834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a647b2-f439-4df8-8fb3-432bb1dc6a42 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:46.038410 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a647b2-f439-4df8-8fb3-432bb1dc6a42 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:46.038410 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a647b2-f439-4df8-8fb3-432bb1dc6a42 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:46.039817 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:46.044558 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21dce1-b5d3-4c45-97b4-e101ac995f5d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:46.045005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21dce1-b5d3-4c45-97b4-e101ac995f5d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:46.045124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21dce1-b5d3-4c45-97b4-e101ac995f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:46.065675 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-7d21dce1-b5d3-4c45-97b4-e101ac995f5d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:46.066900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7d21dce1-b5d3-4c45-97b4-e101ac995f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:46.074805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:01:46.226858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a647b2-f439-4df8-8fb3-432bb1dc6a42 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:46.241517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a647b2-f439-4df8-8fb3-432bb1dc6a42 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:46.247170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f56daa-bd80-4908-9355-b4677f40cbf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:46.247796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f56daa-bd80-4908-9355-b4677f40cbf9 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:46.248081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f56daa-bd80-4908-9355-b4677f40cbf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:46.248353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f56daa-bd80-4908-9355-b4677f40cbf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:46.257199 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f56daa-bd80-4908-9355-b4677f40cbf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:46.258779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f56daa-bd80-4908-9355-b4677f40cbf9 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:46.268668 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 766/1524] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:01:47.100006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd832f-008c-4b57-a91a-7b2a0fdbe80c None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:47.100666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd832f-008c-4b57-a91a-7b2a0fdbe80c None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:47.100666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd832f-008c-4b57-a91a-7b2a0fdbe80c None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:47.101944 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:47.106636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124c10d-5801-453f-81e0-32c33fdd59ed None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:47.107105 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124c10d-5801-453f-81e0-32c33fdd59ed None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:47.107263 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124c10d-5801-453f-81e0-32c33fdd59ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:47.128660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c124c10d-5801-453f-81e0-32c33fdd59ed None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:47.129865 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c124c10d-5801-453f-81e0-32c33fdd59ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:47.137714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:01:47.288590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd832f-008c-4b57-a91a-7b2a0fdbe80c None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:47.307119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd832f-008c-4b57-a91a-7b2a0fdbe80c None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:47.312868 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b46a58-77fb-47cc-ae8a-042d6b27e134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:47.313460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b46a58-77fb-47cc-ae8a-042d6b27e134 service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:47.313743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b46a58-77fb-47cc-ae8a-042d6b27e134 service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:47.314024 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b46a58-77fb-47cc-ae8a-042d6b27e134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:47.322652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b46a58-77fb-47cc-ae8a-042d6b27e134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:47.324248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b46a58-77fb-47cc-ae8a-042d6b27e134 service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:47.333502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 760/1527] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:01:51.369353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e881e8-1d14-4307-9f23-6942f490defc None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:51.369919 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e881e8-1d14-4307-9f23-6942f490defc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:51.370047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e881e8-1d14-4307-9f23-6942f490defc None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:51.372333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:51.377939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbeafb-0ca8-47b8-a003-ce153bf24624 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:51.378521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbeafb-0ca8-47b8-a003-ce153bf24624 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:51.378521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbeafb-0ca8-47b8-a003-ce153bf24624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:51.399029 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-2efbeafb-0ca8-47b8-a003-ce153bf24624 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:51.400261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2efbeafb-0ca8-47b8-a003-ce153bf24624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:51.408245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:01:51.487945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e881e8-1d14-4307-9f23-6942f490defc None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:51.489772 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-43e881e8-1d14-4307-9f23-6942f490defc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:51.573374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e881e8-1d14-4307-9f23-6942f490defc None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:51.576984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee769af0-ff36-4783-98c6-2a74944c77fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:51.577587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee769af0-ff36-4783-98c6-2a74944c77fd service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:51.577868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee769af0-ff36-4783-98c6-2a74944c77fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:51.578143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee769af0-ff36-4783-98c6-2a74944c77fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:51.588518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee769af0-ff36-4783-98c6-2a74944c77fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:51.589952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee769af0-ff36-4783-98c6-2a74944c77fd service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:51.599168 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 769/1530] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:01:53.587707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f233cb-6db1-422f-98f0-cc89892a4f70 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:53.589633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f233cb-6db1-422f-98f0-cc89892a4f70 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:53.589633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f233cb-6db1-422f-98f0-cc89892a4f70 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:53.589982 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:53.594786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e980cb7-1e68-469b-9db3-7265774ac879 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:53.595754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e980cb7-1e68-469b-9db3-7265774ac879 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:53.595938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e980cb7-1e68-469b-9db3-7265774ac879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:53.615615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2e980cb7-1e68-469b-9db3-7265774ac879 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:53.616839 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2e980cb7-1e68-469b-9db3-7265774ac879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:53.624727 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:01:53.660119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f233cb-6db1-422f-98f0-cc89892a4f70 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:53.670764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f233cb-6db1-422f-98f0-cc89892a4f70 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:53.674934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac3bbc-4ae9-43b7-9c73-3f3ced2c380a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:53.675526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac3bbc-4ae9-43b7-9c73-3f3ced2c380a service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:53.675841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac3bbc-4ae9-43b7-9c73-3f3ced2c380a service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:53.676170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac3bbc-4ae9-43b7-9c73-3f3ced2c380a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:53.685234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac3bbc-4ae9-43b7-9c73-3f3ced2c380a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:53.686650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac3bbc-4ae9-43b7-9c73-3f3ced2c380a service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:53.696130 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 763/1533] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:01:57.331160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1b724-0f68-4466-b455-04d0264bac3a None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:57.331759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1b724-0f68-4466-b455-04d0264bac3a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:57.331759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1b724-0f68-4466-b455-04d0264bac3a None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:57.333069 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:57.338194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee708-2ef2-4f82-aae1-1757ba0e7440 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:57.338613 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee708-2ef2-4f82-aae1-1757ba0e7440 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:57.338723 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee708-2ef2-4f82-aae1-1757ba0e7440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:57.346943 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=81 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:57.359625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d3aee708-2ef2-4f82-aae1-1757ba0e7440 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:57.360929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d3aee708-2ef2-4f82-aae1-1757ba0e7440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:57.369243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:01:57.674684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1b724-0f68-4466-b455-04d0264bac3a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:57.676510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-00d1b724-0f68-4466-b455-04d0264bac3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:57.741284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:57.755414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1b724-0f68-4466-b455-04d0264bac3a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:57.758987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8dd1e-9e5d-4e1f-b3c2-75e2e946d501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:57.759586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8dd1e-9e5d-4e1f-b3c2-75e2e946d501 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:57.759902 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8dd1e-9e5d-4e1f-b3c2-75e2e946d501 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:57.760171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8dd1e-9e5d-4e1f-b3c2-75e2e946d501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:57.769011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8dd1e-9e5d-4e1f-b3c2-75e2e946d501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:57.770432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8dd1e-9e5d-4e1f-b3c2-75e2e946d501 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:57.779562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 772/1536] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:01:59.783821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed951c-291e-47bb-b63c-869cdd5cacba None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:59.784354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed951c-291e-47bb-b63c-869cdd5cacba None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:59.784354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed951c-291e-47bb-b63c-869cdd5cacba None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:59.785751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:59.791582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba733a2-46d9-4cd2-9c3f-c2108fc77cd3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:59.792047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba733a2-46d9-4cd2-9c3f-c2108fc77cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:59.792158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba733a2-46d9-4cd2-9c3f-c2108fc77cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:59.812380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-dba733a2-46d9-4cd2-9c3f-c2108fc77cd3 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:59.813569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dba733a2-46d9-4cd2-9c3f-c2108fc77cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:59.821488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:02:00.134543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed951c-291e-47bb-b63c-869cdd5cacba None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:02:00.136283 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e8ed951c-291e-47bb-b63c-869cdd5cacba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:00.149957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed951c-291e-47bb-b63c-869cdd5cacba None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:02:00.153532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397219ad-1b6e-4331-bf7a-454a9fb42d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:02:00.154132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397219ad-1b6e-4331-bf7a-454a9fb42d18 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:00.154411 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397219ad-1b6e-4331-bf7a-454a9fb42d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:00.154682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397219ad-1b6e-4331-bf7a-454a9fb42d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:00.165784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397219ad-1b6e-4331-bf7a-454a9fb42d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:02:00.167593 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397219ad-1b6e-4331-bf7a-454a9fb42d18 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:02:00.177186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 766/1539] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:02:09.807579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=11 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:02:10.172972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=8 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:26.025742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94507ce2-2b2d-4cc3-a23e-a2afbd398859 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.026859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94507ce2-2b2d-4cc3-a23e-a2afbd398859 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.027367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94507ce2-2b2d-4cc3-a23e-a2afbd398859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.049458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-94507ce2-2b2d-4cc3-a23e-a2afbd398859 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.050610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-94507ce2-2b2d-4cc3-a23e-a2afbd398859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.055238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d7078-f530-46a9-9a45-c54630d567b1 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.056185 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d7078-f530-46a9-9a45-c54630d567b1 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.056811 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d7078-f530-46a9-9a45-c54630d567b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.073094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 774/1540] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.074699 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782f980-4bd2-4ee3-8759-50dc0b7a6cf5 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.075323 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782f980-4bd2-4ee3-8759-50dc0b7a6cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.075950 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782f980-4bd2-4ee3-8759-50dc0b7a6cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.085939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-743d7078-f530-46a9-9a45-c54630d567b1 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.087265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-743d7078-f530-46a9-9a45-c54630d567b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.105636 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 767/1541] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.106708 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3259c-8109-4c41-8b9a-39799e61f11d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.106993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3259c-8109-4c41-8b9a-39799e61f11d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.107266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3259c-8109-4c41-8b9a-39799e61f11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.118744 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9782f980-4bd2-4ee3-8759-50dc0b7a6cf5 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.120263 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9782f980-4bd2-4ee3-8759-50dc0b7a6cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.132338 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 775/1542] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.133591 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a28de-3cd8-4bd6-bddd-93f072858b64 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.133881 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a28de-3cd8-4bd6-bddd-93f072858b64 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.134160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a28de-3cd8-4bd6-bddd-93f072858b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.151620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-93b3259c-8109-4c41-8b9a-39799e61f11d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.152890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-93b3259c-8109-4c41-8b9a-39799e61f11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.163072 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-be2a28de-3cd8-4bd6-bddd-93f072858b64 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.164472 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-be2a28de-3cd8-4bd6-bddd-93f072858b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.173331 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 776/1543] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.174496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a484a84-4d56-48f5-8d21-3f05b2aeaa82 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.174788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a484a84-4d56-48f5-8d21-3f05b2aeaa82 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.175061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a484a84-4d56-48f5-8d21-3f05b2aeaa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.175604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 768/1544] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.180337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3259c-8109-4c41-8b9a-39799e61f11d None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.190347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3259c-8109-4c41-8b9a-39799e61f11d None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.206561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4a484a84-4d56-48f5-8d21-3f05b2aeaa82 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.206561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4a484a84-4d56-48f5-8d21-3f05b2aeaa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.208860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a271b-ab5a-4be2-9079-09631c52ba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.209497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a271b-ab5a-4be2-9079-09631c52ba13 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.209781 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a271b-ab5a-4be2-9079-09631c52ba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.210055 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a271b-ab5a-4be2-9079-09631c52ba13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.210724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a271b-ab5a-4be2-9079-09631c52ba13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:03:26.211030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a271b-ab5a-4be2-9079-09631c52ba13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.212077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: WARNING py.warnings [None req-4d5a271b-ab5a-4be2-9079-09631c52ba13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:03:26.212077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: warnings.warn(msg) Aug 10 08:03:26.212077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: Aug 10 08:03:26.213068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a271b-ab5a-4be2-9079-09631c52ba13 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.220427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 777/1545] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.222057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac33bf-920c-43c6-a723-a4a36de30675 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.222576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac33bf-920c-43c6-a723-a4a36de30675 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.223115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac33bf-920c-43c6-a723-a4a36de30675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.239166 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 769/1546] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:03:26.240182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a271b-ab5a-4be2-9079-09631c52ba13 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.245009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-99ac33bf-920c-43c6-a723-a4a36de30675 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.246507 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-99ac33bf-920c-43c6-a723-a4a36de30675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.251803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a271b-ab5a-4be2-9079-09631c52ba13 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.256334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 778/1547] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.256841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad35be8-2392-45e4-a56f-d60a1a57be84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.257458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad35be8-2392-45e4-a56f-d60a1a57be84 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.257743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad35be8-2392-45e4-a56f-d60a1a57be84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.258019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad35be8-2392-45e4-a56f-d60a1a57be84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.258681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad35be8-2392-45e4-a56f-d60a1a57be84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:03:26.258985 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad35be8-2392-45e4-a56f-d60a1a57be84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.259554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53b321-ff24-48d6-9106-7e699c0a0e23 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.260060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53b321-ff24-48d6-9106-7e699c0a0e23 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.260559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53b321-ff24-48d6-9106-7e699c0a0e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.260864 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad35be8-2392-45e4-a56f-d60a1a57be84 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.278461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 770/1548] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:03:26.279747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcb1dc-b198-4042-8dd6-ebf223b97f17 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.280134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcb1dc-b198-4042-8dd6-ebf223b97f17 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.280334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcb1dc-b198-4042-8dd6-ebf223b97f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.285354 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0e53b321-ff24-48d6-9106-7e699c0a0e23 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.286835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0e53b321-ff24-48d6-9106-7e699c0a0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.295079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 779/1549] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.295869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53b321-ff24-48d6-9106-7e699c0a0e23 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.301770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-61bcb1dc-b198-4042-8dd6-ebf223b97f17 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.303460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-61bcb1dc-b198-4042-8dd6-ebf223b97f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.306459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53b321-ff24-48d6-9106-7e699c0a0e23 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.311025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9472aa-6272-45f5-b8da-b831342a8b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.311627 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9472aa-6272-45f5-b8da-b831342a8b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.311807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 771/1550] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.311965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9472aa-6272-45f5-b8da-b831342a8b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.312229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9472aa-6272-45f5-b8da-b831342a8b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.312723 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcb1dc-b198-4042-8dd6-ebf223b97f17 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.312988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9472aa-6272-45f5-b8da-b831342a8b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:03:26.313293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9472aa-6272-45f5-b8da-b831342a8b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.314918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9472aa-6272-45f5-b8da-b831342a8b45 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.325425 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcb1dc-b198-4042-8dd6-ebf223b97f17 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.329963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 780/1551] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:03:26.331176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46318817-0ed1-48f3-8a43-4837b5de8925 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.331466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46318817-0ed1-48f3-8a43-4837b5de8925 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.331769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46318817-0ed1-48f3-8a43-4837b5de8925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.332555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4cf14-912f-4331-ab51-0784723e4c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.333391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4cf14-912f-4331-ab51-0784723e4c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.333691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4cf14-912f-4331-ab51-0784723e4c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.333970 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4cf14-912f-4331-ab51-0784723e4c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.334600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4cf14-912f-4331-ab51-0784723e4c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.336521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4cf14-912f-4331-ab51-0784723e4c65 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.351249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-46318817-0ed1-48f3-8a43-4837b5de8925 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.352481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-46318817-0ed1-48f3-8a43-4837b5de8925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.361235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 781/1552] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.362555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3eef8-4d6c-4b53-b795-9bb234772a9f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.362840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3eef8-4d6c-4b53-b795-9bb234772a9f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.363120 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3eef8-4d6c-4b53-b795-9bb234772a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.378447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 772/1553] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:26.378447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd012e-4a3c-4e77-9603-9341f9de8599 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.378447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd012e-4a3c-4e77-9603-9341f9de8599 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.378447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd012e-4a3c-4e77-9603-9341f9de8599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.385838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c5c3eef8-4d6c-4b53-b795-9bb234772a9f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.387037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c5c3eef8-4d6c-4b53-b795-9bb234772a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.396589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-6ebd012e-4a3c-4e77-9603-9341f9de8599 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.397781 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6ebd012e-4a3c-4e77-9603-9341f9de8599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.448855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 782/1554] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.449752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3eef8-4d6c-4b53-b795-9bb234772a9f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.459123 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 773/1555] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.460277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3eef8-4d6c-4b53-b795-9bb234772a9f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.460393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd1830-9ed2-48dd-bca3-3b0f7220f6b7 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.460685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd1830-9ed2-48dd-bca3-3b0f7220f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.460964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd1830-9ed2-48dd-bca3-3b0f7220f6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.465056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c9766-250e-4e5f-840c-80ac126fd085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.465711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c9766-250e-4e5f-840c-80ac126fd085 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.466104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c9766-250e-4e5f-840c-80ac126fd085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.466273 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c9766-250e-4e5f-840c-80ac126fd085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.466902 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c9766-250e-4e5f-840c-80ac126fd085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.468034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-f74c9766-250e-4e5f-840c-80ac126fd085 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:03:26.468034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Aug 10 08:03:26.468034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: Aug 10 08:03:26.469276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c9766-250e-4e5f-840c-80ac126fd085 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.480715 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-6efd1830-9ed2-48dd-bca3-3b0f7220f6b7 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.481939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6efd1830-9ed2-48dd-bca3-3b0f7220f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.490393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 774/1556] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.491918 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c833b3-7358-49b4-b00a-fff3bf29be88 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.492077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c833b3-7358-49b4-b00a-fff3bf29be88 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.492217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c833b3-7358-49b4-b00a-fff3bf29be88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.498490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 783/1557] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:26.499397 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c9766-250e-4e5f-840c-80ac126fd085 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.512029 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-a5c833b3-7358-49b4-b00a-fff3bf29be88 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.513208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a5c833b3-7358-49b4-b00a-fff3bf29be88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.564739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c9766-250e-4e5f-840c-80ac126fd085 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.569245 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815691c-4dbf-4679-a667-862996508fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.569850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815691c-4dbf-4679-a667-862996508fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.570129 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815691c-4dbf-4679-a667-862996508fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.570401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815691c-4dbf-4679-a667-862996508fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.571021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815691c-4dbf-4679-a667-862996508fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.572945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815691c-4dbf-4679-a667-862996508fcd admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.574240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 775/1558] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.575086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c833b3-7358-49b4-b00a-fff3bf29be88 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.584908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c833b3-7358-49b4-b00a-fff3bf29be88 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.589571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083e82f-7f56-47a1-9270-90e298aeab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.590156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083e82f-7f56-47a1-9270-90e298aeab8c admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.590440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083e82f-7f56-47a1-9270-90e298aeab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.590716 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083e82f-7f56-47a1-9270-90e298aeab8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.591354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083e82f-7f56-47a1-9270-90e298aeab8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:03:26.591661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083e82f-7f56-47a1-9270-90e298aeab8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.593367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083e82f-7f56-47a1-9270-90e298aeab8c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.608091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 784/1559] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:26.608300 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 776/1560] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:03:26.608411 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815691c-4dbf-4679-a667-862996508fcd admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.608526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231e318-564e-4e83-b489-c7968b9f1032 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.608526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231e318-564e-4e83-b489-c7968b9f1032 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.608526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231e318-564e-4e83-b489-c7968b9f1032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.617249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:26.618700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:26.632857 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-a231e318-564e-4e83-b489-c7968b9f1032 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.634083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a231e318-564e-4e83-b489-c7968b9f1032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.674787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815691c-4dbf-4679-a667-862996508fcd admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.679667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df52c9d-fd2c-47b5-a9bf-91810f858e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.680296 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df52c9d-fd2c-47b5-a9bf-91810f858e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.680579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df52c9d-fd2c-47b5-a9bf-91810f858e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.680848 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df52c9d-fd2c-47b5-a9bf-91810f858e31 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.681462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df52c9d-fd2c-47b5-a9bf-91810f858e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.683371 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df52c9d-fd2c-47b5-a9bf-91810f858e31 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.694039 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 777/1561] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.695362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a52ce9-a405-4047-b3d5-66189ebde59f None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.695859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a52ce9-a405-4047-b3d5-66189ebde59f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.696209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a52ce9-a405-4047-b3d5-66189ebde59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.706440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 785/1562] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:26.707587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df52c9d-fd2c-47b5-a9bf-91810f858e31 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.716630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-55a52ce9-a405-4047-b3d5-66189ebde59f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:26.717832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-55a52ce9-a405-4047-b3d5-66189ebde59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.717969 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df52c9d-fd2c-47b5-a9bf-91810f858e31 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.722700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969a8cd-8da4-410e-9960-603522890939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.723426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969a8cd-8da4-410e-9960-603522890939 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.723971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969a8cd-8da4-410e-9960-603522890939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.724340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969a8cd-8da4-410e-9960-603522890939 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.724993 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969a8cd-8da4-410e-9960-603522890939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:03:26.725304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969a8cd-8da4-410e-9960-603522890939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.726175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 778/1563] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.726739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a52ce9-a405-4047-b3d5-66189ebde59f None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.730735 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969a8cd-8da4-410e-9960-603522890939 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.736168 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a52ce9-a405-4047-b3d5-66189ebde59f None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.741403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89c261-3fde-403a-8db7-6977c2193716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.742143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89c261-3fde-403a-8db7-6977c2193716 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.742423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89c261-3fde-403a-8db7-6977c2193716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.742769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89c261-3fde-403a-8db7-6977c2193716 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.743411 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89c261-3fde-403a-8db7-6977c2193716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.744152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 786/1564] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:03:26.744557 dv-cinder-781032-4-smb devstack@keystone.service[80195]: WARNING py.warnings [None req-4b89c261-3fde-403a-8db7-6977c2193716 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:03:26.744557 dv-cinder-781032-4-smb devstack@keystone.service[80195]: warnings.warn(msg) Aug 10 08:03:26.744557 dv-cinder-781032-4-smb devstack@keystone.service[80195]: Aug 10 08:03:26.745315 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969a8cd-8da4-410e-9960-603522890939 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.745971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89c261-3fde-403a-8db7-6977c2193716 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.756592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969a8cd-8da4-410e-9960-603522890939 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.761648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031dac6-1778-46d1-ae77-c2792e869028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.762711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031dac6-1778-46d1-ae77-c2792e869028 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.763026 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031dac6-1778-46d1-ae77-c2792e869028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.763463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031dac6-1778-46d1-ae77-c2792e869028 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.764543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031dac6-1778-46d1-ae77-c2792e869028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:03:26.764871 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031dac6-1778-46d1-ae77-c2792e869028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.768031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031dac6-1778-46d1-ae77-c2792e869028 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.774456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 779/1565] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/users => generated 288 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:26.775265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89c261-3fde-403a-8db7-6977c2193716 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.782335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 787/1566] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:03:26.783522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031dac6-1778-46d1-ae77-c2792e869028 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.785704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89c261-3fde-403a-8db7-6977c2193716 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.790921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb620a-fca6-4651-8878-d121ac15ee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.791537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb620a-fca6-4651-8878-d121ac15ee4b admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.791853 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb620a-fca6-4651-8878-d121ac15ee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.792132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb620a-fca6-4651-8878-d121ac15ee4b admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.792822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb620a-fca6-4651-8878-d121ac15ee4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.794748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb620a-fca6-4651-8878-d121ac15ee4b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.799170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031dac6-1778-46d1-ae77-c2792e869028 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.804121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4919df-3b34-4d9c-a958-8a5e3b82ad38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.804733 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4919df-3b34-4d9c-a958-8a5e3b82ad38 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.805019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4919df-3b34-4d9c-a958-8a5e3b82ad38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.805315 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4919df-3b34-4d9c-a958-8a5e3b82ad38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.805951 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4919df-3b34-4d9c-a958-8a5e3b82ad38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.807908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4919df-3b34-4d9c-a958-8a5e3b82ad38 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.821958 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 780/1567] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:26.821958 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb620a-fca6-4651-8878-d121ac15ee4b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.832336 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb620a-fca6-4651-8878-d121ac15ee4b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.837093 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084c6fe-c08f-457c-8c67-01c9e99fef74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.837686 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084c6fe-c08f-457c-8c67-01c9e99fef74 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.837968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084c6fe-c08f-457c-8c67-01c9e99fef74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.841528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 788/1568] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:26.841690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084c6fe-c08f-457c-8c67-01c9e99fef74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.841690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084c6fe-c08f-457c-8c67-01c9e99fef74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:03:26.841891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4919df-3b34-4d9c-a958-8a5e3b82ad38 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.841996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084c6fe-c08f-457c-8c67-01c9e99fef74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.841996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084c6fe-c08f-457c-8c67-01c9e99fef74 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.855780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 781/1569] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:03:26.855780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084c6fe-c08f-457c-8c67-01c9e99fef74 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.863517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084c6fe-c08f-457c-8c67-01c9e99fef74 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.912496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4919df-3b34-4d9c-a958-8a5e3b82ad38 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.917544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf41e9-3af8-481a-ace5-86f3efa38d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.918199 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf41e9-3af8-481a-ace5-86f3efa38d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.918487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf41e9-3af8-481a-ace5-86f3efa38d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.918766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf41e9-3af8-481a-ace5-86f3efa38d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.919424 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf41e9-3af8-481a-ace5-86f3efa38d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.921127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf41e9-3af8-481a-ace5-86f3efa38d6e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.921480 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c63a83-c97c-44bb-a4fc-950eb0013b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.922618 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c63a83-c97c-44bb-a4fc-950eb0013b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.922904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c63a83-c97c-44bb-a4fc-950eb0013b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.923316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c63a83-c97c-44bb-a4fc-950eb0013b05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.924040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c63a83-c97c-44bb-a4fc-950eb0013b05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:03:26.924682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c63a83-c97c-44bb-a4fc-950eb0013b05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.926350 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c63a83-c97c-44bb-a4fc-950eb0013b05 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.932425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 789/1570] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:26.933305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf41e9-3af8-481a-ace5-86f3efa38d6e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.942248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 782/1571] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:03:26.943360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c63a83-c97c-44bb-a4fc-950eb0013b05 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.943788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf41e9-3af8-481a-ace5-86f3efa38d6e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.948572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f011c3-8f63-45e3-9a0b-708add2d2cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.949263 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f011c3-8f63-45e3-9a0b-708add2d2cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.949549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f011c3-8f63-45e3-9a0b-708add2d2cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.949822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f011c3-8f63-45e3-9a0b-708add2d2cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.950440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f011c3-8f63-45e3-9a0b-708add2d2cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.952377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f011c3-8f63-45e3-9a0b-708add2d2cc0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.958860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c63a83-c97c-44bb-a4fc-950eb0013b05 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.963483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280c912-7f46-4543-ae8c-f6170a792f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.964103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c912-7f46-4543-ae8c-f6170a792f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.964393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c912-7f46-4543-ae8c-f6170a792f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.964673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c912-7f46-4543-ae8c-f6170a792f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.965314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280c912-7f46-4543-ae8c-f6170a792f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.966887 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280c912-7f46-4543-ae8c-f6170a792f33 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.977467 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 783/1572] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:26.978317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280c912-7f46-4543-ae8c-f6170a792f33 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.982320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 790/1573] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:26.983104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f011c3-8f63-45e3-9a0b-708add2d2cc0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.990847 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280c912-7f46-4543-ae8c-f6170a792f33 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.006861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:27.023319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:27.050269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f011c3-8f63-45e3-9a0b-708add2d2cc0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.052789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed6c73-e3e1-45cf-8019-a989f436d895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.053402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6c73-e3e1-45cf-8019-a989f436d895 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.053689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6c73-e3e1-45cf-8019-a989f436d895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.053969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6c73-e3e1-45cf-8019-a989f436d895 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.054600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed6c73-e3e1-45cf-8019-a989f436d895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.055342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c98cb-4b6c-4ac8-927b-dbea30ddf657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.055981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c98cb-4b6c-4ac8-927b-dbea30ddf657 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.056265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c98cb-4b6c-4ac8-927b-dbea30ddf657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.056540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c98cb-4b6c-4ac8-927b-dbea30ddf657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.056648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed6c73-e3e1-45cf-8019-a989f436d895 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.057188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c98cb-4b6c-4ac8-927b-dbea30ddf657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.058773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c98cb-4b6c-4ac8-927b-dbea30ddf657 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.075887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 791/1574] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:27.075887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c98cb-4b6c-4ac8-927b-dbea30ddf657 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.082630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c98cb-4b6c-4ac8-927b-dbea30ddf657 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.084236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 784/1575] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:26 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:27.088399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed6c73-e3e1-45cf-8019-a989f436d895 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.151087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc7175-c48a-414f-af86-29bca7c962a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.151357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7175-c48a-414f-af86-29bca7c962a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.151783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7175-c48a-414f-af86-29bca7c962a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.152207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7175-c48a-414f-af86-29bca7c962a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.152841 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc7175-c48a-414f-af86-29bca7c962a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.152951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed6c73-e3e1-45cf-8019-a989f436d895 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.154768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc7175-c48a-414f-af86-29bca7c962a9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.158118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162bb72-9ae7-4c24-81d2-888a0a3ddc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.158790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162bb72-9ae7-4c24-81d2-888a0a3ddc06 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.159145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162bb72-9ae7-4c24-81d2-888a0a3ddc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.159486 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162bb72-9ae7-4c24-81d2-888a0a3ddc06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.160138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162bb72-9ae7-4c24-81d2-888a0a3ddc06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.162041 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162bb72-9ae7-4c24-81d2-888a0a3ddc06 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.177798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 792/1576] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:27 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:27.178875 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc7175-c48a-414f-af86-29bca7c962a9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.189225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc7175-c48a-414f-af86-29bca7c962a9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.193905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91205c3f-a88a-4ce5-ac45-c0480ddc4cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.194064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 785/1577] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:27 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:27.194497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91205c3f-a88a-4ce5-ac45-c0480ddc4cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.194771 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91205c3f-a88a-4ce5-ac45-c0480ddc4cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.194886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162bb72-9ae7-4c24-81d2-888a0a3ddc06 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.195047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91205c3f-a88a-4ce5-ac45-c0480ddc4cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.195751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91205c3f-a88a-4ce5-ac45-c0480ddc4cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.197362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91205c3f-a88a-4ce5-ac45-c0480ddc4cc0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.211340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 793/1578] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:27.211340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91205c3f-a88a-4ce5-ac45-c0480ddc4cc0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.220813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91205c3f-a88a-4ce5-ac45-c0480ddc4cc0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.260340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162bb72-9ae7-4c24-81d2-888a0a3ddc06 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.265252 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a80705-8f6c-43a6-b537-207b3b93a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.265975 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a80705-8f6c-43a6-b537-207b3b93a4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.266339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a80705-8f6c-43a6-b537-207b3b93a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.266687 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a80705-8f6c-43a6-b537-207b3b93a4a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.267393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a80705-8f6c-43a6-b537-207b3b93a4a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.269375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a80705-8f6c-43a6-b537-207b3b93a4a6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.280422 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c0f9-2bbf-4199-b618-7ae9904eca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.281028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c0f9-2bbf-4199-b618-7ae9904eca5b admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.281836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c0f9-2bbf-4199-b618-7ae9904eca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.282139 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c0f9-2bbf-4199-b618-7ae9904eca5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.282869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734c0f9-2bbf-4199-b618-7ae9904eca5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.284527 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734c0f9-2bbf-4199-b618-7ae9904eca5b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.294435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 794/1579] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:27.296306 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 786/1580] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:27 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:27.296938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c0f9-2bbf-4199-b618-7ae9904eca5b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.300639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a80705-8f6c-43a6-b537-207b3b93a4a6 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.307660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c0f9-2bbf-4199-b618-7ae9904eca5b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.331092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:27.336352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:27.366868 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a80705-8f6c-43a6-b537-207b3b93a4a6 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.367694 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1e38d-d2b3-4d27-ae11-cb7685a2faf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.368342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1e38d-d2b3-4d27-ae11-cb7685a2faf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.368678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1e38d-d2b3-4d27-ae11-cb7685a2faf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.368892 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1e38d-d2b3-4d27-ae11-cb7685a2faf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.369514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1e38d-d2b3-4d27-ae11-cb7685a2faf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.371495 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1e38d-d2b3-4d27-ae11-cb7685a2faf9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.371620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1162582-8daa-4bc4-9ea5-fc8833fabadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.372249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1162582-8daa-4bc4-9ea5-fc8833fabadd admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.372536 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1162582-8daa-4bc4-9ea5-fc8833fabadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.372813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1162582-8daa-4bc4-9ea5-fc8833fabadd admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.373463 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1162582-8daa-4bc4-9ea5-fc8833fabadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.375062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1162582-8daa-4bc4-9ea5-fc8833fabadd admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.385737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 787/1581] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:27.386619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1162582-8daa-4bc4-9ea5-fc8833fabadd admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.394208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 795/1582] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:27 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:27.395040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1e38d-d2b3-4d27-ae11-cb7685a2faf9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.399427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1162582-8daa-4bc4-9ea5-fc8833fabadd admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.404037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334e146-b78e-4ba7-a22b-217aac8fe5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.404259 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1e38d-d2b3-4d27-ae11-cb7685a2faf9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.404627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334e146-b78e-4ba7-a22b-217aac8fe5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.404908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334e146-b78e-4ba7-a22b-217aac8fe5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.405236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334e146-b78e-4ba7-a22b-217aac8fe5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.405782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334e146-b78e-4ba7-a22b-217aac8fe5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.408286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334e146-b78e-4ba7-a22b-217aac8fe5b0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.419706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376d105-861b-4890-9225-08fdd2e8154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.420473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376d105-861b-4890-9225-08fdd2e8154e admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.420768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376d105-861b-4890-9225-08fdd2e8154e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.421046 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376d105-861b-4890-9225-08fdd2e8154e admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.423363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376d105-861b-4890-9225-08fdd2e8154e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.424700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376d105-861b-4890-9225-08fdd2e8154e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.431995 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 788/1583] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:27 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:27.432758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334e146-b78e-4ba7-a22b-217aac8fe5b0 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.442204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 796/1584] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:27.442204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376d105-861b-4890-9225-08fdd2e8154e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.446167 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334e146-b78e-4ba7-a22b-217aac8fe5b0 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.450399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376d105-861b-4890-9225-08fdd2e8154e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.450851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5345918-301c-449c-8e92-f7a300bd5456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.451453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5345918-301c-449c-8e92-f7a300bd5456 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.451755 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5345918-301c-449c-8e92-f7a300bd5456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.452039 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5345918-301c-449c-8e92-f7a300bd5456 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.452656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5345918-301c-449c-8e92-f7a300bd5456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.454628 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5345918-301c-449c-8e92-f7a300bd5456 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.455337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01428ca5-1164-4957-8439-7024f5ac196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.456071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01428ca5-1164-4957-8439-7024f5ac196e admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.456360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01428ca5-1164-4957-8439-7024f5ac196e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.456639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01428ca5-1164-4957-8439-7024f5ac196e admin admin] PATH_INFO: `/v3/projects/545c7b5da6674e78933d22ef3b186e95/users/d159a06cc5e74f53bc3990c07e6c32fc/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.474342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01428ca5-1164-4957-8439-7024f5ac196e admin admin] RBAC: Authorizing `identity:create_grant(project_id=545c7b5da6674e78933d22ef3b186e95, user_id=d159a06cc5e74f53bc3990c07e6c32fc, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.475533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-01428ca5-1164-4957-8439-7024f5ac196e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:03:27.475533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Aug 10 08:03:27.475533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: Aug 10 08:03:27.477209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 789/1585] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:27 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:27.477894 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01428ca5-1164-4957-8439-7024f5ac196e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.478306 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5345918-301c-449c-8e92-f7a300bd5456 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.491950 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 797/1586] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:27 2022] PUT /identity/v3/projects/545c7b5da6674e78933d22ef3b186e95/users/d159a06cc5e74f53bc3990c07e6c32fc/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:27.492783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01428ca5-1164-4957-8439-7024f5ac196e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.493615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5345918-301c-449c-8e92-f7a300bd5456 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.551970 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d722e7-5579-485b-8831-b6fc53456eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.552914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d722e7-5579-485b-8831-b6fc53456eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.553175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d722e7-5579-485b-8831-b6fc53456eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.553433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d722e7-5579-485b-8831-b6fc53456eaa admin admin] PATH_INFO: `/v3/projects/b4137deae66a4187ad5ea2757a9b737b/users/ee4d6facfb4249fd9ff38b7a59837d61/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.556237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01428ca5-1164-4957-8439-7024f5ac196e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.561096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae80f1-4850-494d-b748-554258975f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.561752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae80f1-4850-494d-b748-554258975f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.562033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae80f1-4850-494d-b748-554258975f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.562307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae80f1-4850-494d-b748-554258975f8c admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.562949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae80f1-4850-494d-b748-554258975f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.564982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae80f1-4850-494d-b748-554258975f8c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.568081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d722e7-5579-485b-8831-b6fc53456eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4137deae66a4187ad5ea2757a9b737b, user_id=ee4d6facfb4249fd9ff38b7a59837d61, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.570707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d722e7-5579-485b-8831-b6fc53456eaa admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.584723 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 790/1587] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:27 2022] PUT /identity/v3/projects/b4137deae66a4187ad5ea2757a9b737b/users/ee4d6facfb4249fd9ff38b7a59837d61/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:27.585806 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d722e7-5579-485b-8831-b6fc53456eaa admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.586996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 798/1588] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:27 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:27.587892 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae80f1-4850-494d-b748-554258975f8c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.598170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae80f1-4850-494d-b748-554258975f8c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.651487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d722e7-5579-485b-8831-b6fc53456eaa admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.653796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84249a5-bc24-478c-9999-9ad645fec168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.654405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84249a5-bc24-478c-9999-9ad645fec168 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.654687 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84249a5-bc24-478c-9999-9ad645fec168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.654958 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84249a5-bc24-478c-9999-9ad645fec168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.655626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84249a5-bc24-478c-9999-9ad645fec168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.656951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164f538-bc02-4314-96c7-cadfb03acc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.657609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164f538-bc02-4314-96c7-cadfb03acc38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.657795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84249a5-bc24-478c-9999-9ad645fec168 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.657892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164f538-bc02-4314-96c7-cadfb03acc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.658161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164f538-bc02-4314-96c7-cadfb03acc38 admin admin] PATH_INFO: `/v3/projects/2d9343a3ddd846ec869e446415c9f90e/users/f045e4688602450ba9ee884023069ab9/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.667398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 799/1589] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:27.668240 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84249a5-bc24-478c-9999-9ad645fec168 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.674198 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164f538-bc02-4314-96c7-cadfb03acc38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9343a3ddd846ec869e446415c9f90e, user_id=f045e4688602450ba9ee884023069ab9, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.676895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164f538-bc02-4314-96c7-cadfb03acc38 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.679507 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84249a5-bc24-478c-9999-9ad645fec168 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.680197 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:27.691687 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7992d5-b34b-435b-89b9-06bdd79bc088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.692433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 791/1590] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:27 2022] PUT /identity/v3/projects/2d9343a3ddd846ec869e446415c9f90e/users/f045e4688602450ba9ee884023069ab9/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:27.692553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7992d5-b34b-435b-89b9-06bdd79bc088 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.692664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7992d5-b34b-435b-89b9-06bdd79bc088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.692872 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7992d5-b34b-435b-89b9-06bdd79bc088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.693551 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7992d5-b34b-435b-89b9-06bdd79bc088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.695173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7992d5-b34b-435b-89b9-06bdd79bc088 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.696661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164f538-bc02-4314-96c7-cadfb03acc38 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.701810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:27.713191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 800/1591] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:27.714182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7992d5-b34b-435b-89b9-06bdd79bc088 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.724543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7992d5-b34b-435b-89b9-06bdd79bc088 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.763461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164f538-bc02-4314-96c7-cadfb03acc38 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.768269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bf954-fe94-48bd-ba29-1cdbc8afe473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.768887 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bf954-fe94-48bd-ba29-1cdbc8afe473 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.769171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bf954-fe94-48bd-ba29-1cdbc8afe473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.769446 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bf954-fe94-48bd-ba29-1cdbc8afe473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.770097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bf954-fe94-48bd-ba29-1cdbc8afe473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.771704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bf954-fe94-48bd-ba29-1cdbc8afe473 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.785684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 792/1592] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:27.785684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefbb81-1a44-4854-83f7-2037ceae4edd None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.785684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefbb81-1a44-4854-83f7-2037ceae4edd None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.785684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefbb81-1a44-4854-83f7-2037ceae4edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.794160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e6fc-301a-458e-b9dc-f0b109762cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.794770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e6fc-301a-458e-b9dc-f0b109762cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.795048 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e6fc-301a-458e-b9dc-f0b109762cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.795325 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e6fc-301a-458e-b9dc-f0b109762cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.796007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4e6fc-301a-458e-b9dc-f0b109762cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.798147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4e6fc-301a-458e-b9dc-f0b109762cb1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.811227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 801/1593] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:27.811227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1029a1b-72d0-41cc-90e1-425e8c8bec05 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.811227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1029a1b-72d0-41cc-90e1-425e8c8bec05 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.811227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1029a1b-72d0-41cc-90e1-425e8c8bec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.815314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-cdefbb81-1a44-4854-83f7-2037ceae4edd None None] MFA Rules not processed for user `d159a06cc5e74f53bc3990c07e6c32fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:27.816555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-cdefbb81-1a44-4854-83f7-2037ceae4edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:27.828714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b1029a1b-72d0-41cc-90e1-425e8c8bec05 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:27.829891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b1029a1b-72d0-41cc-90e1-425e8c8bec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:27.837499 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 802/1594] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:27.838218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1029a1b-72d0-41cc-90e1-425e8c8bec05 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.847633 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1029a1b-72d0-41cc-90e1-425e8c8bec05 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.852375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e77b1-c74e-4166-8c42-3f22286cf2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.852998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e77b1-c74e-4166-8c42-3f22286cf2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.853276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e77b1-c74e-4166-8c42-3f22286cf2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.853538 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e77b1-c74e-4166-8c42-3f22286cf2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.854176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e77b1-c74e-4166-8c42-3f22286cf2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.855912 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e77b1-c74e-4166-8c42-3f22286cf2d7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.866543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 803/1595] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:27.867332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e77b1-c74e-4166-8c42-3f22286cf2d7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.877616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e77b1-c74e-4166-8c42-3f22286cf2d7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.882136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe54dc-1961-4373-803b-0ab0ce9bf9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.882705 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe54dc-1961-4373-803b-0ab0ce9bf9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.882984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe54dc-1961-4373-803b-0ab0ce9bf9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.883259 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe54dc-1961-4373-803b-0ab0ce9bf9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.883921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe54dc-1961-4373-803b-0ab0ce9bf9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.885465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe54dc-1961-4373-803b-0ab0ce9bf9b4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.887404 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 793/1596] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:27.888660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3af903-431f-4bd6-b232-07488daaa338 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.888949 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3af903-431f-4bd6-b232-07488daaa338 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.892768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3af903-431f-4bd6-b232-07488daaa338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.900796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 804/1597] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:27.902324 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe54dc-1961-4373-803b-0ab0ce9bf9b4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.916935 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe54dc-1961-4373-803b-0ab0ce9bf9b4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.923852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffddcf-3ca4-47f4-a3c7-54aa40f75aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.924812 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffddcf-3ca4-47f4-a3c7-54aa40f75aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.925182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffddcf-3ca4-47f4-a3c7-54aa40f75aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.925362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffddcf-3ca4-47f4-a3c7-54aa40f75aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.926170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffddcf-3ca4-47f4-a3c7-54aa40f75aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.928248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffddcf-3ca4-47f4-a3c7-54aa40f75aa8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.928367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-6c3af903-431f-4bd6-b232-07488daaa338 None None] MFA Rules not processed for user `f045e4688602450ba9ee884023069ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:27.930062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6c3af903-431f-4bd6-b232-07488daaa338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:27.940260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 805/1598] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:27.941043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffddcf-3ca4-47f4-a3c7-54aa40f75aa8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.950547 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffddcf-3ca4-47f4-a3c7-54aa40f75aa8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:27.955704 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490889b0-49fa-4dc1-8479-87c1f11ad3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:27.956379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490889b0-49fa-4dc1-8479-87c1f11ad3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:27.956660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490889b0-49fa-4dc1-8479-87c1f11ad3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:27.956933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490889b0-49fa-4dc1-8479-87c1f11ad3e9 admin admin] PATH_INFO: `/v3/projects/abd1869819d24ead8fcd3b69168209f1/users/e2db0982bd8c4d01b2ee7e12f94ec67a/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:27.971994 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490889b0-49fa-4dc1-8479-87c1f11ad3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd1869819d24ead8fcd3b69168209f1, user_id=e2db0982bd8c4d01b2ee7e12f94ec67a, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:27.974625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490889b0-49fa-4dc1-8479-87c1f11ad3e9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:27.987357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 806/1599] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:27 2022] PUT /identity/v3/projects/abd1869819d24ead8fcd3b69168209f1/users/e2db0982bd8c4d01b2ee7e12f94ec67a/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:27.988208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490889b0-49fa-4dc1-8479-87c1f11ad3e9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:27.997879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 794/1600] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:28.002919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3af903-431f-4bd6-b232-07488daaa338 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:28.015257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:28.059158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490889b0-49fa-4dc1-8479-87c1f11ad3e9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:28.060294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3af903-431f-4bd6-b232-07488daaa338 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:28.064191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffff271-c889-49ed-b943-08ad0c5c926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:28.064803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffff271-c889-49ed-b943-08ad0c5c926d admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.065088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffff271-c889-49ed-b943-08ad0c5c926d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.065362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffff271-c889-49ed-b943-08ad0c5c926d admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.066010 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffff271-c889-49ed-b943-08ad0c5c926d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:28.067626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffff271-c889-49ed-b943-08ad0c5c926d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:28.077451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 807/1601] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:28.078262 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffff271-c889-49ed-b943-08ad0c5c926d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:28.087900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffff271-c889-49ed-b943-08ad0c5c926d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:28.093425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65067c7b-de33-48e3-a9c9-db838d56b8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:28.094540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65067c7b-de33-48e3-a9c9-db838d56b8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.094820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65067c7b-de33-48e3-a9c9-db838d56b8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.095129 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65067c7b-de33-48e3-a9c9-db838d56b8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.095786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65067c7b-de33-48e3-a9c9-db838d56b8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:28.097731 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65067c7b-de33-48e3-a9c9-db838d56b8d9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:28.107420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 808/1602] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:28.107899 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b67314-a425-4d5f-a365-3baf43972781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:28.108076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65067c7b-de33-48e3-a9c9-db838d56b8d9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:28.108483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b67314-a425-4d5f-a365-3baf43972781 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.108762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b67314-a425-4d5f-a365-3baf43972781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.109030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b67314-a425-4d5f-a365-3baf43972781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.118398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65067c7b-de33-48e3-a9c9-db838d56b8d9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:28.119909 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b67314-a425-4d5f-a365-3baf43972781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:28.121358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b67314-a425-4d5f-a365-3baf43972781 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:28.123204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1821a-dac4-40c7-b0d2-8419d4a68037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:28.123883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1821a-dac4-40c7-b0d2-8419d4a68037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.124168 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1821a-dac4-40c7-b0d2-8419d4a68037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.124440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1821a-dac4-40c7-b0d2-8419d4a68037 admin admin] PATH_INFO: `/v3/projects/fd040d5bb09349cfbcda335fb8f5c066/users/d22ea25e8e5843b1be42ed4c58ab142b/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.132186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 795/1603] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:28.133721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525c089-7462-4df7-ade2-a96941b07268 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.134062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525c089-7462-4df7-ade2-a96941b07268 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.134349 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525c089-7462-4df7-ade2-a96941b07268 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.136358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 796/1604] 10.222.0.30 () {54 vars in 962 bytes} [Wed Aug 10 08:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:28.137367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525c089-7462-4df7-ade2-a96941b07268 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:28.140376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1821a-dac4-40c7-b0d2-8419d4a68037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd040d5bb09349cfbcda335fb8f5c066, user_id=d22ea25e8e5843b1be42ed4c58ab142b, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:28.143207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1821a-dac4-40c7-b0d2-8419d4a68037 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:28.145911 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:28.151284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525c089-7462-4df7-ade2-a96941b07268 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:28.157012 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581a910-0a2d-41ef-8c0b-bc8601153f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:28.157709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581a910-0a2d-41ef-8c0b-bc8601153f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.158017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581a910-0a2d-41ef-8c0b-bc8601153f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.158260 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581a910-0a2d-41ef-8c0b-bc8601153f0c admin admin] PATH_INFO: `/v3/projects/1b486e886a784554a023950b3e45617b/users/b42b1af0e32a41fba8712334c2acfbc7/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.162981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 809/1605] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:28 2022] PUT /identity/v3/projects/fd040d5bb09349cfbcda335fb8f5c066/users/d22ea25e8e5843b1be42ed4c58ab142b/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:28.163865 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4668a8c-fab6-4964-868e-570c8111f563 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.164152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4668a8c-fab6-4964-868e-570c8111f563 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.164426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4668a8c-fab6-4964-868e-570c8111f563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.177729 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581a910-0a2d-41ef-8c0b-bc8601153f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b486e886a784554a023950b3e45617b, user_id=b42b1af0e32a41fba8712334c2acfbc7, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:28.180660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581a910-0a2d-41ef-8c0b-bc8601153f0c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:28.196076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a4668a8c-fab6-4964-868e-570c8111f563 None None] MFA Rules not processed for user `e2db0982bd8c4d01b2ee7e12f94ec67a`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:28.197498 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 797/1606] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:28 2022] PUT /identity/v3/projects/1b486e886a784554a023950b3e45617b/users/b42b1af0e32a41fba8712334c2acfbc7/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:28.201143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581a910-0a2d-41ef-8c0b-bc8601153f0c admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:28.201281 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a4668a8c-fab6-4964-868e-570c8111f563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:28.270872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581a910-0a2d-41ef-8c0b-bc8601153f0c admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:28.276001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdda4b3-4ee6-48d9-a142-abf45c625097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:28.276775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdda4b3-4ee6-48d9-a142-abf45c625097 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.277125 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdda4b3-4ee6-48d9-a142-abf45c625097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.277533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdda4b3-4ee6-48d9-a142-abf45c625097 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.277855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 810/1607] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:28.278163 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdda4b3-4ee6-48d9-a142-abf45c625097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:28.278821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4668a8c-fab6-4964-868e-570c8111f563 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:28.280130 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdda4b3-4ee6-48d9-a142-abf45c625097 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:28.291128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4668a8c-fab6-4964-868e-570c8111f563 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:28.296642 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c963842-2414-4415-bf96-653f380a78e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:28.297068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c963842-2414-4415-bf96-653f380a78e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.297489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c963842-2414-4415-bf96-653f380a78e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.297623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c963842-2414-4415-bf96-653f380a78e2 admin admin] PATH_INFO: `/v3/projects/99714d574da34560b352551e538af2ea/users/27fb790313bb48538af59998e949e2d8/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.314315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 798/1608] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:28 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:28.315930 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdda4b3-4ee6-48d9-a142-abf45c625097 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:28.316183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c963842-2414-4415-bf96-653f380a78e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99714d574da34560b352551e538af2ea, user_id=27fb790313bb48538af59998e949e2d8, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:28.320414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c963842-2414-4415-bf96-653f380a78e2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:28.336660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 811/1609] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:28 2022] PUT /identity/v3/projects/99714d574da34560b352551e538af2ea/users/27fb790313bb48538af59998e949e2d8/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:28.342062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09101-dc04-413c-b876-0fab8a342252 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.342354 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09101-dc04-413c-b876-0fab8a342252 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.342637 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09101-dc04-413c-b876-0fab8a342252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.367410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:28.401632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-37a09101-dc04-413c-b876-0fab8a342252 None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:28.402927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-37a09101-dc04-413c-b876-0fab8a342252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:28.406498 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdda4b3-4ee6-48d9-a142-abf45c625097 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:28.473094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24773ea3-15f6-4302-9cde-507c943e74c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:28.473788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773ea3-15f6-4302-9cde-507c943e74c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.474045 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773ea3-15f6-4302-9cde-507c943e74c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.474331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773ea3-15f6-4302-9cde-507c943e74c7 admin admin] PATH_INFO: `/v3/projects/820c8f75ca22462386876962b77141fe/users/332a3133d2dd480fb25f0c83e14e0c6e/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.487099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 812/1610] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Aug 10 08:03:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:28.488408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92470125-884b-472c-b977-78d8a493bae3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.488748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92470125-884b-472c-b977-78d8a493bae3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.489082 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92470125-884b-472c-b977-78d8a493bae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.500260 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24773ea3-15f6-4302-9cde-507c943e74c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=820c8f75ca22462386876962b77141fe, user_id=332a3133d2dd480fb25f0c83e14e0c6e, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:28.502995 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24773ea3-15f6-4302-9cde-507c943e74c7 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:28.522915 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-92470125-884b-472c-b977-78d8a493bae3 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:28.523332 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 799/1611] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:28 2022] PUT /identity/v3/projects/820c8f75ca22462386876962b77141fe/users/332a3133d2dd480fb25f0c83e14e0c6e/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:28.525040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690755f-944b-46bb-8b3e-f8fd92aa9e8c None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.525272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-92470125-884b-472c-b977-78d8a493bae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:28.525656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690755f-944b-46bb-8b3e-f8fd92aa9e8c None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.526078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690755f-944b-46bb-8b3e-f8fd92aa9e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.552445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e690755f-944b-46bb-8b3e-f8fd92aa9e8c None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:28.553923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e690755f-944b-46bb-8b3e-f8fd92aa9e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:28.573095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:28.612592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 813/1612] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:28.613884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92470125-884b-472c-b977-78d8a493bae3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:28.626266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92470125-884b-472c-b977-78d8a493bae3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:28.631508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43abf2-5f10-4fe2-a427-675a005d4959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:28.631962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 800/1613] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:28.632171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43abf2-5f10-4fe2-a427-675a005d4959 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.632460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43abf2-5f10-4fe2-a427-675a005d4959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.632776 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43abf2-5f10-4fe2-a427-675a005d4959 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.632882 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690755f-944b-46bb-8b3e-f8fd92aa9e8c None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:28.633474 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43abf2-5f10-4fe2-a427-675a005d4959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:28.635524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43abf2-5f10-4fe2-a427-675a005d4959 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:28.647819 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690755f-944b-46bb-8b3e-f8fd92aa9e8c None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:28.655474 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022361a-771d-4e31-b608-5e5e1751444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:28.657072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022361a-771d-4e31-b608-5e5e1751444b admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.657511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022361a-771d-4e31-b608-5e5e1751444b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.657812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022361a-771d-4e31-b608-5e5e1751444b admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.658454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022361a-771d-4e31-b608-5e5e1751444b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:28.660621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022361a-771d-4e31-b608-5e5e1751444b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:28.668589 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 814/1614] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:28 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:28.672676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923d25-b40e-458b-8102-f78a2efd3ddc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.673024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923d25-b40e-458b-8102-f78a2efd3ddc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.673345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923d25-b40e-458b-8102-f78a2efd3ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.683664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 801/1615] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:28 2022] POST /identity/v3/users => generated 294 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:28.684826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022361a-771d-4e31-b608-5e5e1751444b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:28.693991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fd923d25-b40e-458b-8102-f78a2efd3ddc None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:28.695221 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fd923d25-b40e-458b-8102-f78a2efd3ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:28.755698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:28.770703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 815/1616] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:28.771963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e8bf2-bef9-45a2-8dd8-dc9ad17c88ea None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.772257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e8bf2-bef9-45a2-8dd8-dc9ad17c88ea None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.772535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e8bf2-bef9-45a2-8dd8-dc9ad17c88ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.790264 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022361a-771d-4e31-b608-5e5e1751444b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:28.805872 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ff7e8bf2-bef9-45a2-8dd8-dc9ad17c88ea None None] MFA Rules not processed for user `332a3133d2dd480fb25f0c83e14e0c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:28.807119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ff7e8bf2-bef9-45a2-8dd8-dc9ad17c88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:28.873034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd0c97-64d5-46b3-8ac2-d546eceb9b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:28.873907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd0c97-64d5-46b3-8ac2-d546eceb9b78 service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.874431 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd0c97-64d5-46b3-8ac2-d546eceb9b78 service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.874785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd0c97-64d5-46b3-8ac2-d546eceb9b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.895892 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 816/1617] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:28.896911 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e8bf2-bef9-45a2-8dd8-dc9ad17c88ea None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:28.974068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:28.977384 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd0c97-64d5-46b3-8ac2-d546eceb9b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:28.980231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd0c97-64d5-46b3-8ac2-d546eceb9b78 service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:28.980405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e8bf2-bef9-45a2-8dd8-dc9ad17c88ea None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:28.985258 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385486dd-854a-4977-b789-633ed67df218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:28.986340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385486dd-854a-4977-b789-633ed67df218 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:28.987081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385486dd-854a-4977-b789-633ed67df218 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:28.987358 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385486dd-854a-4977-b789-633ed67df218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:28.996026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 802/1618] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:28.997410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd0c97-64d5-46b3-8ac2-d546eceb9b78 service nova] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.010402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd0c97-64d5-46b3-8ac2-d546eceb9b78 service nova] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.014717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6822312-64da-4d34-96c4-4d3909f188a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.015455 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6822312-64da-4d34-96c4-4d3909f188a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.016487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6822312-64da-4d34-96c4-4d3909f188a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.016849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6822312-64da-4d34-96c4-4d3909f188a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.020079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385486dd-854a-4977-b789-633ed67df218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.021961 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385486dd-854a-4977-b789-633ed67df218 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.030297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6822312-64da-4d34-96c4-4d3909f188a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.032955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6822312-64da-4d34-96c4-4d3909f188a1 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.045131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 817/1619] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:29.046292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385486dd-854a-4977-b789-633ed67df218 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.050553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 803/1620] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:29.052027 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6822312-64da-4d34-96c4-4d3909f188a1 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.058949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385486dd-854a-4977-b789-633ed67df218 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.064731 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec0a82-a86a-449f-9a46-11900a36c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.069043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec0a82-a86a-449f-9a46-11900a36c06f admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.069583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec0a82-a86a-449f-9a46-11900a36c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.071984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec0a82-a86a-449f-9a46-11900a36c06f admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.072861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec0a82-a86a-449f-9a46-11900a36c06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.075694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6822312-64da-4d34-96c4-4d3909f188a1 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.079058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec0a82-a86a-449f-9a46-11900a36c06f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.092353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dbbab-8848-4700-b759-fc78a45c1ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.093090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dbbab-8848-4700-b759-fc78a45c1ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.093467 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dbbab-8848-4700-b759-fc78a45c1ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.094548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dbbab-8848-4700-b759-fc78a45c1ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.095599 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dbbab-8848-4700-b759-fc78a45c1ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.098384 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dbbab-8848-4700-b759-fc78a45c1ffe admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.123116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 818/1621] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:29 2022] POST /identity/v3/users => generated 295 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:29.123897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec0a82-a86a-449f-9a46-11900a36c06f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.128119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 804/1622] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:29.128317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dbbab-8848-4700-b759-fc78a45c1ffe admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.145981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec0a82-a86a-449f-9a46-11900a36c06f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.149559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dbbab-8848-4700-b759-fc78a45c1ffe admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.157340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485ac4a-bf26-4afb-a069-b1c0406158f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.158248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ac4a-bf26-4afb-a069-b1c0406158f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.158730 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ac4a-bf26-4afb-a069-b1c0406158f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.159100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ac4a-bf26-4afb-a069-b1c0406158f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.159993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485ac4a-bf26-4afb-a069-b1c0406158f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.160418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac6d9b-5103-4a8e-8769-9f022fe086d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.162238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485ac4a-bf26-4afb-a069-b1c0406158f0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.162450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac6d9b-5103-4a8e-8769-9f022fe086d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.162949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac6d9b-5103-4a8e-8769-9f022fe086d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.164949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac6d9b-5103-4a8e-8769-9f022fe086d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.187902 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac6d9b-5103-4a8e-8769-9f022fe086d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.192501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac6d9b-5103-4a8e-8769-9f022fe086d2 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.204367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 805/1623] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:29 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:29.205427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485ac4a-bf26-4afb-a069-b1c0406158f0 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.218714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 819/1624] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:29.220160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac6d9b-5103-4a8e-8769-9f022fe086d2 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.249577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:29.250313 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac6d9b-5103-4a8e-8769-9f022fe086d2 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.286403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485ac4a-bf26-4afb-a069-b1c0406158f0 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.292012 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8095d1-2605-4e2a-a98f-9e48c17eca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.292734 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8095d1-2605-4e2a-a98f-9e48c17eca72 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.293660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8095d1-2605-4e2a-a98f-9e48c17eca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.293660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8095d1-2605-4e2a-a98f-9e48c17eca72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.294251 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8095d1-2605-4e2a-a98f-9e48c17eca72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.295959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8095d1-2605-4e2a-a98f-9e48c17eca72 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.308590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 806/1625] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:29.309449 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8095d1-2605-4e2a-a98f-9e48c17eca72 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.329502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8095d1-2605-4e2a-a98f-9e48c17eca72 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.336941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd95f26-4a27-45dd-a981-4647088e18a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.337851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd95f26-4a27-45dd-a981-4647088e18a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.338247 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd95f26-4a27-45dd-a981-4647088e18a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.338590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd95f26-4a27-45dd-a981-4647088e18a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.339848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd95f26-4a27-45dd-a981-4647088e18a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.342221 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd95f26-4a27-45dd-a981-4647088e18a0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.370838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2afad3-9af8-4557-a483-c0f29958b76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.372787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2afad3-9af8-4557-a483-c0f29958b76b admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.373500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2afad3-9af8-4557-a483-c0f29958b76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.374161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2afad3-9af8-4557-a483-c0f29958b76b admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.375005 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2afad3-9af8-4557-a483-c0f29958b76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.376909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2afad3-9af8-4557-a483-c0f29958b76b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.379346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 807/1626] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:29 2022] POST /identity/v3/users => generated 289 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:29.385296 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa619fa-9712-421c-b44e-a2ad8494d6b4 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.387048 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa619fa-9712-421c-b44e-a2ad8494d6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.387397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa619fa-9712-421c-b44e-a2ad8494d6b4 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.389097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 808/1627] 10.222.0.30 () {54 vars in 912 bytes} [Wed Aug 10 08:03:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:29.389849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa619fa-9712-421c-b44e-a2ad8494d6b4 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.391260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 820/1628] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:29.392527 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2afad3-9af8-4557-a483-c0f29958b76b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.410401 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2afad3-9af8-4557-a483-c0f29958b76b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.417508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa619fa-9712-421c-b44e-a2ad8494d6b4 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.423659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053eec-452a-445e-80f0-cbcdc1d08066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.425726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053eec-452a-445e-80f0-cbcdc1d08066 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.425726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053eec-452a-445e-80f0-cbcdc1d08066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.425726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053eec-452a-445e-80f0-cbcdc1d08066 admin admin] PATH_INFO: `/v3/projects/ece1a437079d44c8a43862aaf4820333/users/f5d81a1800704e4a85b30f47402eb27d/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.432102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaef69f-2fcc-4dd8-b199-1e92e426099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.432744 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaef69f-2fcc-4dd8-b199-1e92e426099c admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.433075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaef69f-2fcc-4dd8-b199-1e92e426099c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.433366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaef69f-2fcc-4dd8-b199-1e92e426099c admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.434076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaef69f-2fcc-4dd8-b199-1e92e426099c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.435759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaef69f-2fcc-4dd8-b199-1e92e426099c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.447759 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76053eec-452a-445e-80f0-cbcdc1d08066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece1a437079d44c8a43862aaf4820333, user_id=f5d81a1800704e4a85b30f47402eb27d, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.450990 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76053eec-452a-445e-80f0-cbcdc1d08066 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.459436 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 821/1629] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:29.460712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaef69f-2fcc-4dd8-b199-1e92e426099c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.472984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 809/1630] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:29 2022] PUT /identity/v3/projects/ece1a437079d44c8a43862aaf4820333/users/f5d81a1800704e4a85b30f47402eb27d/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:29.474557 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd60d9-d108-432b-ae7e-1a3cc57441f4 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.474847 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd60d9-d108-432b-ae7e-1a3cc57441f4 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.475415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd60d9-d108-432b-ae7e-1a3cc57441f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.481990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaef69f-2fcc-4dd8-b199-1e92e426099c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.504563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-36fd60d9-d108-432b-ae7e-1a3cc57441f4 None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:29.506792 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-36fd60d9-d108-432b-ae7e-1a3cc57441f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:29.602082 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 810/1631] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:03:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:29.602898 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd60d9-d108-432b-ae7e-1a3cc57441f4 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.630039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ec543-570a-4a1a-ae9e-b2df964dfeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.630880 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ec543-570a-4a1a-ae9e-b2df964dfeba admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.632925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ec543-570a-4a1a-ae9e-b2df964dfeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.633340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ec543-570a-4a1a-ae9e-b2df964dfeba admin admin] PATH_INFO: `/v3/projects/2f2f5ce76a3e47ce83c072c551b7d643/users/74964eb2a1014a98bfe24c947dfb25f8/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.669216 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ec543-570a-4a1a-ae9e-b2df964dfeba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2f5ce76a3e47ce83c072c551b7d643, user_id=74964eb2a1014a98bfe24c947dfb25f8, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.682384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ec543-570a-4a1a-ae9e-b2df964dfeba admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.693338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd60d9-d108-432b-ae7e-1a3cc57441f4 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.707240 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 822/1632] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:29 2022] PUT /identity/v3/projects/2f2f5ce76a3e47ce83c072c551b7d643/users/74964eb2a1014a98bfe24c947dfb25f8/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:29.709895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ec543-570a-4a1a-ae9e-b2df964dfeba admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.744944 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:29.746385 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:29.784086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ec543-570a-4a1a-ae9e-b2df964dfeba admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.790060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f7bcc-6b68-444c-9eab-8111011c2365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.791188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7bcc-6b68-444c-9eab-8111011c2365 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.791530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7bcc-6b68-444c-9eab-8111011c2365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.791714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7bcc-6b68-444c-9eab-8111011c2365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.792636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f7bcc-6b68-444c-9eab-8111011c2365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.794724 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f7bcc-6b68-444c-9eab-8111011c2365 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.795281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff362a69-d021-4f58-88f9-68fa200c6ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.796341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff362a69-d021-4f58-88f9-68fa200c6ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.796799 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff362a69-d021-4f58-88f9-68fa200c6ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.798006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff362a69-d021-4f58-88f9-68fa200c6ec5 admin admin] PATH_INFO: `/v3/projects/021a352a6cf04c33a8b1f8140a3b598e/users/25b80e8db86a4694850aa26733e9f9d8/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.807365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 823/1633] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:29.812318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f7bcc-6b68-444c-9eab-8111011c2365 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:29.821780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff362a69-d021-4f58-88f9-68fa200c6ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021a352a6cf04c33a8b1f8140a3b598e, user_id=25b80e8db86a4694850aa26733e9f9d8, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:29.826825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff362a69-d021-4f58-88f9-68fa200c6ec5 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:29.847185 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 811/1634] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:29 2022] PUT /identity/v3/projects/021a352a6cf04c33a8b1f8140a3b598e/users/25b80e8db86a4694850aa26733e9f9d8/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:29.848831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48343d4b-8b0b-4e95-b6f6-0a9aa546b2d5 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.849479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48343d4b-8b0b-4e95-b6f6-0a9aa546b2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.850237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48343d4b-8b0b-4e95-b6f6-0a9aa546b2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.878066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f7bcc-6b68-444c-9eab-8111011c2365 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:29.885389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-48343d4b-8b0b-4e95-b6f6-0a9aa546b2d5 None None] MFA Rules not processed for user `74964eb2a1014a98bfe24c947dfb25f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:29.887194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-48343d4b-8b0b-4e95-b6f6-0a9aa546b2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:29.932536 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb8373-b48a-414e-b7f3-aa60f9af8420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:29.933259 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb8373-b48a-414e-b7f3-aa60f9af8420 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:29.933616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb8373-b48a-414e-b7f3-aa60f9af8420 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:29.933951 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb8373-b48a-414e-b7f3-aa60f9af8420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:29.975237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 812/1635] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:29.976418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48343d4b-8b0b-4e95-b6f6-0a9aa546b2d5 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:30.016463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb8373-b48a-414e-b7f3-aa60f9af8420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:30.018110 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb8373-b48a-414e-b7f3-aa60f9af8420 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:30.044632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 824/1636] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:30.045701 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb8373-b48a-414e-b7f3-aa60f9af8420 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:30.071157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48343d4b-8b0b-4e95-b6f6-0a9aa546b2d5 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:30.080714 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bab07f-98a2-4c1a-b3c2-ee58f425d09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:30.081974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bab07f-98a2-4c1a-b3c2-ee58f425d09a admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:30.083927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bab07f-98a2-4c1a-b3c2-ee58f425d09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:30.084231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bab07f-98a2-4c1a-b3c2-ee58f425d09a admin admin] PATH_INFO: `/v3/projects/ece1a437079d44c8a43862aaf4820333/users/f5d81a1800704e4a85b30f47402eb27d/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:30.088165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bab07f-98a2-4c1a-b3c2-ee58f425d09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece1a437079d44c8a43862aaf4820333, user_id=f5d81a1800704e4a85b30f47402eb27d, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:30.091441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:30.094629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bab07f-98a2-4c1a-b3c2-ee58f425d09a admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:30.133258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 813/1637] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:29 2022] PUT /identity/v3/projects/ece1a437079d44c8a43862aaf4820333/users/f5d81a1800704e4a85b30f47402eb27d/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:30.134379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bab07f-98a2-4c1a-b3c2-ee58f425d09a admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:30.160928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb8373-b48a-414e-b7f3-aa60f9af8420 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:30.213409 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:30.251817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bab07f-98a2-4c1a-b3c2-ee58f425d09a admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:30.260892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9dc48e-54ef-4517-9af1-62d3384ea730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:30.261469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dc48e-54ef-4517-9af1-62d3384ea730 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:30.261749 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dc48e-54ef-4517-9af1-62d3384ea730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:30.262054 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dc48e-54ef-4517-9af1-62d3384ea730 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:30.262867 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9dc48e-54ef-4517-9af1-62d3384ea730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:30.264845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa48f9-e128-444e-962b-477ba98fa147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:30.265009 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9dc48e-54ef-4517-9af1-62d3384ea730 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:30.266546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa48f9-e128-444e-962b-477ba98fa147 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:30.266902 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa48f9-e128-444e-962b-477ba98fa147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:30.267253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa48f9-e128-444e-962b-477ba98fa147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:30.268028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa48f9-e128-444e-962b-477ba98fa147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:30.269886 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa48f9-e128-444e-962b-477ba98fa147 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:30.292618 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 825/1638] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:30.295075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76855202-4342-42a4-8d18-833adca34ec2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:30.295470 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76855202-4342-42a4-8d18-833adca34ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:30.295878 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76855202-4342-42a4-8d18-833adca34ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:30.312050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 814/1639] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:30 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:30.312050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9dc48e-54ef-4517-9af1-62d3384ea730 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:30.337728 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-76855202-4342-42a4-8d18-833adca34ec2 None None] MFA Rules not processed for user `f5d81a1800704e4a85b30f47402eb27d`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:30.338922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-76855202-4342-42a4-8d18-833adca34ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:30.412850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9dc48e-54ef-4517-9af1-62d3384ea730 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:30.491433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521effe-3caf-4503-acc1-9ec871778b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:30.491433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521effe-3caf-4503-acc1-9ec871778b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:30.491433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521effe-3caf-4503-acc1-9ec871778b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:30.491433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521effe-3caf-4503-acc1-9ec871778b70 admin admin] PATH_INFO: `/v3/projects/021a352a6cf04c33a8b1f8140a3b598e/users/25b80e8db86a4694850aa26733e9f9d8/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:30.498565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521effe-3caf-4503-acc1-9ec871778b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021a352a6cf04c33a8b1f8140a3b598e, user_id=25b80e8db86a4694850aa26733e9f9d8, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:30.498565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521effe-3caf-4503-acc1-9ec871778b70 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:30.498565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 815/1640] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:30 2022] PUT /identity/v3/projects/021a352a6cf04c33a8b1f8140a3b598e/users/25b80e8db86a4694850aa26733e9f9d8/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:30.498565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521effe-3caf-4503-acc1-9ec871778b70 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:30.508342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 826/1641] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:30.510246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86d595-4030-41e4-84c6-0fb659fb1cf8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:30.510770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86d595-4030-41e4-84c6-0fb659fb1cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:30.511217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86d595-4030-41e4-84c6-0fb659fb1cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:30.571660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2c86d595-4030-41e4-84c6-0fb659fb1cf8 None None] MFA Rules not processed for user `25b80e8db86a4694850aa26733e9f9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:30.573660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2c86d595-4030-41e4-84c6-0fb659fb1cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:30.646907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:30.687870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521effe-3caf-4503-acc1-9ec871778b70 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:30.697764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c3be9-b88b-4f70-a2fb-dc368db1c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:30.698431 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c3be9-b88b-4f70-a2fb-dc368db1c624 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:30.698831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c3be9-b88b-4f70-a2fb-dc368db1c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:30.699021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c3be9-b88b-4f70-a2fb-dc368db1c624 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:30.699679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c3be9-b88b-4f70-a2fb-dc368db1c624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:30.701684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c3be9-b88b-4f70-a2fb-dc368db1c624 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:30.720007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 827/1642] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:30.720007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86d595-4030-41e4-84c6-0fb659fb1cf8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:30.742539 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 816/1643] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:30 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:30.748926 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c3be9-b88b-4f70-a2fb-dc368db1c624 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:30.761505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c3be9-b88b-4f70-a2fb-dc368db1c624 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:30.769290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ec048-c077-4af9-8a07-9c12094fad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:30.769859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ec048-c077-4af9-8a07-9c12094fad70 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:30.770147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ec048-c077-4af9-8a07-9c12094fad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:30.771577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ec048-c077-4af9-8a07-9c12094fad70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:30.772487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ec048-c077-4af9-8a07-9c12094fad70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:30.774538 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ec048-c077-4af9-8a07-9c12094fad70 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:30.792104 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 817/1644] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:30.795375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ec048-c077-4af9-8a07-9c12094fad70 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:30.801083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86d595-4030-41e4-84c6-0fb659fb1cf8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:30.811694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ec048-c077-4af9-8a07-9c12094fad70 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:30.813933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c587a2-5121-45cd-a43e-90f24217d98b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:30.815400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c587a2-5121-45cd-a43e-90f24217d98b service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:30.815798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c587a2-5121-45cd-a43e-90f24217d98b service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:30.816224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c587a2-5121-45cd-a43e-90f24217d98b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:30.819536 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054631a0-9211-44fb-8ab0-fcb6d78534c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:30.820623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054631a0-9211-44fb-8ab0-fcb6d78534c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:30.820981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054631a0-9211-44fb-8ab0-fcb6d78534c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:30.821336 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054631a0-9211-44fb-8ab0-fcb6d78534c0 admin admin] PATH_INFO: `/v3/projects/e824b15bdb8d4906ad47b55009372e36/users/a168e168540f4d5d804df33435ec6508/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:30.843184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054631a0-9211-44fb-8ab0-fcb6d78534c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e824b15bdb8d4906ad47b55009372e36, user_id=a168e168540f4d5d804df33435ec6508, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:30.847925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054631a0-9211-44fb-8ab0-fcb6d78534c0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:30.871291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 818/1645] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:30 2022] PUT /identity/v3/projects/e824b15bdb8d4906ad47b55009372e36/users/a168e168540f4d5d804df33435ec6508/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:03:30.872590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054631a0-9211-44fb-8ab0-fcb6d78534c0 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:30.883900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:30.972504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c587a2-5121-45cd-a43e-90f24217d98b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:30.972883 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054631a0-9211-44fb-8ab0-fcb6d78534c0 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:30.975998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c587a2-5121-45cd-a43e-90f24217d98b service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:30.979916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cd9ab-dd1e-4bbc-87ba-58d3eb58a550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:30.981108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cd9ab-dd1e-4bbc-87ba-58d3eb58a550 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:30.982261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cd9ab-dd1e-4bbc-87ba-58d3eb58a550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:30.982786 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cd9ab-dd1e-4bbc-87ba-58d3eb58a550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:30.984600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cd9ab-dd1e-4bbc-87ba-58d3eb58a550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:30.988230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cd9ab-dd1e-4bbc-87ba-58d3eb58a550 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:30.992541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 828/1646] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:31.007408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 819/1647] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:31.015422 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c587a2-5121-45cd-a43e-90f24217d98b service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:31.043281 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c587a2-5121-45cd-a43e-90f24217d98b service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:31.056306 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21326eb-1f96-4367-998b-1721d102359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:31.057244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21326eb-1f96-4367-998b-1721d102359e admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:31.057605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21326eb-1f96-4367-998b-1721d102359e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:31.057983 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21326eb-1f96-4367-998b-1721d102359e admin admin] PATH_INFO: `/v3/projects/e824b15bdb8d4906ad47b55009372e36/users/a168e168540f4d5d804df33435ec6508/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:31.069530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21326eb-1f96-4367-998b-1721d102359e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e824b15bdb8d4906ad47b55009372e36, user_id=a168e168540f4d5d804df33435ec6508, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:31.076346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21326eb-1f96-4367-998b-1721d102359e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:31.099291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cd9ab-dd1e-4bbc-87ba-58d3eb58a550 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:31.117787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 829/1648] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:31 2022] PUT /identity/v3/projects/e824b15bdb8d4906ad47b55009372e36/users/a168e168540f4d5d804df33435ec6508/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:31.120623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f2ec5-fb5b-49c9-bb96-c2ad349792fc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:31.121219 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f2ec5-fb5b-49c9-bb96-c2ad349792fc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:31.121724 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f2ec5-fb5b-49c9-bb96-c2ad349792fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:31.171085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0d7f2ec5-fb5b-49c9-bb96-c2ad349792fc None None] MFA Rules not processed for user `a168e168540f4d5d804df33435ec6508`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:31.172946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0d7f2ec5-fb5b-49c9-bb96-c2ad349792fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:31.255392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cd9ab-dd1e-4bbc-87ba-58d3eb58a550 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:31.290742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:31.311060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 830/1649] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:31.369189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973c9f-cd7f-43e2-984f-f0b6defd06c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:31.370195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973c9f-cd7f-43e2-984f-f0b6defd06c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:31.370938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973c9f-cd7f-43e2-984f-f0b6defd06c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:31.371427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973c9f-cd7f-43e2-984f-f0b6defd06c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:31.391213 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f2ec5-fb5b-49c9-bb96-c2ad349792fc None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:31.418033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f2ec5-fb5b-49c9-bb96-c2ad349792fc None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:31.437844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cd8a9-ae3d-4a1d-b235-283cbd536cbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:31.438655 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cd8a9-ae3d-4a1d-b235-283cbd536cbd service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:31.439519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cd8a9-ae3d-4a1d-b235-283cbd536cbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:31.439975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cd8a9-ae3d-4a1d-b235-283cbd536cbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:31.579808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79cd8a9-ae3d-4a1d-b235-283cbd536cbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:31.581446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79cd8a9-ae3d-4a1d-b235-283cbd536cbd service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:31.595479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973c9f-cd7f-43e2-984f-f0b6defd06c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:31.601598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973c9f-cd7f-43e2-984f-f0b6defd06c4 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:31.626234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 831/1650] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:03:31.643676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 820/1651] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:03:31.808269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cd8a9-ae3d-4a1d-b235-283cbd536cbd service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:31.826734 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cd8a9-ae3d-4a1d-b235-283cbd536cbd service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:31.834951 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c8b02-bc75-40b6-9507-e15396626b62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:31.836134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c8b02-bc75-40b6-9507-e15396626b62 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:31.836650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c8b02-bc75-40b6-9507-e15396626b62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:31.837167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c8b02-bc75-40b6-9507-e15396626b62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:31.851121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c8b02-bc75-40b6-9507-e15396626b62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:31.852786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c8b02-bc75-40b6-9507-e15396626b62 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:31.881137 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 832/1652] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:32.081658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedcee9-e9f9-4f8a-a355-ad0573a503d2 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:32.082166 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedcee9-e9f9-4f8a-a355-ad0573a503d2 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:32.082463 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedcee9-e9f9-4f8a-a355-ad0573a503d2 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:32.085873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 821/1653] 10.222.0.30 () {54 vars in 962 bytes} [Wed Aug 10 08:03:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:32.098984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd02b7e-8b62-4fb2-a525-b9b6150bcd0e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:32.099360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd02b7e-8b62-4fb2-a525-b9b6150bcd0e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:32.099691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd02b7e-8b62-4fb2-a525-b9b6150bcd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:32.158632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5fd02b7e-8b62-4fb2-a525-b9b6150bcd0e None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:32.162228 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5fd02b7e-8b62-4fb2-a525-b9b6150bcd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:32.343834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 833/1654] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Aug 10 08:03:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:32.349769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79f1e8-4a00-41bf-be7a-2964f3b4fd48 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:32.350642 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79f1e8-4a00-41bf-be7a-2964f3b4fd48 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:32.351275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79f1e8-4a00-41bf-be7a-2964f3b4fd48 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:32.353339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 822/1655] 10.222.0.30 () {54 vars in 912 bytes} [Wed Aug 10 08:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:32.358674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecff466-0a06-4cda-b537-e89d65d6c646 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:32.359838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecff466-0a06-4cda-b537-e89d65d6c646 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:32.361436 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecff466-0a06-4cda-b537-e89d65d6c646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:32.438100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-eecff466-0a06-4cda-b537-e89d65d6c646 None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:32.445687 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-eecff466-0a06-4cda-b537-e89d65d6c646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:32.481485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 834/1656] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:03:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:32.563164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79f1e8-4a00-41bf-be7a-2964f3b4fd48 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:32.599579 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79f1e8-4a00-41bf-be7a-2964f3b4fd48 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:32.610472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dfcd0-516c-490f-ab6e-177819a342d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:32.611432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dfcd0-516c-490f-ab6e-177819a342d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:32.611859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dfcd0-516c-490f-ab6e-177819a342d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:32.612317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dfcd0-516c-490f-ab6e-177819a342d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:32.634112 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:32.637148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dfcd0-516c-490f-ab6e-177819a342d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:32.639555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dfcd0-516c-490f-ab6e-177819a342d6 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:32.686650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 823/1657] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:33.201316 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecff466-0a06-4cda-b537-e89d65d6c646 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:33.347312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dfcd0-516c-490f-ab6e-177819a342d6 service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:33.348086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecff466-0a06-4cda-b537-e89d65d6c646 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:33.351111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dfcd0-516c-490f-ab6e-177819a342d6 service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:33.355636 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989572b-21af-4901-84d8-db5f580ee774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:33.355922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:33.356624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989572b-21af-4901-84d8-db5f580ee774 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:33.356838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:33.357183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989572b-21af-4901-84d8-db5f580ee774 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:33.357283 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:33.357665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] PATH_INFO: `/v3/users/332a3133d2dd480fb25f0c83e14e0c6e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:33.357793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989572b-21af-4901-84d8-db5f580ee774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:33.361949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=332a3133d2dd480fb25f0c83e14e0c6e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:33.363066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:03:33.363066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Aug 10 08:03:33.363066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: Aug 10 08:03:33.371200 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:33.385024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:33.454942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989572b-21af-4901-84d8-db5f580ee774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:33.456864 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989572b-21af-4901-84d8-db5f580ee774 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:33.475894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 824/1658] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:33.538851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332a3133d2dd480fb25f0c83e14e0c6e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:33.558404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332a3133d2dd480fb25f0c83e14e0c6e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:33.590757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332a3133d2dd480fb25f0c83e14e0c6e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:33.592534 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332a3133d2dd480fb25f0c83e14e0c6e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:33.639579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332a3133d2dd480fb25f0c83e14e0c6e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:33.654780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 835/1659] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:03:33 2022] DELETE /identity/v3/users/332a3133d2dd480fb25f0c83e14e0c6e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:33.659801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d4bc3-f08c-4e25-8b89-4fbf2fea9bdd None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:33.660298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d4bc3-f08c-4e25-8b89-4fbf2fea9bdd None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:33.660713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d4bc3-f08c-4e25-8b89-4fbf2fea9bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:33.698852 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-147d4bc3-f08c-4e25-8b89-4fbf2fea9bdd None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:33.700539 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-147d4bc3-f08c-4e25-8b89-4fbf2fea9bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:33.858549 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 825/1660] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:33.897811 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:33.899670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:34.070349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f416633-4088-4533-aa3f-7f81cb48f3fa admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:34.075404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88655bdf-d45c-45e6-8745-fced999a48f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:34.076088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88655bdf-d45c-45e6-8745-fced999a48f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:34.076455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88655bdf-d45c-45e6-8745-fced999a48f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:34.076860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88655bdf-d45c-45e6-8745-fced999a48f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:34.100795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88655bdf-d45c-45e6-8745-fced999a48f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:34.102461 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88655bdf-d45c-45e6-8745-fced999a48f1 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:34.128600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 836/1661] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:35.720353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d4bc3-f08c-4e25-8b89-4fbf2fea9bdd None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:35.722660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-147d4bc3-f08c-4e25-8b89-4fbf2fea9bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:35.746776 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d4bc3-f08c-4e25-8b89-4fbf2fea9bdd None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:35.786480 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:35.791439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:35.791637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:35.794678 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] PATH_INFO: `/v3/projects/820c8f75ca22462386876962b77141fe` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:35.809234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=820c8f75ca22462386876962b77141fe)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:35.810294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: WARNING py.warnings [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:03:35.810294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: warnings.warn(msg) Aug 10 08:03:35.810294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: Aug 10 08:03:35.814439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:36.082402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820c8f75ca22462386876962b77141fe', 'request_id': 'req-792a9e57-7089-4450-a22b-3c4054c8ca48'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:36.097199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820c8f75ca22462386876962b77141fe', 'request_id': 'req-792a9e57-7089-4450-a22b-3c4054c8ca48'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:36.117122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820c8f75ca22462386876962b77141fe', 'request_id': 'req-792a9e57-7089-4450-a22b-3c4054c8ca48'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:36.155516 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] The token cache is being invalidate because project 820c8f75ca22462386876962b77141fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:03:36.155903 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:36.157834 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:36.163494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 826/1662] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:03:35 2022] DELETE /identity/v3/projects/820c8f75ca22462386876962b77141fe => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:36.176377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88655bdf-d45c-45e6-8745-fced999a48f1 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:36.193203 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88655bdf-d45c-45e6-8745-fced999a48f1 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:36.471252 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc32d3-b917-4478-9ad2-242f1e7a6f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:36.474236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc32d3-b917-4478-9ad2-242f1e7a6f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:36.474547 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc32d3-b917-4478-9ad2-242f1e7a6f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:36.475445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc32d3-b917-4478-9ad2-242f1e7a6f2c admin admin] PATH_INFO: `/v3/users/25b80e8db86a4694850aa26733e9f9d8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:36.478712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc32d3-b917-4478-9ad2-242f1e7a6f2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b80e8db86a4694850aa26733e9f9d8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:36.484469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc32d3-b917-4478-9ad2-242f1e7a6f2c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:36.633582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:36.684521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e5bc32d3-b917-4478-9ad2-242f1e7a6f2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b80e8db86a4694850aa26733e9f9d8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:36.727981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e5bc32d3-b917-4478-9ad2-242f1e7a6f2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b80e8db86a4694850aa26733e9f9d8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:36.752647 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e5bc32d3-b917-4478-9ad2-242f1e7a6f2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b80e8db86a4694850aa26733e9f9d8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:36.753678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e5bc32d3-b917-4478-9ad2-242f1e7a6f2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b80e8db86a4694850aa26733e9f9d8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:36.789174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e5bc32d3-b917-4478-9ad2-242f1e7a6f2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b80e8db86a4694850aa26733e9f9d8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:36.804400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 837/1663] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:03:36 2022] DELETE /identity/v3/users/25b80e8db86a4694850aa26733e9f9d8 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:37.817126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:37.819780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:37.859651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a9e57-7089-4450-a22b-3c4054c8ca48 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:37.915340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:38.104099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:38.105633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:38.105917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:38.106197 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] PATH_INFO: `/v3/users/d159a06cc5e74f53bc3990c07e6c32fc` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:38.109730 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d159a06cc5e74f53bc3990c07e6c32fc)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:38.114062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:38.302723 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd159a06cc5e74f53bc3990c07e6c32fc'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:38.331097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd159a06cc5e74f53bc3990c07e6c32fc'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:38.331932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd159a06cc5e74f53bc3990c07e6c32fc'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:38.332953 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd159a06cc5e74f53bc3990c07e6c32fc'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:38.368499 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd159a06cc5e74f53bc3990c07e6c32fc'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:38.398111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 827/1664] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:03:37 2022] DELETE /identity/v3/users/d159a06cc5e74f53bc3990c07e6c32fc => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:38.404388 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44794e-1056-4b08-ae31-d097ea8c5a2d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:38.404896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44794e-1056-4b08-ae31-d097ea8c5a2d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:38.405197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44794e-1056-4b08-ae31-d097ea8c5a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:38.445088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ce44794e-1056-4b08-ae31-d097ea8c5a2d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:38.446470 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ce44794e-1056-4b08-ae31-d097ea8c5a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:38.615181 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 838/1665] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:38.645293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:38.648062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:38.853628 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecbe24-d6c0-47a9-ba16-2d17976f1b0c admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:38.869668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a421b3-c28e-4c5d-aff0-ce5c539e0fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:38.870387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a421b3-c28e-4c5d-aff0-ce5c539e0fdf service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:38.870802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a421b3-c28e-4c5d-aff0-ce5c539e0fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:38.870945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a421b3-c28e-4c5d-aff0-ce5c539e0fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:38.884197 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a421b3-c28e-4c5d-aff0-ce5c539e0fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:38.887316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a421b3-c28e-4c5d-aff0-ce5c539e0fdf service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:38.960489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 828/1666] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:39.505831 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44794e-1056-4b08-ae31-d097ea8c5a2d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:39.508775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ce44794e-1056-4b08-ae31-d097ea8c5a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:39.704113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44794e-1056-4b08-ae31-d097ea8c5a2d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:39.713602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104915d-1c70-4d03-a69f-a9bbf84c8787 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:39.714416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104915d-1c70-4d03-a69f-a9bbf84c8787 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:39.714809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104915d-1c70-4d03-a69f-a9bbf84c8787 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:39.715194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104915d-1c70-4d03-a69f-a9bbf84c8787 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:39.718537 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3104915d-1c70-4d03-a69f-a9bbf84c8787 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:39.895801 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104915d-1c70-4d03-a69f-a9bbf84c8787 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:39.897384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104915d-1c70-4d03-a69f-a9bbf84c8787 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:39.916644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 839/1667] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:39.984770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947e018-13ce-475d-8866-a973010e6616 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:39.985562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947e018-13ce-475d-8866-a973010e6616 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:39.986960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947e018-13ce-475d-8866-a973010e6616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:40.033238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-a947e018-13ce-475d-8866-a973010e6616 None None] MFA Rules not processed for user `ee4d6facfb4249fd9ff38b7a59837d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:40.034709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a947e018-13ce-475d-8866-a973010e6616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:40.042224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104915d-1c70-4d03-a69f-a9bbf84c8787 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:40.044167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3104915d-1c70-4d03-a69f-a9bbf84c8787 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:40.092676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:40.127029 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104915d-1c70-4d03-a69f-a9bbf84c8787 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:40.144323 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:40.147466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:40.148435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:40.149904 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b admin admin] PATH_INFO: `/v3/projects/021a352a6cf04c33a8b1f8140a3b598e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:40.153321 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=021a352a6cf04c33a8b1f8140a3b598e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:40.164171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:40.179322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:40.278478 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 829/1668] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:40.283308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021a352a6cf04c33a8b1f8140a3b598e', 'request_id': 'req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:40.290947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021a352a6cf04c33a8b1f8140a3b598e', 'request_id': 'req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:40.293931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947e018-13ce-475d-8866-a973010e6616 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:40.295379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a947e018-13ce-475d-8866-a973010e6616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:40.339299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021a352a6cf04c33a8b1f8140a3b598e', 'request_id': 'req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:40.402349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b admin admin] The token cache is being invalidate because project 021a352a6cf04c33a8b1f8140a3b598e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:03:40.402686 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:40.412284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6e1ecc7d-99f1-40fc-b22c-489fddb96b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:40.424119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 840/1669] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:03:40 2022] DELETE /identity/v3/projects/021a352a6cf04c33a8b1f8140a3b598e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:40.430887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca12c0b-3cb7-4827-be95-e6c213423c88 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:40.431293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca12c0b-3cb7-4827-be95-e6c213423c88 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:40.431394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca12c0b-3cb7-4827-be95-e6c213423c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:40.502816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5ca12c0b-3cb7-4827-be95-e6c213423c88 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:40.506261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5ca12c0b-3cb7-4827-be95-e6c213423c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:40.602651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947e018-13ce-475d-8866-a973010e6616 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:40.712298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 841/1670] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:03:40.720570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4039329-13a3-49b7-a9b1-b32c32a4add8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:40.721138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4039329-13a3-49b7-a9b1-b32c32a4add8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:40.721599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4039329-13a3-49b7-a9b1-b32c32a4add8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:40.804643 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c4039329-13a3-49b7-a9b1-b32c32a4add8 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:40.806814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c4039329-13a3-49b7-a9b1-b32c32a4add8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:40.817433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92622f8-783d-4fca-97f2-35c3317fe05d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:40.818109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92622f8-783d-4fca-97f2-35c3317fe05d service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:40.818366 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92622f8-783d-4fca-97f2-35c3317fe05d service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:40.818633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92622f8-783d-4fca-97f2-35c3317fe05d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:40.820528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 842/1671] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:40.821664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4039329-13a3-49b7-a9b1-b32c32a4add8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:40.823336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c4039329-13a3-49b7-a9b1-b32c32a4add8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:40.830601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-c92622f8-783d-4fca-97f2-35c3317fe05d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:40.850427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4039329-13a3-49b7-a9b1-b32c32a4add8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:40.856779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:40.858457 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:40.859281 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:40.859789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] PATH_INFO: `/v3/projects/545c7b5da6674e78933d22ef3b186e95` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:40.862461 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=545c7b5da6674e78933d22ef3b186e95)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:40.864907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:40.975087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545c7b5da6674e78933d22ef3b186e95', 'request_id': 'req-d676851d-b624-4670-ae89-1ced9f90bb17'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:40.988666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545c7b5da6674e78933d22ef3b186e95', 'request_id': 'req-d676851d-b624-4670-ae89-1ced9f90bb17'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:40.999270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545c7b5da6674e78933d22ef3b186e95', 'request_id': 'req-d676851d-b624-4670-ae89-1ced9f90bb17'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:41.037110 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] The token cache is being invalidate because project 545c7b5da6674e78933d22ef3b186e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:03:41.038187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:41.039369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:41.047520 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 843/1672] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:03:40 2022] DELETE /identity/v3/projects/545c7b5da6674e78933d22ef3b186e95 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:41.055698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:41.061367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:41.079490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:41.111128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92622f8-783d-4fca-97f2-35c3317fe05d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:41.112787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92622f8-783d-4fca-97f2-35c3317fe05d service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:41.144161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 830/1673] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 851 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:03:41.146157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd68d7-98f8-4cac-a9cf-0286dca134bd None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.146414 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd68d7-98f8-4cac-a9cf-0286dca134bd None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.146688 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd68d7-98f8-4cac-a9cf-0286dca134bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.167646 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:41.193535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d0fd68d7-98f8-4cac-a9cf-0286dca134bd None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:41.196546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d0fd68d7-98f8-4cac-a9cf-0286dca134bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:41.260430 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676851d-b624-4670-ae89-1ced9f90bb17 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:41.281501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedc8fa-f225-4759-b895-8f6eacd3d73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:41.283019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc8fa-f225-4759-b895-8f6eacd3d73b admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.283501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc8fa-f225-4759-b895-8f6eacd3d73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.283784 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc8fa-f225-4759-b895-8f6eacd3d73b admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.285182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedc8fa-f225-4759-b895-8f6eacd3d73b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:03:41.285182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedc8fa-f225-4759-b895-8f6eacd3d73b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:41.289280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedc8fa-f225-4759-b895-8f6eacd3d73b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:41.323265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 844/1674] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:03:41.324278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedc8fa-f225-4759-b895-8f6eacd3d73b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:41.329645 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-feedc8fa-f225-4759-b895-8f6eacd3d73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:41.382387 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedc8fa-f225-4759-b895-8f6eacd3d73b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:41.400179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 831/1675] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:41.401157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd68d7-98f8-4cac-a9cf-0286dca134bd None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:41.409383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:41.410074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.411169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.411169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] PATH_INFO: `/v3/users/e2db0982bd8c4d01b2ee7e12f94ec67a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.414531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2db0982bd8c4d01b2ee7e12f94ec67a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:41.419860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:41.436363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd68d7-98f8-4cac-a9cf-0286dca134bd None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:41.462207 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea60ed5-79f8-4257-8957-b7fe15a088e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:41.463901 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60ed5-79f8-4257-8957-b7fe15a088e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.465944 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60ed5-79f8-4257-8957-b7fe15a088e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.466372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60ed5-79f8-4257-8957-b7fe15a088e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.467160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea60ed5-79f8-4257-8957-b7fe15a088e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:41.473004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea60ed5-79f8-4257-8957-b7fe15a088e4 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:41.545597 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2db0982bd8c4d01b2ee7e12f94ec67a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:41.556340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 832/1676] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:41 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:41.559041 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6659-d9d4-4f08-9437-a6ff6433eedf None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.560627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6659-d9d4-4f08-9437-a6ff6433eedf None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.564468 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2db0982bd8c4d01b2ee7e12f94ec67a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:41.564710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6659-d9d4-4f08-9437-a6ff6433eedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.581560 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2db0982bd8c4d01b2ee7e12f94ec67a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:41.582291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2db0982bd8c4d01b2ee7e12f94ec67a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:41.614344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2db0982bd8c4d01b2ee7e12f94ec67a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:41.619385 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-073b6659-d9d4-4f08-9437-a6ff6433eedf None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:41.621946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-073b6659-d9d4-4f08-9437-a6ff6433eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:41.630949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 845/1677] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:03:41 2022] DELETE /identity/v3/users/e2db0982bd8c4d01b2ee7e12f94ec67a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:41.632126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:41.635646 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:41.744521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 833/1678] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:41.747472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290d91c-5797-423a-8e8c-785b1d3091c8 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.747739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290d91c-5797-423a-8e8c-785b1d3091c8 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.748206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290d91c-5797-423a-8e8c-785b1d3091c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.778994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-0290d91c-5797-423a-8e8c-785b1d3091c8 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:41.781127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0290d91c-5797-423a-8e8c-785b1d3091c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:41.808882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624c887-28cf-47a5-acdf-0b79ea7dcdf7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:41.820439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917581ce-a554-4141-85a7-b6278ae9093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:41.821222 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917581ce-a554-4141-85a7-b6278ae9093d admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.821509 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917581ce-a554-4141-85a7-b6278ae9093d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.822040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917581ce-a554-4141-85a7-b6278ae9093d admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.822701 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917581ce-a554-4141-85a7-b6278ae9093d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:41.829578 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917581ce-a554-4141-85a7-b6278ae9093d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:41.872262 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:41.900257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 846/1679] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:41 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:41.901285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917581ce-a554-4141-85a7-b6278ae9093d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:41.935039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917581ce-a554-4141-85a7-b6278ae9093d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:41.948628 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 834/1680] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:41.956252 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290d91c-5797-423a-8e8c-785b1d3091c8 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:41.959988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7614e9-f79d-4bc0-aea7-2c9034d99d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:41.960629 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7614e9-f79d-4bc0-aea7-2c9034d99d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.960910 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7614e9-f79d-4bc0-aea7-2c9034d99d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.964762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7614e9-f79d-4bc0-aea7-2c9034d99d79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.965478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7614e9-f79d-4bc0-aea7-2c9034d99d79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:03:41.965790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7614e9-f79d-4bc0-aea7-2c9034d99d79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:41.969238 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7614e9-f79d-4bc0-aea7-2c9034d99d79 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:41.989036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290d91c-5797-423a-8e8c-785b1d3091c8 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:41.989036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea21f3e-f668-408c-ae8e-6cd6c8b3a396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:41.989036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea21f3e-f668-408c-ae8e-6cd6c8b3a396 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.989036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea21f3e-f668-408c-ae8e-6cd6c8b3a396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.989308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea21f3e-f668-408c-ae8e-6cd6c8b3a396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.989308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea21f3e-f668-408c-ae8e-6cd6c8b3a396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:41.991849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea21f3e-f668-408c-ae8e-6cd6c8b3a396 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:42.006322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 835/1681] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:42.010592 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea21f3e-f668-408c-ae8e-6cd6c8b3a396 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:42.019087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 847/1682] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:03:42.020510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7614e9-f79d-4bc0-aea7-2c9034d99d79 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:42.028731 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea21f3e-f668-408c-ae8e-6cd6c8b3a396 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:42.033873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdbac3-0fcc-4293-8222-0708c6cdd36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:42.034579 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdbac3-0fcc-4293-8222-0708c6cdd36f admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:42.035103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdbac3-0fcc-4293-8222-0708c6cdd36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:42.035777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdbac3-0fcc-4293-8222-0708c6cdd36f admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:42.036274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdbac3-0fcc-4293-8222-0708c6cdd36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:42.037957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdbac3-0fcc-4293-8222-0708c6cdd36f admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:42.053119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 836/1683] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:42.057459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdbac3-0fcc-4293-8222-0708c6cdd36f admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:42.062617 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7614e9-f79d-4bc0-aea7-2c9034d99d79 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:42.067170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:42.075238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdbac3-0fcc-4293-8222-0708c6cdd36f admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:42.079689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8d208-f113-4129-90e6-4858dce5549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:42.080509 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d208-f113-4129-90e6-4858dce5549e admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:42.080791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d208-f113-4129-90e6-4858dce5549e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:42.081064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d208-f113-4129-90e6-4858dce5549e admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:42.081698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8d208-f113-4129-90e6-4858dce5549e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:42.082481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b8144-fe82-498e-b4d0-bde22288d832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:42.083216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b8144-fe82-498e-b4d0-bde22288d832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:42.083512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b8144-fe82-498e-b4d0-bde22288d832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:42.083708 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8d208-f113-4129-90e6-4858dce5549e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:42.083927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b8144-fe82-498e-b4d0-bde22288d832 admin admin] PATH_INFO: `/v3/projects/41b5c483724d492299e6416d3a1fa47c/users/291f47a5bd234aaa96b179ce8a35d252/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:42.109812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b8144-fe82-498e-b4d0-bde22288d832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b5c483724d492299e6416d3a1fa47c, user_id=291f47a5bd234aaa96b179ce8a35d252, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:42.117741 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b8144-fe82-498e-b4d0-bde22288d832 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:42.147575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 837/1684] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:42 2022] PUT /identity/v3/projects/41b5c483724d492299e6416d3a1fa47c/users/291f47a5bd234aaa96b179ce8a35d252/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:03:42.158066 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b8144-fe82-498e-b4d0-bde22288d832 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:42.160564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 848/1685] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:42 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:42.162407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd658db-1ab9-4bf7-9618-49c9d329a0a5 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:42.162973 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd658db-1ab9-4bf7-9618-49c9d329a0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:42.163491 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd658db-1ab9-4bf7-9618-49c9d329a0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:42.164915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1a6b8144-fe82-498e-b4d0-bde22288d832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:42.214813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-bfd658db-1ab9-4bf7-9618-49c9d329a0a5 None None] MFA Rules not processed for user `291f47a5bd234aaa96b179ce8a35d252`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:42.217362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-bfd658db-1ab9-4bf7-9618-49c9d329a0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:42.303420 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b8144-fe82-498e-b4d0-bde22288d832 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:42.342744 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 849/1686] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:42.344818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd658db-1ab9-4bf7-9618-49c9d329a0a5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:42.451026 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd658db-1ab9-4bf7-9618-49c9d329a0a5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:42.459085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc7741-8c95-4f3d-b271-207231cfd5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:42.460169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc7741-8c95-4f3d-b271-207231cfd5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:42.462373 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc7741-8c95-4f3d-b271-207231cfd5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:42.463025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc7741-8c95-4f3d-b271-207231cfd5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:42.464099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc7741-8c95-4f3d-b271-207231cfd5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:42.466681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc7741-8c95-4f3d-b271-207231cfd5e8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:42.475271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4d44d-e279-4ba1-b2bb-6998f8c471c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:42.475981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4d44d-e279-4ba1-b2bb-6998f8c471c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:42.476269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4d44d-e279-4ba1-b2bb-6998f8c471c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:42.476548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4d44d-e279-4ba1-b2bb-6998f8c471c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:42.501656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 850/1687] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:42 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:42.503445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc7741-8c95-4f3d-b271-207231cfd5e8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:42.516498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc7741-8c95-4f3d-b271-207231cfd5e8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:42.525437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04288e36-82d0-4921-b956-b2a65cd26abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:42.526568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04288e36-82d0-4921-b956-b2a65cd26abd admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:42.527148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04288e36-82d0-4921-b956-b2a65cd26abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:42.527831 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04288e36-82d0-4921-b956-b2a65cd26abd admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:42.529063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04288e36-82d0-4921-b956-b2a65cd26abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:42.532018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04288e36-82d0-4921-b956-b2a65cd26abd admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:42.532185 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4d44d-e279-4ba1-b2bb-6998f8c471c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:42.537372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4d44d-e279-4ba1-b2bb-6998f8c471c0 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:42.580780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 838/1688] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:42.582835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4d44d-e279-4ba1-b2bb-6998f8c471c0 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:42.585313 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 851/1689] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:42 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:42.589424 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04288e36-82d0-4921-b956-b2a65cd26abd admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:42.622847 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4d44d-e279-4ba1-b2bb-6998f8c471c0 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:42.623663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:42.693529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04288e36-82d0-4921-b956-b2a65cd26abd admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:42.702086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a3c94-4482-4314-95a8-5be6b302ea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:42.704265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a3c94-4482-4314-95a8-5be6b302ea31 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:42.704850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a3c94-4482-4314-95a8-5be6b302ea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:42.705405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a3c94-4482-4314-95a8-5be6b302ea31 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:42.706423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a3c94-4482-4314-95a8-5be6b302ea31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:42.708848 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a3c94-4482-4314-95a8-5be6b302ea31 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:42.764222 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 852/1690] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:42 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:42.768564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a3c94-4482-4314-95a8-5be6b302ea31 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:42.784960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a3c94-4482-4314-95a8-5be6b302ea31 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:42.791357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463dbf4-b7f5-41ff-8591-07f66468a19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:42.792135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463dbf4-b7f5-41ff-8591-07f66468a19f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:42.793588 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463dbf4-b7f5-41ff-8591-07f66468a19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:42.793956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463dbf4-b7f5-41ff-8591-07f66468a19f admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:42.795294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463dbf4-b7f5-41ff-8591-07f66468a19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:42.797934 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463dbf4-b7f5-41ff-8591-07f66468a19f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:42.817128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 853/1691] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:42.820032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463dbf4-b7f5-41ff-8591-07f66468a19f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:42.821558 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe49aa6-7a9e-479d-ad04-d9ce2ab4250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:42.822182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe49aa6-7a9e-479d-ad04-d9ce2ab4250d admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:42.822407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe49aa6-7a9e-479d-ad04-d9ce2ab4250d admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:42.822684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe49aa6-7a9e-479d-ad04-d9ce2ab4250d admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:42.823338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe49aa6-7a9e-479d-ad04-d9ce2ab4250d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:42.825239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe49aa6-7a9e-479d-ad04-d9ce2ab4250d admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:42.836758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463dbf4-b7f5-41ff-8591-07f66468a19f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:42.844681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2ed19-c54c-46c4-9225-6f7709329d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:42.845871 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2ed19-c54c-46c4-9225-6f7709329d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:42.846814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2ed19-c54c-46c4-9225-6f7709329d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:42.847367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2ed19-c54c-46c4-9225-6f7709329d03 admin admin] PATH_INFO: `/v3/projects/b413e9fa3f474be885052571724f6543/users/40cc264bba8e47b9a3b64a10ee50df17/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:42.859501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 839/1692] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:42.860432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe49aa6-7a9e-479d-ad04-d9ce2ab4250d admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:42.862199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2fe49aa6-7a9e-479d-ad04-d9ce2ab4250d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:42.871781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2ed19-c54c-46c4-9225-6f7709329d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b413e9fa3f474be885052571724f6543, user_id=40cc264bba8e47b9a3b64a10ee50df17, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:42.875037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2ed19-c54c-46c4-9225-6f7709329d03 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:42.886219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe49aa6-7a9e-479d-ad04-d9ce2ab4250d admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:42.900759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 854/1693] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:42 2022] PUT /identity/v3/projects/b413e9fa3f474be885052571724f6543/users/40cc264bba8e47b9a3b64a10ee50df17/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:42.900759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2ed19-c54c-46c4-9225-6f7709329d03 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:42.901484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:42.902194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:42.902585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:42.903272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] PATH_INFO: `/v3/users/f045e4688602450ba9ee884023069ab9` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:42.906830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f045e4688602450ba9ee884023069ab9)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:42.909118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:42.980360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:43.011387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f045e4688602450ba9ee884023069ab9'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:43.019507 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2ed19-c54c-46c4-9225-6f7709329d03 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:43.028717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f045e4688602450ba9ee884023069ab9'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:43.029068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f045e4688602450ba9ee884023069ab9'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:43.029752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f045e4688602450ba9ee884023069ab9'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:43.031847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b24cd-8c77-4c7c-ba7d-38aa1d52ef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:43.034544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b24cd-8c77-4c7c-ba7d-38aa1d52ef8c admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:43.034544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b24cd-8c77-4c7c-ba7d-38aa1d52ef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:43.034544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b24cd-8c77-4c7c-ba7d-38aa1d52ef8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:43.034544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b24cd-8c77-4c7c-ba7d-38aa1d52ef8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:43.044427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b24cd-8c77-4c7c-ba7d-38aa1d52ef8c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:43.050672 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f045e4688602450ba9ee884023069ab9'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:43.076665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 855/1694] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:43.077676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b24cd-8c77-4c7c-ba7d-38aa1d52ef8c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:43.080501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0c0b24cd-8c77-4c7c-ba7d-38aa1d52ef8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:43.089329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 840/1695] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:03:42 2022] DELETE /identity/v3/users/f045e4688602450ba9ee884023069ab9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:43.090176 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:43.091624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:43.107601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b24cd-8c77-4c7c-ba7d-38aa1d52ef8c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:43.165084 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c397689-36bf-4646-a1ef-e3b706da604f admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:43.170781 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3104560-cb62-4548-9347-c66586010d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:43.171636 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3104560-cb62-4548-9347-c66586010d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:43.171963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3104560-cb62-4548-9347-c66586010d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:43.172242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3104560-cb62-4548-9347-c66586010d16 admin admin] PATH_INFO: `/v3/projects/273f2e2f959544c09a5de1c2874093af/users/e4b473c633d8401eadf3c020c78847ec/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:43.193176 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3104560-cb62-4548-9347-c66586010d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273f2e2f959544c09a5de1c2874093af, user_id=e4b473c633d8401eadf3c020c78847ec, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:43.198457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3104560-cb62-4548-9347-c66586010d16 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:43.253966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 841/1696] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:43 2022] PUT /identity/v3/projects/273f2e2f959544c09a5de1c2874093af/users/e4b473c633d8401eadf3c020c78847ec/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:43.255606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51aab-a7bf-45ac-83b1-018a99306f3f None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:43.255951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51aab-a7bf-45ac-83b1-018a99306f3f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:43.256231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51aab-a7bf-45ac-83b1-018a99306f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:43.288581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e9a51aab-a7bf-45ac-83b1-018a99306f3f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:43.289892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e9a51aab-a7bf-45ac-83b1-018a99306f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:43.293436 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1f510-cd49-4d8e-b844-5f810357b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:43.294846 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1f510-cd49-4d8e-b844-5f810357b375 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:43.294963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1f510-cd49-4d8e-b844-5f810357b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:43.295246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1f510-cd49-4d8e-b844-5f810357b375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:43.296840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1f510-cd49-4d8e-b844-5f810357b375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:43.299671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1f510-cd49-4d8e-b844-5f810357b375 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:43.329153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 856/1697] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:43.330636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d61845-069e-4965-b44e-076dc6e9c1bc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:43.330934 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d61845-069e-4965-b44e-076dc6e9c1bc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:43.331216 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d61845-069e-4965-b44e-076dc6e9c1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:43.367395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:43.402102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a7d61845-069e-4965-b44e-076dc6e9c1bc None None] MFA Rules not processed for user `e4b473c633d8401eadf3c020c78847ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:43.407200 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a7d61845-069e-4965-b44e-076dc6e9c1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:43.468091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 842/1698] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:43.469064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a51aab-a7bf-45ac-83b1-018a99306f3f None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:43.492692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a51aab-a7bf-45ac-83b1-018a99306f3f None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:43.508358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720366e0-89b2-4ee2-8fa4-d7ed3da811ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:43.509283 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720366e0-89b2-4ee2-8fa4-d7ed3da811ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:43.509574 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720366e0-89b2-4ee2-8fa4-d7ed3da811ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:43.509867 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720366e0-89b2-4ee2-8fa4-d7ed3da811ff admin admin] PATH_INFO: `/v3/projects/b413e9fa3f474be885052571724f6543/users/40cc264bba8e47b9a3b64a10ee50df17/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:43.516182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720366e0-89b2-4ee2-8fa4-d7ed3da811ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b413e9fa3f474be885052571724f6543, user_id=40cc264bba8e47b9a3b64a10ee50df17, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:43.519073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720366e0-89b2-4ee2-8fa4-d7ed3da811ff admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:43.556235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 843/1699] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:43 2022] PUT /identity/v3/projects/b413e9fa3f474be885052571724f6543/users/40cc264bba8e47b9a3b64a10ee50df17/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:43.558461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720366e0-89b2-4ee2-8fa4-d7ed3da811ff admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:43.566686 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-720366e0-89b2-4ee2-8fa4-d7ed3da811ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:43.615841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:43.638927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 857/1700] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:43.641011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7d660-753f-4cc5-bd4b-7c9da73387e2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:43.642072 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7d660-753f-4cc5-bd4b-7c9da73387e2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:43.643021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7d660-753f-4cc5-bd4b-7c9da73387e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:43.698676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d7a7d660-753f-4cc5-bd4b-7c9da73387e2 None None] MFA Rules not processed for user `40cc264bba8e47b9a3b64a10ee50df17`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:43.700306 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d7a7d660-753f-4cc5-bd4b-7c9da73387e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:43.729681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720366e0-89b2-4ee2-8fa4-d7ed3da811ff admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:43.735851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f0af8-052f-4b97-b4e0-b5ac01bc9f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:43.736562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f0af8-052f-4b97-b4e0-b5ac01bc9f3c service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:43.736860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f0af8-052f-4b97-b4e0-b5ac01bc9f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:43.737129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f0af8-052f-4b97-b4e0-b5ac01bc9f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:43.836475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f0af8-052f-4b97-b4e0-b5ac01bc9f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:43.838216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f0af8-052f-4b97-b4e0-b5ac01bc9f3c service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:43.849921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 844/1701] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:43.851048 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f0af8-052f-4b97-b4e0-b5ac01bc9f3c service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:43.863200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f0af8-052f-4b97-b4e0-b5ac01bc9f3c service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:43.869291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a630cb-c61d-4dbe-9442-41bea43cc35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:43.870137 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a630cb-c61d-4dbe-9442-41bea43cc35e admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:43.870588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a630cb-c61d-4dbe-9442-41bea43cc35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:43.871002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a630cb-c61d-4dbe-9442-41bea43cc35e admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:43.871841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a630cb-c61d-4dbe-9442-41bea43cc35e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:43.875183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a630cb-c61d-4dbe-9442-41bea43cc35e admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:43.927042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 845/1702] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:43 2022] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:43.927894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a630cb-c61d-4dbe-9442-41bea43cc35e admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:43.950952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 858/1703] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:43.972081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7d660-753f-4cc5-bd4b-7c9da73387e2 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:43.972081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d7a7d660-753f-4cc5-bd4b-7c9da73387e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:44.070505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a630cb-c61d-4dbe-9442-41bea43cc35e admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:44.076897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8e2d3-ebad-4c5b-9216-6ea9df22bf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:44.078476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8e2d3-ebad-4c5b-9216-6ea9df22bf09 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:44.078971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8e2d3-ebad-4c5b-9216-6ea9df22bf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:44.080250 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8e2d3-ebad-4c5b-9216-6ea9df22bf09 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:44.080999 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8e2d3-ebad-4c5b-9216-6ea9df22bf09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:44.084029 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8e2d3-ebad-4c5b-9216-6ea9df22bf09 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:44.090333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7d660-753f-4cc5-bd4b-7c9da73387e2 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:44.120843 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 846/1704] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:43 2022] POST /identity/v3/users => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:44.122529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acf89e-7b88-4443-97d5-c96f576f9c00 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:44.122828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acf89e-7b88-4443-97d5-c96f576f9c00 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:44.124267 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acf89e-7b88-4443-97d5-c96f576f9c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:44.185091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:44.218550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d375d-c658-448f-b3a0-21c4d6202387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:44.219297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d375d-c658-448f-b3a0-21c4d6202387 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:44.220349 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-83acf89e-7b88-4443-97d5-c96f576f9c00 None None] MFA Rules not processed for user `b42b1af0e32a41fba8712334c2acfbc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:44.221086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d375d-c658-448f-b3a0-21c4d6202387 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:44.221443 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d375d-c658-448f-b3a0-21c4d6202387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:44.223546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-83acf89e-7b88-4443-97d5-c96f576f9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:44.226803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-365d375d-c658-448f-b3a0-21c4d6202387 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:44.283607 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:44.368383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d375d-c658-448f-b3a0-21c4d6202387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:44.370540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d375d-c658-448f-b3a0-21c4d6202387 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:44.382077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 847/1705] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:44.383145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acf89e-7b88-4443-97d5-c96f576f9c00 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:44.385392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 859/1706] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:44.387034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d375d-c658-448f-b3a0-21c4d6202387 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:44.388671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-365d375d-c658-448f-b3a0-21c4d6202387 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:44.396542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acf89e-7b88-4443-97d5-c96f576f9c00 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:44.401429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cbeef-dab4-4628-916b-b9d1760c11d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:44.402270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cbeef-dab4-4628-916b-b9d1760c11d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:44.402702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cbeef-dab4-4628-916b-b9d1760c11d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:44.403118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cbeef-dab4-4628-916b-b9d1760c11d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:44.405311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cbeef-dab4-4628-916b-b9d1760c11d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:44.407680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cbeef-dab4-4628-916b-b9d1760c11d0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:44.407976 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d375d-c658-448f-b3a0-21c4d6202387 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:44.417787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:44.418836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:44.419284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:44.419635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] PATH_INFO: `/v3/projects/2d9343a3ddd846ec869e446415c9f90e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:44.421115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9343a3ddd846ec869e446415c9f90e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:44.425673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:44.425882 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 848/1707] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:44.427427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cbeef-dab4-4628-916b-b9d1760c11d0 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:44.429345 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-de7cbeef-dab4-4628-916b-b9d1760c11d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:44.536237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9343a3ddd846ec869e446415c9f90e', 'request_id': 'req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:44.554367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9343a3ddd846ec869e446415c9f90e', 'request_id': 'req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:44.566319 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9343a3ddd846ec869e446415c9f90e', 'request_id': 'req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:44.573907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cbeef-dab4-4628-916b-b9d1760c11d0 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:44.586114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] The token cache is being invalidate because project 2d9343a3ddd846ec869e446415c9f90e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:03:44.586564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:44.588340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:44.590714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 860/1708] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:03:44 2022] DELETE /identity/v3/projects/2d9343a3ddd846ec869e446415c9f90e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:44.593993 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:44.599038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:44.742947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15622b-9f84-4d90-bbb8-7c7c4cf438e7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:44.747906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351de6b6-b291-4e45-9eb7-b7c7e7b8305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:44.748685 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351de6b6-b291-4e45-9eb7-b7c7e7b8305d admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:44.750236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351de6b6-b291-4e45-9eb7-b7c7e7b8305d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:44.750819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351de6b6-b291-4e45-9eb7-b7c7e7b8305d admin admin] PATH_INFO: `/v3/projects/dabb67be914243a5b7731a544dfa50e3/users/9b97b22e32aa4e3d81e899b3c2aac06e/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:44.756674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978f595-50ae-41dd-9f2e-86f5e297a7c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:44.758113 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978f595-50ae-41dd-9f2e-86f5e297a7c9 service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:44.758622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978f595-50ae-41dd-9f2e-86f5e297a7c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:44.760316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978f595-50ae-41dd-9f2e-86f5e297a7c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:44.763931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-3978f595-50ae-41dd-9f2e-86f5e297a7c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:44.773090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351de6b6-b291-4e45-9eb7-b7c7e7b8305d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabb67be914243a5b7731a544dfa50e3, user_id=9b97b22e32aa4e3d81e899b3c2aac06e, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:44.775897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351de6b6-b291-4e45-9eb7-b7c7e7b8305d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:44.787181 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:44.806019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 861/1709] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:44 2022] PUT /identity/v3/projects/dabb67be914243a5b7731a544dfa50e3/users/9b97b22e32aa4e3d81e899b3c2aac06e/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:44.808431 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351de6b6-b291-4e45-9eb7-b7c7e7b8305d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:44.813232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-351de6b6-b291-4e45-9eb7-b7c7e7b8305d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:44.985604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:45.022061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351de6b6-b291-4e45-9eb7-b7c7e7b8305d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:45.033526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:45.034193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:45.034477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:45.034752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] PATH_INFO: `/v3/users/74964eb2a1014a98bfe24c947dfb25f8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:45.037742 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978f595-50ae-41dd-9f2e-86f5e297a7c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:45.040116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74964eb2a1014a98bfe24c947dfb25f8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:45.042075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:45.042820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978f595-50ae-41dd-9f2e-86f5e297a7c9 service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:45.065719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 849/1710] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:45.066636 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978f595-50ae-41dd-9f2e-86f5e297a7c9 service nova] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:45.089288 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978f595-50ae-41dd-9f2e-86f5e297a7c9 service nova] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:45.105091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3389189-d1a2-4a1b-8ae0-283be4eafe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:45.105734 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3389189-d1a2-4a1b-8ae0-283be4eafe46 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:45.106029 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3389189-d1a2-4a1b-8ae0-283be4eafe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:45.106309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3389189-d1a2-4a1b-8ae0-283be4eafe46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:45.106986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3389189-d1a2-4a1b-8ae0-283be4eafe46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:45.112369 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3389189-d1a2-4a1b-8ae0-283be4eafe46 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:45.146064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 850/1711] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:45.147825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3389189-d1a2-4a1b-8ae0-283be4eafe46 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:45.152470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d3389189-d1a2-4a1b-8ae0-283be4eafe46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:45.174683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74964eb2a1014a98bfe24c947dfb25f8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.184359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3389189-d1a2-4a1b-8ae0-283be4eafe46 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:45.191642 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74964eb2a1014a98bfe24c947dfb25f8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.202356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:45.203099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:45.203392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:45.203673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] PATH_INFO: `/v3/projects/abd1869819d24ead8fcd3b69168209f1` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:45.208678 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd1869819d24ead8fcd3b69168209f1)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:45.210631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:45.214187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74964eb2a1014a98bfe24c947dfb25f8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.215104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74964eb2a1014a98bfe24c947dfb25f8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.274966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74964eb2a1014a98bfe24c947dfb25f8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.310892 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 862/1712] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:03:44 2022] DELETE /identity/v3/users/74964eb2a1014a98bfe24c947dfb25f8 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:45.317175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:45.321466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:45.407402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd1869819d24ead8fcd3b69168209f1', 'request_id': 'req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.432535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd1869819d24ead8fcd3b69168209f1', 'request_id': 'req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.450339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd1869819d24ead8fcd3b69168209f1', 'request_id': 'req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.484529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] The token cache is being invalidate because project abd1869819d24ead8fcd3b69168209f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:03:45.485013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.487324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.495567 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 851/1713] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:03:45 2022] DELETE /identity/v3/projects/abd1869819d24ead8fcd3b69168209f1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:45.496629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:45.500456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:45.537244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b86aa1-46b6-49e3-9ca2-3a4e4f5b7652 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:45.600437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:45.695110 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77abfb-a889-46b1-8d46-c29ed0d0efdd admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:45.714809 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:45.716160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:45.716453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:45.716803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] PATH_INFO: `/v3/users/f5d81a1800704e4a85b30f47402eb27d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:45.718002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d81a1800704e4a85b30f47402eb27d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:45.720871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:45.733043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dcca9-f48d-42eb-87fc-a20ae5cdcfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:45.733945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dcca9-f48d-42eb-87fc-a20ae5cdcfd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:45.734272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dcca9-f48d-42eb-87fc-a20ae5cdcfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:45.734591 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dcca9-f48d-42eb-87fc-a20ae5cdcfd8 admin admin] PATH_INFO: `/v3/projects/dabb67be914243a5b7731a544dfa50e3/users/9b97b22e32aa4e3d81e899b3c2aac06e/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:45.741823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40dcca9-f48d-42eb-87fc-a20ae5cdcfd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabb67be914243a5b7731a544dfa50e3, user_id=9b97b22e32aa4e3d81e899b3c2aac06e, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:45.749070 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40dcca9-f48d-42eb-87fc-a20ae5cdcfd8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:45.801251 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 863/1714] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:45 2022] PUT /identity/v3/projects/dabb67be914243a5b7731a544dfa50e3/users/9b97b22e32aa4e3d81e899b3c2aac06e/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:45.813650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458fc68-61a1-4336-9e05-982658503fea None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:45.813943 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458fc68-61a1-4336-9e05-982658503fea None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:45.814219 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458fc68-61a1-4336-9e05-982658503fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:45.844379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d81a1800704e4a85b30f47402eb27d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.861963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d81a1800704e4a85b30f47402eb27d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.862870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d81a1800704e4a85b30f47402eb27d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.870406 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d81a1800704e4a85b30f47402eb27d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.880242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:45.890748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9458fc68-61a1-4336-9e05-982658503fea None None] MFA Rules not processed for user `9b97b22e32aa4e3d81e899b3c2aac06e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:45.892456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9458fc68-61a1-4336-9e05-982658503fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:45.901022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d81a1800704e4a85b30f47402eb27d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:45.938435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 852/1715] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:03:45 2022] DELETE /identity/v3/users/f5d81a1800704e4a85b30f47402eb27d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:46.080527 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:46.082214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:46.083925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 864/1716] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:45 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:03:46.241577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77b65-e564-4bc3-a9e3-cac66d779131 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:46.250511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbd070-51d2-42f7-beae-a8fcd581fb62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:46.251423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbd070-51d2-42f7-beae-a8fcd581fb62 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:46.252216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbd070-51d2-42f7-beae-a8fcd581fb62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:46.252593 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbd070-51d2-42f7-beae-a8fcd581fb62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:46.431539 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbd070-51d2-42f7-beae-a8fcd581fb62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:46.433182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbd070-51d2-42f7-beae-a8fcd581fb62 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:46.462486 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 853/1717] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:03:46.579168 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458fc68-61a1-4336-9e05-982658503fea None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:46.686008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458fc68-61a1-4336-9e05-982658503fea None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:46.694546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3767c5-c1a2-433f-92a8-39dfb642e959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:46.695549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3767c5-c1a2-433f-92a8-39dfb642e959 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:46.697966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3767c5-c1a2-433f-92a8-39dfb642e959 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:46.698277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3767c5-c1a2-433f-92a8-39dfb642e959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:46.702034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5f3767c5-c1a2-433f-92a8-39dfb642e959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:46.800139 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3767c5-c1a2-433f-92a8-39dfb642e959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:46.801970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3767c5-c1a2-433f-92a8-39dfb642e959 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:46.808204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:46.831086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 865/1718] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:47.629848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbd070-51d2-42f7-beae-a8fcd581fb62 service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:47.631237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-fecbd070-51d2-42f7-beae-a8fcd581fb62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:47.655357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbd070-51d2-42f7-beae-a8fcd581fb62 service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:47.660307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56315b9f-c952-47ea-9969-5cc666c884f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:47.660935 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315b9f-c952-47ea-9969-5cc666c884f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:47.661222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315b9f-c952-47ea-9969-5cc666c884f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:47.661493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315b9f-c952-47ea-9969-5cc666c884f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:47.665622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-56315b9f-c952-47ea-9969-5cc666c884f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:47.816514 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56315b9f-c952-47ea-9969-5cc666c884f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:47.817967 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56315b9f-c952-47ea-9969-5cc666c884f2 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:47.853741 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 854/1719] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:47.900528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10efd9c-196f-4b76-93a2-23e48776d0a7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:47.901384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10efd9c-196f-4b76-93a2-23e48776d0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:47.901824 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10efd9c-196f-4b76-93a2-23e48776d0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:47.947002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e10efd9c-196f-4b76-93a2-23e48776d0a7 None None] MFA Rules not processed for user `ee4d6facfb4249fd9ff38b7a59837d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:47.948344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e10efd9c-196f-4b76-93a2-23e48776d0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:48.009288 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfd31e-44c9-4d26-97a3-7c2412b27e58 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:48.009730 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfd31e-44c9-4d26-97a3-7c2412b27e58 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:48.009836 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfd31e-44c9-4d26-97a3-7c2412b27e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:48.113103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-06bfd31e-44c9-4d26-97a3-7c2412b27e58 None None] MFA Rules not processed for user `27fb790313bb48538af59998e949e2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:48.114360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-06bfd31e-44c9-4d26-97a3-7c2412b27e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:48.142154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:48.174637 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 866/1720] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:03:48.175887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10efd9c-196f-4b76-93a2-23e48776d0a7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:48.179276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e10efd9c-196f-4b76-93a2-23e48776d0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:48.360801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 855/1721] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:48.363878 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfd31e-44c9-4d26-97a3-7c2412b27e58 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:48.365440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-06bfd31e-44c9-4d26-97a3-7c2412b27e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:48.521505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10efd9c-196f-4b76-93a2-23e48776d0a7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:48.560547 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:48.561225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:48.561566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:48.561977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] PATH_INFO: `/v3/projects/2f2f5ce76a3e47ce83c072c551b7d643` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:48.568706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f2f5ce76a3e47ce83c072c551b7d643)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:48.570667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:48.675031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfd31e-44c9-4d26-97a3-7c2412b27e58 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:48.695212 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9b031-0e37-46b6-a417-075ab354e7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:48.697608 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9b031-0e37-46b6-a417-075ab354e7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:48.697786 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9b031-0e37-46b6-a417-075ab354e7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:48.699015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9b031-0e37-46b6-a417-075ab354e7a4 admin admin] PATH_INFO: `/v3/projects/ece1a437079d44c8a43862aaf4820333` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:48.704816 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9b031-0e37-46b6-a417-075ab354e7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece1a437079d44c8a43862aaf4820333)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:48.724844 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9b031-0e37-46b6-a417-075ab354e7a4 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:48.751411 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f2f5ce76a3e47ce83c072c551b7d643', 'request_id': 'req-4810dd55-d73f-4f78-b25e-82a14bb6880a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:48.767098 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f2f5ce76a3e47ce83c072c551b7d643', 'request_id': 'req-4810dd55-d73f-4f78-b25e-82a14bb6880a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:48.774269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f2f5ce76a3e47ce83c072c551b7d643', 'request_id': 'req-4810dd55-d73f-4f78-b25e-82a14bb6880a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:48.799467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] The token cache is being invalidate because project 2f2f5ce76a3e47ce83c072c551b7d643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:03:48.801381 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:48.803130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:48.808085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 867/1722] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:03:48 2022] DELETE /identity/v3/projects/2f2f5ce76a3e47ce83c072c551b7d643 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:48.809093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:48.812667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:48.879348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c6c9b031-0e37-46b6-a417-075ab354e7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece1a437079d44c8a43862aaf4820333', 'request_id': 'req-c6c9b031-0e37-46b6-a417-075ab354e7a4'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:48.900672 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c6c9b031-0e37-46b6-a417-075ab354e7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece1a437079d44c8a43862aaf4820333', 'request_id': 'req-c6c9b031-0e37-46b6-a417-075ab354e7a4'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:48.922887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:48.925117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c6c9b031-0e37-46b6-a417-075ab354e7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece1a437079d44c8a43862aaf4820333', 'request_id': 'req-c6c9b031-0e37-46b6-a417-075ab354e7a4'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:48.950795 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c6c9b031-0e37-46b6-a417-075ab354e7a4 admin admin] The token cache is being invalidate because project ece1a437079d44c8a43862aaf4820333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:03:48.951392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c6c9b031-0e37-46b6-a417-075ab354e7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:48.953239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c6c9b031-0e37-46b6-a417-075ab354e7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:48.964140 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 856/1723] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:03:48 2022] DELETE /identity/v3/projects/ece1a437079d44c8a43862aaf4820333 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:48.970645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a57285-7886-40e6-811d-536051ccbe3c None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:48.982693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a57285-7886-40e6-811d-536051ccbe3c None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:48.983153 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a57285-7886-40e6-811d-536051ccbe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:49.070638 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810dd55-d73f-4f78-b25e-82a14bb6880a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:49.078423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-48a57285-7886-40e6-811d-536051ccbe3c None None] MFA Rules not processed for user `d22ea25e8e5843b1be42ed4c58ab142b`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:49.079717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-48a57285-7886-40e6-811d-536051ccbe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:49.190716 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:49.241681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0394225-bc89-43ea-aaf2-667447112c59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:49.242320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0394225-bc89-43ea-aaf2-667447112c59 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:49.242607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0394225-bc89-43ea-aaf2-667447112c59 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:49.242885 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0394225-bc89-43ea-aaf2-667447112c59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:49.245409 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b0394225-bc89-43ea-aaf2-667447112c59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:49.309359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 857/1724] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:49.310334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a57285-7886-40e6-811d-536051ccbe3c None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:49.312317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-48a57285-7886-40e6-811d-536051ccbe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:49.419369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0394225-bc89-43ea-aaf2-667447112c59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:49.426925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0394225-bc89-43ea-aaf2-667447112c59 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:49.449057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 868/1725] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:49.454463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37003526-cf06-4695-8eb3-d113dd43638e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:49.456209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37003526-cf06-4695-8eb3-d113dd43638e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:49.456506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37003526-cf06-4695-8eb3-d113dd43638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:49.507370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a57285-7886-40e6-811d-536051ccbe3c None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:49.523413 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6bc4f-8b29-48c3-ae05-8ea14bab1b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:49.524092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6bc4f-8b29-48c3-ae05-8ea14bab1b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:49.525339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6bc4f-8b29-48c3-ae05-8ea14bab1b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:49.525339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6bc4f-8b29-48c3-ae05-8ea14bab1b46 admin admin] PATH_INFO: `/v3/users/a168e168540f4d5d804df33435ec6508` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:49.527128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-37003526-cf06-4695-8eb3-d113dd43638e None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:49.528454 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-37003526-cf06-4695-8eb3-d113dd43638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:49.529940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6bc4f-8b29-48c3-ae05-8ea14bab1b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a168e168540f4d5d804df33435ec6508)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:49.535465 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6bc4f-8b29-48c3-ae05-8ea14bab1b46 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:49.589225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 869/1726] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:49.598139 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055e574-c89a-4508-a8a2-b70a278438cb None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:49.598730 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055e574-c89a-4508-a8a2-b70a278438cb None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:49.599115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055e574-c89a-4508-a8a2-b70a278438cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:49.688209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b055e574-c89a-4508-a8a2-b70a278438cb None None] MFA Rules not processed for user `d22ea25e8e5843b1be42ed4c58ab142b`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:49.695265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b055e574-c89a-4508-a8a2-b70a278438cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:49.732255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 870/1727] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:49.737405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba342e1f-1d82-468e-970d-7218d738b266 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:49.737692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba342e1f-1d82-468e-970d-7218d738b266 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:49.737967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba342e1f-1d82-468e-970d-7218d738b266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:49.750136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5ba6bc4f-8b29-48c3-ae05-8ea14bab1b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a168e168540f4d5d804df33435ec6508'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:49.783574 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5ba6bc4f-8b29-48c3-ae05-8ea14bab1b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a168e168540f4d5d804df33435ec6508'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:49.785109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5ba6bc4f-8b29-48c3-ae05-8ea14bab1b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a168e168540f4d5d804df33435ec6508'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:49.786125 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5ba6bc4f-8b29-48c3-ae05-8ea14bab1b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a168e168540f4d5d804df33435ec6508'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:49.822804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ba342e1f-1d82-468e-970d-7218d738b266 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:49.828331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5ba6bc4f-8b29-48c3-ae05-8ea14bab1b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a168e168540f4d5d804df33435ec6508'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:49.831998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ba342e1f-1d82-468e-970d-7218d738b266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:49.846962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 871/1728] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:49.848166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba342e1f-1d82-468e-970d-7218d738b266 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:49.849790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ba342e1f-1d82-468e-970d-7218d738b266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:49.873327 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 858/1729] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:03:49 2022] DELETE /identity/v3/users/a168e168540f4d5d804df33435ec6508 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:49.876526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6bc4f-8b29-48c3-ae05-8ea14bab1b46 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:49.912141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba342e1f-1d82-468e-970d-7218d738b266 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:50.041238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:50.061537 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:50.079891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6bc4f-8b29-48c3-ae05-8ea14bab1b46 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:50.095170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0443df-a3b2-4550-89dc-57854355e8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:50.096489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0443df-a3b2-4550-89dc-57854355e8ab admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.096989 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0443df-a3b2-4550-89dc-57854355e8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.099186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0443df-a3b2-4550-89dc-57854355e8ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.100314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0443df-a3b2-4550-89dc-57854355e8ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:03:50.101211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0443df-a3b2-4550-89dc-57854355e8ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:50.104838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0443df-a3b2-4550-89dc-57854355e8ab admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:50.160015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee08739-d9a6-43e6-bcbd-9adf29b3e6e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:50.160648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08739-d9a6-43e6-bcbd-9adf29b3e6e9 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.160969 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08739-d9a6-43e6-bcbd-9adf29b3e6e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.161196 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08739-d9a6-43e6-bcbd-9adf29b3e6e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.162869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 859/1730] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:03:50.170458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80774129-70db-4bef-ace2-8bab04906d72 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.170776 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80774129-70db-4bef-ace2-8bab04906d72 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.171598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80774129-70db-4bef-ace2-8bab04906d72 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.190014 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 860/1731] 10.222.0.30 () {54 vars in 912 bytes} [Wed Aug 10 08:03:50 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:50.190966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80774129-70db-4bef-ace2-8bab04906d72 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:50.209813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2ee08739-d9a6-43e6-bcbd-9adf29b3e6e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:50.232058 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80774129-70db-4bef-ace2-8bab04906d72 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:50.242837 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abdfb7-1349-46c2-b560-994d41ddb3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:50.244317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abdfb7-1349-46c2-b560-994d41ddb3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.244603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abdfb7-1349-46c2-b560-994d41ddb3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.245186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abdfb7-1349-46c2-b560-994d41ddb3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.247760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abdfb7-1349-46c2-b560-994d41ddb3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:50.253075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abdfb7-1349-46c2-b560-994d41ddb3a6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:50.359634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 861/1732] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:50 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:50.361135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fbb4e-56f6-4362-8d43-c61d735c8c78 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.361430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fbb4e-56f6-4362-8d43-c61d735c8c78 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.361708 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fbb4e-56f6-4362-8d43-c61d735c8c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.426829 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee08739-d9a6-43e6-bcbd-9adf29b3e6e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:50.432626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee08739-d9a6-43e6-bcbd-9adf29b3e6e9 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:50.461988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 872/1733] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:50.466068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee08739-d9a6-43e6-bcbd-9adf29b3e6e9 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:50.499352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-c79fbb4e-56f6-4362-8d43-c61d735c8c78 None None] MFA Rules not processed for user `bb3537ce04d24347b155855d2e29cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:50.501754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-c79fbb4e-56f6-4362-8d43-c61d735c8c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:50.505188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee08739-d9a6-43e6-bcbd-9adf29b3e6e9 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:50.633801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 862/1734] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:03:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:50.685973 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1a53b-323b-40f6-8e9c-38c5286d56d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:50.687010 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1a53b-323b-40f6-8e9c-38c5286d56d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.687786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1a53b-323b-40f6-8e9c-38c5286d56d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.689483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fbb4e-56f6-4362-8d43-c61d735c8c78 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:50.691346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-c79fbb4e-56f6-4362-8d43-c61d735c8c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:50.700547 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1a53b-323b-40f6-8e9c-38c5286d56d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.701247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1a53b-323b-40f6-8e9c-38c5286d56d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:50.705047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1a53b-323b-40f6-8e9c-38c5286d56d2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:50.710401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fbb4e-56f6-4362-8d43-c61d735c8c78 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:50.719945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110f406-ec7b-4b51-b8e2-a33f392211e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:50.720593 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110f406-ec7b-4b51-b8e2-a33f392211e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.722344 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110f406-ec7b-4b51-b8e2-a33f392211e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.722627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110f406-ec7b-4b51-b8e2-a33f392211e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.743303 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110f406-ec7b-4b51-b8e2-a33f392211e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:50.750863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110f406-ec7b-4b51-b8e2-a33f392211e0 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:50.763250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 873/1735] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:50 2022] POST /identity/v3/users => generated 283 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:50.765867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1a53b-323b-40f6-8e9c-38c5286d56d2 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:50.777445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 863/1736] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:50.785479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1a53b-323b-40f6-8e9c-38c5286d56d2 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:50.790649 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e57352-efc2-44d9-a541-8645bf7118a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:50.791359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e57352-efc2-44d9-a541-8645bf7118a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.791631 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e57352-efc2-44d9-a541-8645bf7118a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.791941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e57352-efc2-44d9-a541-8645bf7118a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.792915 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e57352-efc2-44d9-a541-8645bf7118a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:50.795090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e57352-efc2-44d9-a541-8645bf7118a5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:50.810816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 874/1737] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:50.814994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110f406-ec7b-4b51-b8e2-a33f392211e0 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:50.830145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110f406-ec7b-4b51-b8e2-a33f392211e0 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:50.836184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6fee7-c83e-4852-a5b7-931e2209572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:50.836904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6fee7-c83e-4852-a5b7-931e2209572c admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.837260 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6fee7-c83e-4852-a5b7-931e2209572c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.837663 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6fee7-c83e-4852-a5b7-931e2209572c admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.838395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6fee7-c83e-4852-a5b7-931e2209572c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:50.840232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6fee7-c83e-4852-a5b7-931e2209572c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:50.859928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 864/1738] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:50.861616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e57352-efc2-44d9-a541-8645bf7118a5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:50.875506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e57352-efc2-44d9-a541-8645bf7118a5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:50.885880 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d007a-124d-440e-a4db-83208a9e1fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:50.887315 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d007a-124d-440e-a4db-83208a9e1fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.887866 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d007a-124d-440e-a4db-83208a9e1fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.888220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d007a-124d-440e-a4db-83208a9e1fa0 admin admin] PATH_INFO: `/v3/projects/26586a88a9b24a5588cd06c5fabf97a1/users/5ab17f41c81e4f82987c92a8d273ee63/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.932917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d007a-124d-440e-a4db-83208a9e1fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26586a88a9b24a5588cd06c5fabf97a1, user_id=5ab17f41c81e4f82987c92a8d273ee63, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:50.936532 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d007a-124d-440e-a4db-83208a9e1fa0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:50.961238 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 875/1739] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:50 2022] PUT /identity/v3/projects/26586a88a9b24a5588cd06c5fabf97a1/users/5ab17f41c81e4f82987c92a8d273ee63/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:50.972956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6e0f2-4dcf-4bd8-ac2d-4453b0617dd0 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.973736 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6e0f2-4dcf-4bd8-ac2d-4453b0617dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.974089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6e0f2-4dcf-4bd8-ac2d-4453b0617dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:51.033344 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d3d6e0f2-4dcf-4bd8-ac2d-4453b0617dd0 None None] MFA Rules not processed for user `5ab17f41c81e4f82987c92a8d273ee63`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:51.035194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d3d6e0f2-4dcf-4bd8-ac2d-4453b0617dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:51.222241 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 865/1740] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:51.229300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d007a-124d-440e-a4db-83208a9e1fa0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:51.301466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:51.328757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31194be-9560-414b-b81d-a9d4fdbdfc9f None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:51.328757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31194be-9560-414b-b81d-a9d4fdbdfc9f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:51.328940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31194be-9560-414b-b81d-a9d4fdbdfc9f None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:51.331094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 866/1741] 10.222.0.30 () {54 vars in 912 bytes} [Wed Aug 10 08:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:51.336374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845432-38a9-4a8d-b7ba-308c48ff6128 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:51.336664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845432-38a9-4a8d-b7ba-308c48ff6128 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:51.336946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845432-38a9-4a8d-b7ba-308c48ff6128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:51.348204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d007a-124d-440e-a4db-83208a9e1fa0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:51.374986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d2d23-e5ac-48dd-bba4-bcfee1e08a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:51.374986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d2d23-e5ac-48dd-bba4-bcfee1e08a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:51.374986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d2d23-e5ac-48dd-bba4-bcfee1e08a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:51.374986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d2d23-e5ac-48dd-bba4-bcfee1e08a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:51.375579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d2d23-e5ac-48dd-bba4-bcfee1e08a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:51.384608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d2d23-e5ac-48dd-bba4-bcfee1e08a3a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:51.407352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-98845432-38a9-4a8d-b7ba-308c48ff6128 None None] MFA Rules not processed for user `bb3537ce04d24347b155855d2e29cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:51.408542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-98845432-38a9-4a8d-b7ba-308c48ff6128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:51.461723 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 876/1742] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:51 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:51.469269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d2d23-e5ac-48dd-bba4-bcfee1e08a3a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:51.498414 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:51.612454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 867/1743] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:03:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:51.641278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845432-38a9-4a8d-b7ba-308c48ff6128 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:51.643071 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-98845432-38a9-4a8d-b7ba-308c48ff6128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:51.660162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845432-38a9-4a8d-b7ba-308c48ff6128 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:51.678444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d2d23-e5ac-48dd-bba4-bcfee1e08a3a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:51.695826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab4473-104a-4315-b9b0-b09baae3af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:51.697115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab4473-104a-4315-b9b0-b09baae3af0a admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:51.697404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab4473-104a-4315-b9b0-b09baae3af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:51.697680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab4473-104a-4315-b9b0-b09baae3af0a admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:51.701207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab4473-104a-4315-b9b0-b09baae3af0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:51.708586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab4473-104a-4315-b9b0-b09baae3af0a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:51.776160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 877/1744] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:51 2022] POST /identity/v3/users => generated 289 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:51.777504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d27fc0-5340-4e7c-8b3b-83e034cf33fe None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:51.777840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d27fc0-5340-4e7c-8b3b-83e034cf33fe None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:51.778063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d27fc0-5340-4e7c-8b3b-83e034cf33fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:51.823325 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-89d27fc0-5340-4e7c-8b3b-83e034cf33fe None None] MFA Rules not processed for user `b42b1af0e32a41fba8712334c2acfbc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:51.826926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-89d27fc0-5340-4e7c-8b3b-83e034cf33fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:51.828141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7f555-60d7-4e5b-890f-5e73f04d66ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:51.829387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7f555-60d7-4e5b-890f-5e73f04d66ef service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:51.829889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7f555-60d7-4e5b-890f-5e73f04d66ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:51.830365 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7f555-60d7-4e5b-890f-5e73f04d66ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:51.848353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7f555-60d7-4e5b-890f-5e73f04d66ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:51.850734 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7f555-60d7-4e5b-890f-5e73f04d66ef service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:51.885941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 868/1745] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:51.887261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7f555-60d7-4e5b-890f-5e73f04d66ef service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:51.942488 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7f555-60d7-4e5b-890f-5e73f04d66ef service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:51.961634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 878/1746] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:51.962920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d27fc0-5340-4e7c-8b3b-83e034cf33fe None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:51.964102 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e2dba-9f55-46e5-8439-869bfcde5dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:51.964734 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e2dba-9f55-46e5-8439-869bfcde5dde admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:51.965021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e2dba-9f55-46e5-8439-869bfcde5dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:51.965277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-89d27fc0-5340-4e7c-8b3b-83e034cf33fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:51.965396 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e2dba-9f55-46e5-8439-869bfcde5dde admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:51.965949 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e2dba-9f55-46e5-8439-869bfcde5dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:51.974216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e2dba-9f55-46e5-8439-869bfcde5dde admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:51.989820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d27fc0-5340-4e7c-8b3b-83e034cf33fe None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:51.996124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:51.997313 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:51.997828 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:51.998360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] PATH_INFO: `/v3/users/e4b473c633d8401eadf3c020c78847ec` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:52.000151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b473c633d8401eadf3c020c78847ec)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:52.002740 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:52.028746 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 869/1747] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:52.029766 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e2dba-9f55-46e5-8439-869bfcde5dde admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:52.036324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-195e2dba-9f55-46e5-8439-869bfcde5dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:52.080152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b473c633d8401eadf3c020c78847ec'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:52.091148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b473c633d8401eadf3c020c78847ec'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:52.094021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:52.106812 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b473c633d8401eadf3c020c78847ec'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:52.108166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b473c633d8401eadf3c020c78847ec'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:52.125843 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e2dba-9f55-46e5-8439-869bfcde5dde admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:52.137730 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b473c633d8401eadf3c020c78847ec'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:52.146066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 879/1748] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:03:51 2022] DELETE /identity/v3/users/e4b473c633d8401eadf3c020c78847ec => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:52.147316 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:52.147787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f502fc-60b3-49f4-bfa7-71acca83daa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:52.149359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:52.150599 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f502fc-60b3-49f4-bfa7-71acca83daa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:52.150899 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f502fc-60b3-49f4-bfa7-71acca83daa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:52.154242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f502fc-60b3-49f4-bfa7-71acca83daa6 admin admin] PATH_INFO: `/v3/projects/e824b15bdb8d4906ad47b55009372e36` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:52.157774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f502fc-60b3-49f4-bfa7-71acca83daa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e824b15bdb8d4906ad47b55009372e36)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:52.163443 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f502fc-60b3-49f4-bfa7-71acca83daa6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:52.245814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d8d3d-f6a5-4743-84cc-46e16f277ca9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:52.297261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-03f502fc-60b3-49f4-bfa7-71acca83daa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e824b15bdb8d4906ad47b55009372e36', 'request_id': 'req-03f502fc-60b3-49f4-bfa7-71acca83daa6'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:52.317028 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-03f502fc-60b3-49f4-bfa7-71acca83daa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e824b15bdb8d4906ad47b55009372e36', 'request_id': 'req-03f502fc-60b3-49f4-bfa7-71acca83daa6'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:52.329673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-03f502fc-60b3-49f4-bfa7-71acca83daa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e824b15bdb8d4906ad47b55009372e36', 'request_id': 'req-03f502fc-60b3-49f4-bfa7-71acca83daa6'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:52.330367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2c009-5a0e-4d0f-a64a-ba0c689cf2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:52.331069 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2c009-5a0e-4d0f-a64a-ba0c689cf2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:52.331356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2c009-5a0e-4d0f-a64a-ba0c689cf2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:52.331634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2c009-5a0e-4d0f-a64a-ba0c689cf2e0 admin admin] PATH_INFO: `/v3/projects/b0d0c6be13ab4762a045f62033cf4b83/users/f4b8027fdb914298a98a5d9939f67ec1/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:52.356703 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-03f502fc-60b3-49f4-bfa7-71acca83daa6 admin admin] The token cache is being invalidate because project e824b15bdb8d4906ad47b55009372e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:03:52.356888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-03f502fc-60b3-49f4-bfa7-71acca83daa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:52.359565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-03f502fc-60b3-49f4-bfa7-71acca83daa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:52.363777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 870/1749] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:03:52 2022] DELETE /identity/v3/projects/e824b15bdb8d4906ad47b55009372e36 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:52.364846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e6d37-6df3-4d88-93c2-3907e07983b0 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:52.365139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e6d37-6df3-4d88-93c2-3907e07983b0 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:52.365418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e6d37-6df3-4d88-93c2-3907e07983b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:52.371750 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2c009-5a0e-4d0f-a64a-ba0c689cf2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d0c6be13ab4762a045f62033cf4b83, user_id=f4b8027fdb914298a98a5d9939f67ec1, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:52.375135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2c009-5a0e-4d0f-a64a-ba0c689cf2e0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:52.400676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 880/1750] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:52 2022] PUT /identity/v3/projects/b0d0c6be13ab4762a045f62033cf4b83/users/f4b8027fdb914298a98a5d9939f67ec1/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:52.407478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032022f0-413e-4302-9d5f-015a09154c3b None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:52.407790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032022f0-413e-4302-9d5f-015a09154c3b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:52.408084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032022f0-413e-4302-9d5f-015a09154c3b None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:52.411941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 881/1751] 10.222.0.30 () {54 vars in 961 bytes} [Wed Aug 10 08:03:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:52.414739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b841633-5dc8-4e97-987c-4adf816bd9d2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:52.414739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b841633-5dc8-4e97-987c-4adf816bd9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:52.415008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b841633-5dc8-4e97-987c-4adf816bd9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:52.415292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-264e6d37-6df3-4d88-93c2-3907e07983b0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:52.418248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-264e6d37-6df3-4d88-93c2-3907e07983b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:52.462295 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5b841633-5dc8-4e97-987c-4adf816bd9d2 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:52.463590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5b841633-5dc8-4e97-987c-4adf816bd9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:52.526688 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:52.571020 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 871/1752] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:52.572095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e6d37-6df3-4d88-93c2-3907e07983b0 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:52.574831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-264e6d37-6df3-4d88-93c2-3907e07983b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:52.609640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e6d37-6df3-4d88-93c2-3907e07983b0 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:52.625312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea42993-a4ef-4a21-9215-0e044c1001b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:52.625940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea42993-a4ef-4a21-9215-0e044c1001b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:52.626225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea42993-a4ef-4a21-9215-0e044c1001b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:52.626499 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea42993-a4ef-4a21-9215-0e044c1001b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:52.627161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea42993-a4ef-4a21-9215-0e044c1001b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:52.628819 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea42993-a4ef-4a21-9215-0e044c1001b6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:52.638415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 882/1753] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:52.639857 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4c73b-2fe2-44bf-8881-c41892a9ab7d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:52.640148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4c73b-2fe2-44bf-8881-c41892a9ab7d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:52.640429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4c73b-2fe2-44bf-8881-c41892a9ab7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:52.649517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:52.653414 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 872/1754] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:52.654415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea42993-a4ef-4a21-9215-0e044c1001b6 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:52.657900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-9ea42993-a4ef-4a21-9215-0e044c1001b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:52.683763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4ba4c73b-2fe2-44bf-8881-c41892a9ab7d None None] MFA Rules not processed for user `ccab7239a2474aa093e685d5da97f1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:52.686087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4ba4c73b-2fe2-44bf-8881-c41892a9ab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:52.844415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea42993-a4ef-4a21-9215-0e044c1001b6 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:52.851590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 883/1755] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Aug 10 08:03:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:52.852941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd07bc-93e6-4303-8571-ee3b9a04edb6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:52.853235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd07bc-93e6-4303-8571-ee3b9a04edb6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:52.853516 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd07bc-93e6-4303-8571-ee3b9a04edb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:52.861820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7b5f1-2283-4332-aaa6-5349082c4bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:52.862466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7b5f1-2283-4332-aaa6-5349082c4bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:52.862755 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7b5f1-2283-4332-aaa6-5349082c4bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:52.863032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7b5f1-2283-4332-aaa6-5349082c4bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:52.882739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7b5f1-2283-4332-aaa6-5349082c4bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:52.883463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c7dd07bc-93e6-4303-8571-ee3b9a04edb6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:52.884467 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7b5f1-2283-4332-aaa6-5349082c4bf3 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:52.884788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c7dd07bc-93e6-4303-8571-ee3b9a04edb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:52.907587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 873/1756] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:52.907764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 884/1757] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:52.908304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7b5f1-2283-4332-aaa6-5349082c4bf3 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:52.908581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd07bc-93e6-4303-8571-ee3b9a04edb6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:52.934583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd07bc-93e6-4303-8571-ee3b9a04edb6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:52.945896 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7b5f1-2283-4332-aaa6-5349082c4bf3 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:52.947345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623b2f7-ce39-4803-b5b0-3fd8011b9490 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccab7239a2474aa093e685d5da97f1a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:52.948610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623b2f7-ce39-4803-b5b0-3fd8011b9490 service placement] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:52.948610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623b2f7-ce39-4803-b5b0-3fd8011b9490 service placement] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:52.948816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623b2f7-ce39-4803-b5b0-3fd8011b9490 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:52.951567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e623b2f7-ce39-4803-b5b0-3fd8011b9490 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:52.952566 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b96f5-b3f1-4044-9e0a-570e278fb939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:52.953432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b96f5-b3f1-4044-9e0a-570e278fb939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:52.953872 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b96f5-b3f1-4044-9e0a-570e278fb939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:52.954339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b96f5-b3f1-4044-9e0a-570e278fb939 admin admin] PATH_INFO: `/v3/projects/b0d0c6be13ab4762a045f62033cf4b83/users/f4b8027fdb914298a98a5d9939f67ec1/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:52.958891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b96f5-b3f1-4044-9e0a-570e278fb939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d0c6be13ab4762a045f62033cf4b83, user_id=f4b8027fdb914298a98a5d9939f67ec1, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:52.962156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b96f5-b3f1-4044-9e0a-570e278fb939 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:52.966138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623b2f7-ce39-4803-b5b0-3fd8011b9490 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:52.967790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623b2f7-ce39-4803-b5b0-3fd8011b9490 service placement] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:52.980927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 885/1758] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:52.981868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623b2f7-ce39-4803-b5b0-3fd8011b9490 service placement] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:52.993685 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623b2f7-ce39-4803-b5b0-3fd8011b9490 service placement] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:52.999811 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 874/1759] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:52 2022] PUT /identity/v3/projects/b0d0c6be13ab4762a045f62033cf4b83/users/f4b8027fdb914298a98a5d9939f67ec1/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:53.011340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40d95-1f7e-413a-8219-8db4023c577c None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:53.013552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40d95-1f7e-413a-8219-8db4023c577c None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:53.013932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40d95-1f7e-413a-8219-8db4023c577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:53.080857 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe7c14-e83e-4d4f-a8d0-8a7ab04c4114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:53.081488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe7c14-e83e-4d4f-a8d0-8a7ab04c4114 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:53.084186 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe7c14-e83e-4d4f-a8d0-8a7ab04c4114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:53.084508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe7c14-e83e-4d4f-a8d0-8a7ab04c4114 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:53.085195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe7c14-e83e-4d4f-a8d0-8a7ab04c4114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:03:53.085504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe7c14-e83e-4d4f-a8d0-8a7ab04c4114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:53.087126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe7c14-e83e-4d4f-a8d0-8a7ab04c4114 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:53.126093 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-08d40d95-1f7e-413a-8219-8db4023c577c None None] MFA Rules not processed for user `f4b8027fdb914298a98a5d9939f67ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:53.129621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 886/1760] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:03:53.134299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe7c14-e83e-4d4f-a8d0-8a7ab04c4114 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:53.145435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-08d40d95-1f7e-413a-8219-8db4023c577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:53.164668 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe7c14-e83e-4d4f-a8d0-8a7ab04c4114 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:53.190345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d453c41-7544-4d93-81ef-d6541f1bf84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:53.190990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d453c41-7544-4d93-81ef-d6541f1bf84e admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:53.191274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d453c41-7544-4d93-81ef-d6541f1bf84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:53.191547 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d453c41-7544-4d93-81ef-d6541f1bf84e admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:53.192224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d453c41-7544-4d93-81ef-d6541f1bf84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:53.194136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d453c41-7544-4d93-81ef-d6541f1bf84e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:53.324232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 887/1761] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:53 2022] POST /identity/v3/projects => generated 389 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:03:53.328228 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d453c41-7544-4d93-81ef-d6541f1bf84e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:53.404889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 875/1762] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:53.425417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40d95-1f7e-413a-8219-8db4023c577c None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:53.429006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-08d40d95-1f7e-413a-8219-8db4023c577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:53.564568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:53.601444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d453c41-7544-4d93-81ef-d6541f1bf84e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:53.614799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf10eb-ee9d-4b17-94ef-7adfcea88966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:53.615392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf10eb-ee9d-4b17-94ef-7adfcea88966 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:53.616664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf10eb-ee9d-4b17-94ef-7adfcea88966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:53.616966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf10eb-ee9d-4b17-94ef-7adfcea88966 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:53.617617 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf10eb-ee9d-4b17-94ef-7adfcea88966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:53.619556 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf10eb-ee9d-4b17-94ef-7adfcea88966 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:53.690960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 888/1763] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:53 2022] POST /identity/v3/users => generated 295 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:53.692664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf10eb-ee9d-4b17-94ef-7adfcea88966 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:53.711666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40d95-1f7e-413a-8219-8db4023c577c None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:53.717647 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf10eb-ee9d-4b17-94ef-7adfcea88966 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:53.726906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:53.734370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78437467-95a9-48a1-806e-3515df191c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:53.735408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78437467-95a9-48a1-806e-3515df191c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:53.735408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78437467-95a9-48a1-806e-3515df191c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:53.736441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78437467-95a9-48a1-806e-3515df191c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:53.737119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78437467-95a9-48a1-806e-3515df191c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:53.739777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78437467-95a9-48a1-806e-3515df191c48 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:53.757887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 889/1764] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:53.758826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78437467-95a9-48a1-806e-3515df191c48 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:53.772650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78437467-95a9-48a1-806e-3515df191c48 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:53.779793 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979ff38-3432-4080-a229-a8590473c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:53.780547 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979ff38-3432-4080-a229-a8590473c311 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:53.780783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979ff38-3432-4080-a229-a8590473c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:53.782183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979ff38-3432-4080-a229-a8590473c311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:53.782861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979ff38-3432-4080-a229-a8590473c311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:53.785328 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979ff38-3432-4080-a229-a8590473c311 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:53.834973 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 890/1765] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:53.836114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979ff38-3432-4080-a229-a8590473c311 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:53.859148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979ff38-3432-4080-a229-a8590473c311 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:53.873588 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12522b5-7d63-4840-b6c6-d4a8451d0719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:53.875000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12522b5-7d63-4840-b6c6-d4a8451d0719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:53.875286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12522b5-7d63-4840-b6c6-d4a8451d0719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:53.875561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12522b5-7d63-4840-b6c6-d4a8451d0719 admin admin] PATH_INFO: `/v3/projects/5d34d0e85d74485aae11efaee699647e/users/bc038466ab9e4d0eb82fa0a7c8458637/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:53.916764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12522b5-7d63-4840-b6c6-d4a8451d0719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d34d0e85d74485aae11efaee699647e, user_id=bc038466ab9e4d0eb82fa0a7c8458637, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:53.919985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12522b5-7d63-4840-b6c6-d4a8451d0719 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:53.931924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d395ed-0341-423e-8d29-ad5dc148fed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:53.932629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d395ed-0341-423e-8d29-ad5dc148fed1 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:53.939603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d395ed-0341-423e-8d29-ad5dc148fed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:53.940162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d395ed-0341-423e-8d29-ad5dc148fed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:53.952335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 891/1766] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:53 2022] PUT /identity/v3/projects/5d34d0e85d74485aae11efaee699647e/users/bc038466ab9e4d0eb82fa0a7c8458637/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:53.953980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7e4f-f8ee-4a25-83b1-d9d0a31cf16d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:53.954502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7e4f-f8ee-4a25-83b1-d9d0a31cf16d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:53.955067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7e4f-f8ee-4a25-83b1-d9d0a31cf16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:54.000931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c81b7e4f-f8ee-4a25-83b1-d9d0a31cf16d None None] MFA Rules not processed for user `27fb790313bb48538af59998e949e2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:54.008968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c81b7e4f-f8ee-4a25-83b1-d9d0a31cf16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:54.094457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d395ed-0341-423e-8d29-ad5dc148fed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:54.096205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d395ed-0341-423e-8d29-ad5dc148fed1 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:54.135525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 876/1767] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:54.158266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074de25-b1fb-43e9-9a10-4e17b2177b42 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:54.158667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074de25-b1fb-43e9-9a10-4e17b2177b42 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:54.160054 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074de25-b1fb-43e9-9a10-4e17b2177b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:54.193361 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 892/1768] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:54.194542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b7e4f-f8ee-4a25-83b1-d9d0a31cf16d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:54.201548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c81b7e4f-f8ee-4a25-83b1-d9d0a31cf16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:54.348469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-3074de25-b1fb-43e9-9a10-4e17b2177b42 None None] MFA Rules not processed for user `bc038466ab9e4d0eb82fa0a7c8458637`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:54.349505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-3074de25-b1fb-43e9-9a10-4e17b2177b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:54.422309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b7e4f-f8ee-4a25-83b1-d9d0a31cf16d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:54.439892 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:54.440016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:54.441793 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:54.442132 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] PATH_INFO: `/v3/projects/273f2e2f959544c09a5de1c2874093af` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:54.466807 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] RBAC: Authorizing `identity:delete_project(project_id=273f2e2f959544c09a5de1c2874093af)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:54.470108 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:54.567019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:54.579585 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273f2e2f959544c09a5de1c2874093af', 'request_id': 'req-70fba292-328a-4638-9233-bd8b69fe798d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:54.584511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 877/1769] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:54.585514 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074de25-b1fb-43e9-9a10-4e17b2177b42 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:54.596295 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273f2e2f959544c09a5de1c2874093af', 'request_id': 'req-70fba292-328a-4638-9233-bd8b69fe798d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:54.613679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273f2e2f959544c09a5de1c2874093af', 'request_id': 'req-70fba292-328a-4638-9233-bd8b69fe798d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:54.636983 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] The token cache is being invalidate because project 273f2e2f959544c09a5de1c2874093af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:03:54.637284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:54.640630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:54.643079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 893/1770] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:03:54 2022] DELETE /identity/v3/projects/273f2e2f959544c09a5de1c2874093af => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:54.645941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:54.647378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:54.728228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:54.757348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074de25-b1fb-43e9-9a10-4e17b2177b42 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:54.952365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fba292-328a-4638-9233-bd8b69fe798d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:54.978861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da35b8-eb3c-4a6e-aa4c-5dcc6b32a3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:54.979508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da35b8-eb3c-4a6e-aa4c-5dcc6b32a3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:54.979834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da35b8-eb3c-4a6e-aa4c-5dcc6b32a3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:54.980108 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da35b8-eb3c-4a6e-aa4c-5dcc6b32a3c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:54.980745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da35b8-eb3c-4a6e-aa4c-5dcc6b32a3c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:55.021719 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da35b8-eb3c-4a6e-aa4c-5dcc6b32a3c8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:55.026777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bd690-05ca-48dc-9914-921331bb0c03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:55.027294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bd690-05ca-48dc-9914-921331bb0c03 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:55.027294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bd690-05ca-48dc-9914-921331bb0c03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:55.027446 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bd690-05ca-48dc-9914-921331bb0c03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:55.034386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-410bd690-05ca-48dc-9914-921331bb0c03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:55.142463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 894/1771] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:54 2022] POST /identity/v3/projects => generated 389 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:55.143844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da35b8-eb3c-4a6e-aa4c-5dcc6b32a3c8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:55.150469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-69da35b8-eb3c-4a6e-aa4c-5dcc6b32a3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:55.252561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bd690-05ca-48dc-9914-921331bb0c03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:55.256677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bd690-05ca-48dc-9914-921331bb0c03 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:55.278517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 878/1772] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:55.292295 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bd690-05ca-48dc-9914-921331bb0c03 service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:55.321947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da35b8-eb3c-4a6e-aa4c-5dcc6b32a3c8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:55.337239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bd690-05ca-48dc-9914-921331bb0c03 service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:55.338800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb44bb-6b97-4ffd-bc26-21c37ac74940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:55.339511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb44bb-6b97-4ffd-bc26-21c37ac74940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:55.339998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb44bb-6b97-4ffd-bc26-21c37ac74940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:55.340327 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb44bb-6b97-4ffd-bc26-21c37ac74940 admin admin] PATH_INFO: `/v3/users/9b97b22e32aa4e3d81e899b3c2aac06e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:55.344600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb44bb-6b97-4ffd-bc26-21c37ac74940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b97b22e32aa4e3d81e899b3c2aac06e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:55.348634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb44bb-6b97-4ffd-bc26-21c37ac74940 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:55.357790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e28dd6-5dba-496f-9da7-bb6455410238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:55.358969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e28dd6-5dba-496f-9da7-bb6455410238 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:55.359256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e28dd6-5dba-496f-9da7-bb6455410238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:55.359529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e28dd6-5dba-496f-9da7-bb6455410238 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:55.360198 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e28dd6-5dba-496f-9da7-bb6455410238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:55.362122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e28dd6-5dba-496f-9da7-bb6455410238 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:55.444858 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 879/1773] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:55 2022] POST /identity/v3/users => generated 301 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:55.446633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e28dd6-5dba-496f-9da7-bb6455410238 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:55.460533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d4bb44bb-6b97-4ffd-bc26-21c37ac74940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b97b22e32aa4e3d81e899b3c2aac06e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:55.473667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d4bb44bb-6b97-4ffd-bc26-21c37ac74940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b97b22e32aa4e3d81e899b3c2aac06e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:55.476786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:55.508177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e28dd6-5dba-496f-9da7-bb6455410238 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:55.524399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d4bb44bb-6b97-4ffd-bc26-21c37ac74940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b97b22e32aa4e3d81e899b3c2aac06e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:55.529146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d4bb44bb-6b97-4ffd-bc26-21c37ac74940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b97b22e32aa4e3d81e899b3c2aac06e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:55.538962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2bc1f-2b8a-4b91-8cf4-ed16f4bf5ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:55.540305 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2bc1f-2b8a-4b91-8cf4-ed16f4bf5ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:55.540694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2bc1f-2b8a-4b91-8cf4-ed16f4bf5ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:55.542343 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2bc1f-2b8a-4b91-8cf4-ed16f4bf5ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:55.543397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2bc1f-2b8a-4b91-8cf4-ed16f4bf5ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:55.555833 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2bc1f-2b8a-4b91-8cf4-ed16f4bf5ec9 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:55.595603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 880/1774] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:55.598037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2bc1f-2b8a-4b91-8cf4-ed16f4bf5ec9 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:55.600122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e3f2bc1f-2b8a-4b91-8cf4-ed16f4bf5ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:55.619662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2bc1f-2b8a-4b91-8cf4-ed16f4bf5ec9 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:55.625928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2616d1-1b4b-416a-b68f-00bf91a707d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:55.626615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2616d1-1b4b-416a-b68f-00bf91a707d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:55.626907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2616d1-1b4b-416a-b68f-00bf91a707d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:55.627179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2616d1-1b4b-416a-b68f-00bf91a707d9 admin admin] PATH_INFO: `/v3/projects/5133ac552e584b56ab39d0956482743f/users/64a45f348df84a4e9ebc84a7a3569d8b/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:55.630727 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d4bb44bb-6b97-4ffd-bc26-21c37ac74940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b97b22e32aa4e3d81e899b3c2aac06e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:55.649000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2616d1-1b4b-416a-b68f-00bf91a707d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5133ac552e584b56ab39d0956482743f, user_id=64a45f348df84a4e9ebc84a7a3569d8b, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:55.652950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2616d1-1b4b-416a-b68f-00bf91a707d9 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:55.679451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 895/1775] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:03:55 2022] DELETE /identity/v3/users/9b97b22e32aa4e3d81e899b3c2aac06e => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:55.706627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 881/1776] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:55 2022] PUT /identity/v3/projects/5133ac552e584b56ab39d0956482743f/users/64a45f348df84a4e9ebc84a7a3569d8b/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:55.711400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb44bb-6b97-4ffd-bc26-21c37ac74940 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:55.906203 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb44bb-6b97-4ffd-bc26-21c37ac74940 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:55.920337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0facad-be0b-4f4e-8f74-1c12f2b4fa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:55.921007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0facad-be0b-4f4e-8f74-1c12f2b4fa74 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:55.923416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0facad-be0b-4f4e-8f74-1c12f2b4fa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:55.923699 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0facad-be0b-4f4e-8f74-1c12f2b4fa74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:55.924458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0facad-be0b-4f4e-8f74-1c12f2b4fa74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:55.926381 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0facad-be0b-4f4e-8f74-1c12f2b4fa74 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:55.960394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 896/1777] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:55.961460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2616d1-1b4b-416a-b68f-00bf91a707d9 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:56.080823 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2616d1-1b4b-416a-b68f-00bf91a707d9 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:56.087619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a236c-c0d2-43ed-8ef5-7f66e15e3f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:56.088247 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a236c-c0d2-43ed-8ef5-7f66e15e3f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:56.088531 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a236c-c0d2-43ed-8ef5-7f66e15e3f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:56.088813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a236c-c0d2-43ed-8ef5-7f66e15e3f57 admin admin] PATH_INFO: `/v3/projects/5133ac552e584b56ab39d0956482743f/users/64a45f348df84a4e9ebc84a7a3569d8b/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:56.091438 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a236c-c0d2-43ed-8ef5-7f66e15e3f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5133ac552e584b56ab39d0956482743f, user_id=64a45f348df84a4e9ebc84a7a3569d8b, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:56.095700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a236c-c0d2-43ed-8ef5-7f66e15e3f57 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:56.104982 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:56.113398 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 882/1778] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:55 2022] PUT /identity/v3/projects/5133ac552e584b56ab39d0956482743f/users/64a45f348df84a4e9ebc84a7a3569d8b/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:56.128806 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c5109-dd1b-4a17-a184-e5a082c3430c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:56.129129 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c5109-dd1b-4a17-a184-e5a082c3430c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:56.129382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c5109-dd1b-4a17-a184-e5a082c3430c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:56.185204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a04c5109-dd1b-4a17-a184-e5a082c3430c None None] MFA Rules not processed for user `64a45f348df84a4e9ebc84a7a3569d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:56.186580 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a04c5109-dd1b-4a17-a184-e5a082c3430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:56.261171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a236c-c0d2-43ed-8ef5-7f66e15e3f57 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:56.263705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-688a236c-c0d2-43ed-8ef5-7f66e15e3f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:56.340995 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 897/1779] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:56 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:56.354365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c5109-dd1b-4a17-a184-e5a082c3430c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:56.361099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a04c5109-dd1b-4a17-a184-e5a082c3430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:56.422887 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a236c-c0d2-43ed-8ef5-7f66e15e3f57 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:56.433044 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:56.435173 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:56.435511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:56.435758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] PATH_INFO: `/v3/projects/dabb67be914243a5b7731a544dfa50e3` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:56.437752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dabb67be914243a5b7731a544dfa50e3)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:56.439861 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:56.454924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c5109-dd1b-4a17-a184-e5a082c3430c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:56.462556 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7b1af-58cf-48a2-a4ae-57670aee8f0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:56.463230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7b1af-58cf-48a2-a4ae-57670aee8f0f service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:56.463945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7b1af-58cf-48a2-a4ae-57670aee8f0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:56.463945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7b1af-58cf-48a2-a4ae-57670aee8f0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:56.486536 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7b1af-58cf-48a2-a4ae-57670aee8f0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:56.488158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7b1af-58cf-48a2-a4ae-57670aee8f0f service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:56.493480 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:56.509421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 898/1780] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:56 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:56.521825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dabb67be914243a5b7731a544dfa50e3', 'request_id': 'req-8676d382-15a2-41e0-850e-73a09525954b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:56.535060 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dabb67be914243a5b7731a544dfa50e3', 'request_id': 'req-8676d382-15a2-41e0-850e-73a09525954b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:56.545507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dabb67be914243a5b7731a544dfa50e3', 'request_id': 'req-8676d382-15a2-41e0-850e-73a09525954b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:56.565575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] The token cache is being invalidate because project dabb67be914243a5b7731a544dfa50e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:03:56.566193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:56.567122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:56.570729 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 883/1781] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:03:56 2022] DELETE /identity/v3/projects/dabb67be914243a5b7731a544dfa50e3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:03:56.575494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb48bea-dd41-4a78-9331-8df0519d138e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:56.575713 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb48bea-dd41-4a78-9331-8df0519d138e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:56.576067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb48bea-dd41-4a78-9331-8df0519d138e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:56.630220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8bb48bea-dd41-4a78-9331-8df0519d138e None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:56.631651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8bb48bea-dd41-4a78-9331-8df0519d138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:56.733994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:56.735383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:56.798980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 899/1782] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:03:56.807632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf89d0-a6df-443b-b3c3-4e1647f34f3b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:56.807948 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf89d0-a6df-443b-b3c3-4e1647f34f3b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:56.808238 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf89d0-a6df-443b-b3c3-4e1647f34f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:56.885635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6bcf89d0-a6df-443b-b3c3-4e1647f34f3b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:56.898300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6bcf89d0-a6df-443b-b3c3-4e1647f34f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:56.945343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 900/1783] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:56.945343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf89d0-a6df-443b-b3c3-4e1647f34f3b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:56.987941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf89d0-a6df-443b-b3c3-4e1647f34f3b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:56.990826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676d382-15a2-41e0-850e-73a09525954b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:57.011151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4bf5f-91c9-4f2d-80c6-31594d85e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:57.014232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edbe4b-67d8-4a1f-adc0-8dc00b156cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:57.017707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edbe4b-67d8-4a1f-adc0-8dc00b156cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:57.018000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edbe4b-67d8-4a1f-adc0-8dc00b156cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:57.018281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edbe4b-67d8-4a1f-adc0-8dc00b156cf2 admin admin] PATH_INFO: `/v3/users/bc038466ab9e4d0eb82fa0a7c8458637` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:57.019577 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4bf5f-91c9-4f2d-80c6-31594d85e3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:57.019942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4bf5f-91c9-4f2d-80c6-31594d85e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:57.020229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4bf5f-91c9-4f2d-80c6-31594d85e3a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:57.023949 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edbe4b-67d8-4a1f-adc0-8dc00b156cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc038466ab9e4d0eb82fa0a7c8458637)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:57.025157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4bf5f-91c9-4f2d-80c6-31594d85e3a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:03:57.025479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4bf5f-91c9-4f2d-80c6-31594d85e3a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:57.033393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edbe4b-67d8-4a1f-adc0-8dc00b156cf2 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:57.037399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4bf5f-91c9-4f2d-80c6-31594d85e3a9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:57.093620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 901/1784] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:03:57.095183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4bf5f-91c9-4f2d-80c6-31594d85e3a9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:57.121631 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4bf5f-91c9-4f2d-80c6-31594d85e3a9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:57.143080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691d4b8-19ca-4f95-a9b9-78001fa1ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:57.150741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691d4b8-19ca-4f95-a9b9-78001fa1ef2e admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:57.151187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691d4b8-19ca-4f95-a9b9-78001fa1ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:57.152190 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691d4b8-19ca-4f95-a9b9-78001fa1ef2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:57.158496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691d4b8-19ca-4f95-a9b9-78001fa1ef2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:57.161783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691d4b8-19ca-4f95-a9b9-78001fa1ef2e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:57.224161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:57.271406 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-25edbe4b-67d8-4a1f-adc0-8dc00b156cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc038466ab9e4d0eb82fa0a7c8458637'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:57.299370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-25edbe4b-67d8-4a1f-adc0-8dc00b156cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc038466ab9e4d0eb82fa0a7c8458637'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:57.300231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-25edbe4b-67d8-4a1f-adc0-8dc00b156cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc038466ab9e4d0eb82fa0a7c8458637'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:57.300905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-25edbe4b-67d8-4a1f-adc0-8dc00b156cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc038466ab9e4d0eb82fa0a7c8458637'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:57.330194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-25edbe4b-67d8-4a1f-adc0-8dc00b156cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc038466ab9e4d0eb82fa0a7c8458637'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:03:57.360792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 902/1785] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:57 2022] POST /identity/v3/projects => generated 401 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:57.364113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691d4b8-19ca-4f95-a9b9-78001fa1ef2e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:57.367036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9691d4b8-19ca-4f95-a9b9-78001fa1ef2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:57.396950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 884/1786] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:03:56 2022] DELETE /identity/v3/users/bc038466ab9e4d0eb82fa0a7c8458637 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:03:57.408537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090f8ea-587c-48db-8216-7c8549a00b12 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:57.410022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090f8ea-587c-48db-8216-7c8549a00b12 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:57.410471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090f8ea-587c-48db-8216-7c8549a00b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:57.467774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e090f8ea-587c-48db-8216-7c8549a00b12 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:57.469294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e090f8ea-587c-48db-8216-7c8549a00b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:57.604604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691d4b8-19ca-4f95-a9b9-78001fa1ef2e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:57.635866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 885/1787] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:57.635866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c527f-6319-43f2-b460-3dccf43132aa None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:57.635866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c527f-6319-43f2-b460-3dccf43132aa None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:57.635866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c527f-6319-43f2-b460-3dccf43132aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:57.767392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-c64c527f-6319-43f2-b460-3dccf43132aa None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:57.768905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-c64c527f-6319-43f2-b460-3dccf43132aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:57.874621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f9386-76a9-4ce4-9918-4b229c408f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:57.875266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f9386-76a9-4ce4-9918-4b229c408f47 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:57.875552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f9386-76a9-4ce4-9918-4b229c408f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:57.875874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f9386-76a9-4ce4-9918-4b229c408f47 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:57.876498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f9386-76a9-4ce4-9918-4b229c408f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:57.883601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f9386-76a9-4ce4-9918-4b229c408f47 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:57.921854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:57.945736 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 903/1788] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:57 2022] POST /identity/v3/users => generated 301 bytes in 579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:57.949152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f9386-76a9-4ce4-9918-4b229c408f47 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:57.958647 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fd6f9386-76a9-4ce4-9918-4b229c408f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:58.104459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 886/1789] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:03:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:58.105337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c527f-6319-43f2-b460-3dccf43132aa None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:58.133539 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c527f-6319-43f2-b460-3dccf43132aa None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:58.137190 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f9386-76a9-4ce4-9918-4b229c408f47 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:58.145305 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14765c-5e07-4b15-882c-edc9c9683c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:58.146223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14765c-5e07-4b15-882c-edc9c9683c62 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:58.146887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b418e58-61b9-4ffa-942f-16f39f9958e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:58.147505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b418e58-61b9-4ffa-942f-16f39f9958e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:58.147803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b418e58-61b9-4ffa-942f-16f39f9958e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:58.148562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14765c-5e07-4b15-882c-edc9c9683c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:58.149129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14765c-5e07-4b15-882c-edc9c9683c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:58.149921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14765c-5e07-4b15-882c-edc9c9683c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:58.150350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b418e58-61b9-4ffa-942f-16f39f9958e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:58.152232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14765c-5e07-4b15-882c-edc9c9683c62 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:58.172935 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b418e58-61b9-4ffa-942f-16f39f9958e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:58.176042 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b418e58-61b9-4ffa-942f-16f39f9958e6 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:58.182070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 887/1790] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:58.184192 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14765c-5e07-4b15-882c-edc9c9683c62 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:58.201649 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 904/1791] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:58.211835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14765c-5e07-4b15-882c-edc9c9683c62 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:58.226832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166d3a8-e693-417b-a27e-738abf5028b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:58.227705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166d3a8-e693-417b-a27e-738abf5028b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:58.227977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166d3a8-e693-417b-a27e-738abf5028b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:58.228192 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166d3a8-e693-417b-a27e-738abf5028b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:58.228854 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166d3a8-e693-417b-a27e-738abf5028b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:58.234520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166d3a8-e693-417b-a27e-738abf5028b0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:58.247144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:58.266460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 888/1792] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:58.271876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b418e58-61b9-4ffa-942f-16f39f9958e6 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:58.298036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b418e58-61b9-4ffa-942f-16f39f9958e6 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:58.340399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b67c0-e99e-44c7-b6ec-e08d594c144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:58.341326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b67c0-e99e-44c7-b6ec-e08d594c144b admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:58.341618 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b67c0-e99e-44c7-b6ec-e08d594c144b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:58.341892 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b67c0-e99e-44c7-b6ec-e08d594c144b admin admin] PATH_INFO: `/v3/projects/426f6e7767b7440fba84b4c2f68d400a/users/6858f2586a344ef188c076aee5ccf771/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:58.442797 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b67c0-e99e-44c7-b6ec-e08d594c144b admin admin] RBAC: Authorizing `identity:create_grant(project_id=426f6e7767b7440fba84b4c2f68d400a, user_id=6858f2586a344ef188c076aee5ccf771, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:58.453178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b67c0-e99e-44c7-b6ec-e08d594c144b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:58.499583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166d3a8-e693-417b-a27e-738abf5028b0 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:58.502547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f166d3a8-e693-417b-a27e-738abf5028b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:58.545347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 905/1793] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:58 2022] PUT /identity/v3/projects/426f6e7767b7440fba84b4c2f68d400a/users/6858f2586a344ef188c076aee5ccf771/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:58.557281 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badde3a-6cd6-4edf-86ce-ef273487cff0 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:58.557612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badde3a-6cd6-4edf-86ce-ef273487cff0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:58.557844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badde3a-6cd6-4edf-86ce-ef273487cff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:58.652312 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3badde3a-6cd6-4edf-86ce-ef273487cff0 None None] MFA Rules not processed for user `6858f2586a344ef188c076aee5ccf771`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:58.653808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3badde3a-6cd6-4edf-86ce-ef273487cff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:58.764976 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166d3a8-e693-417b-a27e-738abf5028b0 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:58.836550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 906/1794] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:03:58 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:03:58.837833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badde3a-6cd6-4edf-86ce-ef273487cff0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:58.899486 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edb26d-ca35-46fd-9da1-ae7e063f0735 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:58.900940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edb26d-ca35-46fd-9da1-ae7e063f0735 service swift] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:58.902871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edb26d-ca35-46fd-9da1-ae7e063f0735 service swift] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:58.903180 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edb26d-ca35-46fd-9da1-ae7e063f0735 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:59.043600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badde3a-6cd6-4edf-86ce-ef273487cff0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:59.047805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edb26d-ca35-46fd-9da1-ae7e063f0735 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:59.049931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edb26d-ca35-46fd-9da1-ae7e063f0735 service swift] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:59.071992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f2aa2-3bf5-4104-a633-dcfa720782f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:59.073414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f2aa2-3bf5-4104-a633-dcfa720782f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:59.073856 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f2aa2-3bf5-4104-a633-dcfa720782f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:59.075832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f2aa2-3bf5-4104-a633-dcfa720782f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:59.076660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f2aa2-3bf5-4104-a633-dcfa720782f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:59.078652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f2aa2-3bf5-4104-a633-dcfa720782f8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:59.078879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 889/1795] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:03:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 08:03:59.102029 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:59.154117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 907/1796] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:03:58 2022] POST /identity/v3/projects => generated 399 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:59.161311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edb26d-ca35-46fd-9da1-ae7e063f0735 service swift] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:59.199503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edb26d-ca35-46fd-9da1-ae7e063f0735 service swift] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:59.251590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:59.373019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5bf2e-4cf9-419b-b9d8-4ec06cc08765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:59.375504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5bf2e-4cf9-419b-b9d8-4ec06cc08765 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:59.376413 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5bf2e-4cf9-419b-b9d8-4ec06cc08765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:59.376702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5bf2e-4cf9-419b-b9d8-4ec06cc08765 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:59.379409 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5bf2e-4cf9-419b-b9d8-4ec06cc08765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:59.382700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5bf2e-4cf9-419b-b9d8-4ec06cc08765 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:59.435475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 890/1797] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:03:59 2022] POST /identity/v3/users => generated 306 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:03:59.440071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f2aa2-3bf5-4104-a633-dcfa720782f8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:59.453932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f2aa2-3bf5-4104-a633-dcfa720782f8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:59.478968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddae060-4980-43d1-87e1-ef1fb9d73a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:59.479604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddae060-4980-43d1-87e1-ef1fb9d73a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:59.479920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddae060-4980-43d1-87e1-ef1fb9d73a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:59.480185 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddae060-4980-43d1-87e1-ef1fb9d73a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:59.480840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddae060-4980-43d1-87e1-ef1fb9d73a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:59.482578 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddae060-4980-43d1-87e1-ef1fb9d73a8c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:59.584796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 908/1798] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:59.586349 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5bf2e-4cf9-419b-b9d8-4ec06cc08765 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:59.601729 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5bf2e-4cf9-419b-b9d8-4ec06cc08765 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:59.623790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb370b-cdfb-4201-95b6-2753c59c9edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:59.624550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb370b-cdfb-4201-95b6-2753c59c9edb admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:59.624838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb370b-cdfb-4201-95b6-2753c59c9edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:59.625121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb370b-cdfb-4201-95b6-2753c59c9edb admin admin] PATH_INFO: `/v3/projects/0dd8ca4fa8eb43259ec3c6f52457d1d9/users/3bcb0124269e4c7fb083fcd20d1de16e/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:59.685307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb370b-cdfb-4201-95b6-2753c59c9edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd8ca4fa8eb43259ec3c6f52457d1d9, user_id=3bcb0124269e4c7fb083fcd20d1de16e, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:59.700519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb370b-cdfb-4201-95b6-2753c59c9edb admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:59.750611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 891/1799] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:59 2022] PUT /identity/v3/projects/0dd8ca4fa8eb43259ec3c6f52457d1d9/users/3bcb0124269e4c7fb083fcd20d1de16e/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:03:59.754705 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddae060-4980-43d1-87e1-ef1fb9d73a8c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:59.770385 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddae060-4980-43d1-87e1-ef1fb9d73a8c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:59.788398 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb370b-cdfb-4201-95b6-2753c59c9edb admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:59.790963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-cebb370b-cdfb-4201-95b6-2753c59c9edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:59.952679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa22a3-fec3-47b2-bd5d-f06d9a68aec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:59.953769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa22a3-fec3-47b2-bd5d-f06d9a68aec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:59.954314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa22a3-fec3-47b2-bd5d-f06d9a68aec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:59.954737 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa22a3-fec3-47b2-bd5d-f06d9a68aec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:59.956153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa22a3-fec3-47b2-bd5d-f06d9a68aec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:59.958486 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa22a3-fec3-47b2-bd5d-f06d9a68aec3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:59.973724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb370b-cdfb-4201-95b6-2753c59c9edb admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:59.973921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 909/1800] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:03:59.978613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa22a3-fec3-47b2-bd5d-f06d9a68aec3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:59.986138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:59.987702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:59.992340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:59.994183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] PATH_INFO: `/v3/users/5ab17f41c81e4f82987c92a8d273ee63` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:59.999211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab17f41c81e4f82987c92a8d273ee63)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:00.017633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:00.034366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa22a3-fec3-47b2-bd5d-f06d9a68aec3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:00.052282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f42da-6916-495b-b587-062646ca70f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:00.054502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f42da-6916-495b-b587-062646ca70f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:00.056378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f42da-6916-495b-b587-062646ca70f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:00.057237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f42da-6916-495b-b587-062646ca70f3 admin admin] PATH_INFO: `/v3/projects/0dd8ca4fa8eb43259ec3c6f52457d1d9/users/3bcb0124269e4c7fb083fcd20d1de16e/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:00.065488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f42da-6916-495b-b587-062646ca70f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd8ca4fa8eb43259ec3c6f52457d1d9, user_id=3bcb0124269e4c7fb083fcd20d1de16e, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:00.071269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f42da-6916-495b-b587-062646ca70f3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:00.128979 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 910/1801] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:03:59 2022] PUT /identity/v3/projects/0dd8ca4fa8eb43259ec3c6f52457d1d9/users/3bcb0124269e4c7fb083fcd20d1de16e/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:00.140602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276d55f-f353-423b-9a57-ab88cc97835c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:00.140886 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276d55f-f353-423b-9a57-ab88cc97835c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:00.141209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276d55f-f353-423b-9a57-ab88cc97835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:00.207951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab17f41c81e4f82987c92a8d273ee63'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:00.235074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab17f41c81e4f82987c92a8d273ee63'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:00.241861 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab17f41c81e4f82987c92a8d273ee63'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:00.243224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab17f41c81e4f82987c92a8d273ee63'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:00.278960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2276d55f-f353-423b-9a57-ab88cc97835c None None] MFA Rules not processed for user `3bcb0124269e4c7fb083fcd20d1de16e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:00.279192 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab17f41c81e4f82987c92a8d273ee63'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:00.280945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2276d55f-f353-423b-9a57-ab88cc97835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:00.367303 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 892/1802] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:03:59 2022] DELETE /identity/v3/users/5ab17f41c81e4f82987c92a8d273ee63 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:00.370699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:00.380614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:00.424071 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:00.627298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 911/1803] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:00 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:04:00.629300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee373d-608c-493f-895a-085157df8829 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:00.629594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee373d-608c-493f-895a-085157df8829 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:00.629946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee373d-608c-493f-895a-085157df8829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:00.639022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e0578-412e-45bb-ac86-5cc576d13e76 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:00.663063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-efee373d-608c-493f-895a-085157df8829 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:00.663787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:00.665132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:00.665261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-efee373d-608c-493f-895a-085157df8829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:00.666103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:00.667092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] PATH_INFO: `/v3/projects/5d34d0e85d74485aae11efaee699647e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:00.670978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d34d0e85d74485aae11efaee699647e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:00.677646 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:00.694191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 912/1804] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:00.695244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee373d-608c-493f-895a-085157df8829 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:00.706637 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-efee373d-608c-493f-895a-085157df8829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:00.878356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d34d0e85d74485aae11efaee699647e', 'request_id': 'req-b9fc0dba-5024-45d0-9834-937bf35c9168'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:00.881671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:00.903927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d34d0e85d74485aae11efaee699647e', 'request_id': 'req-b9fc0dba-5024-45d0-9834-937bf35c9168'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:00.929491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d34d0e85d74485aae11efaee699647e', 'request_id': 'req-b9fc0dba-5024-45d0-9834-937bf35c9168'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:00.946037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee373d-608c-493f-895a-085157df8829 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:00.970504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] The token cache is being invalidate because project 5d34d0e85d74485aae11efaee699647e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:00.970798 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:00.973466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:00.976738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 893/1805] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:00 2022] DELETE /identity/v3/projects/5d34d0e85d74485aae11efaee699647e => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:00.977631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:00.985468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:01.097506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bbc02-ce49-4787-b54b-43b5ea8b1974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:01.098405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bbc02-ce49-4787-b54b-43b5ea8b1974 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:01.098753 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bbc02-ce49-4787-b54b-43b5ea8b1974 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:01.099117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bbc02-ce49-4787-b54b-43b5ea8b1974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:01.109743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e00bbc02-ce49-4787-b54b-43b5ea8b1974 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:01.204912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc0dba-5024-45d0-9834-937bf35c9168 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:01.218616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a52a1-687a-4ee4-a16e-25456ed2eaba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:01.219607 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a52a1-687a-4ee4-a16e-25456ed2eaba service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:01.219931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a52a1-687a-4ee4-a16e-25456ed2eaba service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:01.220215 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a52a1-687a-4ee4-a16e-25456ed2eaba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:01.223579 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-fc2a52a1-687a-4ee4-a16e-25456ed2eaba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:01.368461 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bbc02-ce49-4787-b54b-43b5ea8b1974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:01.371279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bbc02-ce49-4787-b54b-43b5ea8b1974 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:01.397685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:01.412780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 913/1806] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:01.413849 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bbc02-ce49-4787-b54b-43b5ea8b1974 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:01.421003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e00bbc02-ce49-4787-b54b-43b5ea8b1974 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:01.466665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a52a1-687a-4ee4-a16e-25456ed2eaba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:01.467318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bbc02-ce49-4787-b54b-43b5ea8b1974 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:01.468761 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a52a1-687a-4ee4-a16e-25456ed2eaba service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:01.480559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:01.481623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:01.483537 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:01.484167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] PATH_INFO: `/v3/users/64a45f348df84a4e9ebc84a7a3569d8b` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:01.489306 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=64a45f348df84a4e9ebc84a7a3569d8b)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:01.495867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:01.529350 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 894/1807] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:01.530588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a32350-9e66-42ee-8f7b-8ad90bc7273e None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:01.530868 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a32350-9e66-42ee-8f7b-8ad90bc7273e None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:01.531147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a32350-9e66-42ee-8f7b-8ad90bc7273e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:01.654825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e2a32350-9e66-42ee-8f7b-8ad90bc7273e None None] MFA Rules not processed for user `bb3537ce04d24347b155855d2e29cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:01.658094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e2a32350-9e66-42ee-8f7b-8ad90bc7273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:01.692752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 895/1808] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Aug 10 08:04:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:01.697418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a32350-9e66-42ee-8f7b-8ad90bc7273e None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:01.699006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e2a32350-9e66-42ee-8f7b-8ad90bc7273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:01.726270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64a45f348df84a4e9ebc84a7a3569d8b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:01.740730 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64a45f348df84a4e9ebc84a7a3569d8b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:01.754856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a32350-9e66-42ee-8f7b-8ad90bc7273e None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:01.756148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64a45f348df84a4e9ebc84a7a3569d8b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:01.757387 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64a45f348df84a4e9ebc84a7a3569d8b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:01.777254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e85db5-fbc1-4622-8858-884aa18b75df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:01.777987 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e85db5-fbc1-4622-8858-884aa18b75df service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:01.780956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e85db5-fbc1-4622-8858-884aa18b75df service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:01.781331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e85db5-fbc1-4622-8858-884aa18b75df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:01.783849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-12e85db5-fbc1-4622-8858-884aa18b75df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:01.821999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64a45f348df84a4e9ebc84a7a3569d8b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:01.862044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 914/1809] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:01 2022] DELETE /identity/v3/users/64a45f348df84a4e9ebc84a7a3569d8b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:02.013384 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e85db5-fbc1-4622-8858-884aa18b75df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:02.015178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e85db5-fbc1-4622-8858-884aa18b75df service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:02.065444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 896/1810] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:01 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:02.123562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:02.125150 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:02.192779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:02.348868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b2c70-8a89-4755-a2de-4962253aac0b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:02.361132 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e9613-7578-42f7-97e7-2295513fb410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:02.361758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e9613-7578-42f7-97e7-2295513fb410 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:02.362027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e9613-7578-42f7-97e7-2295513fb410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:02.362309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e9613-7578-42f7-97e7-2295513fb410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:02.375498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e23e9613-7578-42f7-97e7-2295513fb410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:02.393890 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e9613-7578-42f7-97e7-2295513fb410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:02.395356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e9613-7578-42f7-97e7-2295513fb410 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:02.418119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 915/1811] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:03.623629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e85db5-fbc1-4622-8858-884aa18b75df service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:03.625314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-12e85db5-fbc1-4622-8858-884aa18b75df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:03.649662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e85db5-fbc1-4622-8858-884aa18b75df service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:03.872599 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191b9cc-c057-4131-9268-3656e2d7c1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:03.873555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191b9cc-c057-4131-9268-3656e2d7c1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:03.874010 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191b9cc-c057-4131-9268-3656e2d7c1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:03.874437 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191b9cc-c057-4131-9268-3656e2d7c1c8 admin admin] PATH_INFO: `/v3/projects/26586a88a9b24a5588cd06c5fabf97a1` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:03.876497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191b9cc-c057-4131-9268-3656e2d7c1c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26586a88a9b24a5588cd06c5fabf97a1)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:03.881343 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191b9cc-c057-4131-9268-3656e2d7c1c8 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:04.021250 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1191b9cc-c057-4131-9268-3656e2d7c1c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26586a88a9b24a5588cd06c5fabf97a1', 'request_id': 'req-1191b9cc-c057-4131-9268-3656e2d7c1c8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:04.031864 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1191b9cc-c057-4131-9268-3656e2d7c1c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26586a88a9b24a5588cd06c5fabf97a1', 'request_id': 'req-1191b9cc-c057-4131-9268-3656e2d7c1c8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:04.040783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1191b9cc-c057-4131-9268-3656e2d7c1c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26586a88a9b24a5588cd06c5fabf97a1', 'request_id': 'req-1191b9cc-c057-4131-9268-3656e2d7c1c8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:04.065360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1191b9cc-c057-4131-9268-3656e2d7c1c8 admin admin] The token cache is being invalidate because project 26586a88a9b24a5588cd06c5fabf97a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:04.066127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1191b9cc-c057-4131-9268-3656e2d7c1c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:04.067328 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1191b9cc-c057-4131-9268-3656e2d7c1c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:04.071659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 897/1812] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:03 2022] DELETE /identity/v3/projects/26586a88a9b24a5588cd06c5fabf97a1 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:04.075784 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e9613-7578-42f7-97e7-2295513fb410 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:04.091134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e9613-7578-42f7-97e7-2295513fb410 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:04.174304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde540e4-2e05-4e6a-b04a-ea83f41a42af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:04.175132 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde540e4-2e05-4e6a-b04a-ea83f41a42af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:04.175483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde540e4-2e05-4e6a-b04a-ea83f41a42af admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:04.175904 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde540e4-2e05-4e6a-b04a-ea83f41a42af admin admin] PATH_INFO: `/v3/users/f4b8027fdb914298a98a5d9939f67ec1` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:04.179055 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde540e4-2e05-4e6a-b04a-ea83f41a42af admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b8027fdb914298a98a5d9939f67ec1)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:04.186689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde540e4-2e05-4e6a-b04a-ea83f41a42af admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:04.365683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cde540e4-2e05-4e6a-b04a-ea83f41a42af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b8027fdb914298a98a5d9939f67ec1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:04.383634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cde540e4-2e05-4e6a-b04a-ea83f41a42af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b8027fdb914298a98a5d9939f67ec1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:04.428509 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cde540e4-2e05-4e6a-b04a-ea83f41a42af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b8027fdb914298a98a5d9939f67ec1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:04.430347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cde540e4-2e05-4e6a-b04a-ea83f41a42af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b8027fdb914298a98a5d9939f67ec1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:04.470699 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cde540e4-2e05-4e6a-b04a-ea83f41a42af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b8027fdb914298a98a5d9939f67ec1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:04.483559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 916/1813] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:04 2022] DELETE /identity/v3/users/f4b8027fdb914298a98a5d9939f67ec1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:05.109222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2741b-29e0-4a63-b2f8-5b9777a3d6ca None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:05.109849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2741b-29e0-4a63-b2f8-5b9777a3d6ca None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:05.109952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2741b-29e0-4a63-b2f8-5b9777a3d6ca None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:05.112089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 898/1814] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 08:04:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:05.150593 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775580fd-68bd-42f5-aedc-3533dd550434 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:05.151767 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775580fd-68bd-42f5-aedc-3533dd550434 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:05.152355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775580fd-68bd-42f5-aedc-3533dd550434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:05.204305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-775580fd-68bd-42f5-aedc-3533dd550434 None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:05.208205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-775580fd-68bd-42f5-aedc-3533dd550434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:05.300059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:05.385180 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 917/1815] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 08:04:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:05.396827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2741b-29e0-4a63-b2f8-5b9777a3d6ca None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:05.399445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-cbd2741b-29e0-4a63-b2f8-5b9777a3d6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:05.430428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:05.580319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2741b-29e0-4a63-b2f8-5b9777a3d6ca None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:05.613258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:05.614221 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:05.614754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:05.619787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] PATH_INFO: `/v3/users/291f47a5bd234aaa96b179ce8a35d252` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:05.621915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=291f47a5bd234aaa96b179ce8a35d252)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:05.625421 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:05.708861 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '291f47a5bd234aaa96b179ce8a35d252'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:05.726730 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '291f47a5bd234aaa96b179ce8a35d252'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:05.727803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '291f47a5bd234aaa96b179ce8a35d252'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:05.728583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '291f47a5bd234aaa96b179ce8a35d252'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:05.768873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '291f47a5bd234aaa96b179ce8a35d252'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:05.809863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 899/1816] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:05 2022] DELETE /identity/v3/users/291f47a5bd234aaa96b179ce8a35d252 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:05.811686 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e34d5-d192-45ee-b805-74fcb0227043 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:05.812036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e34d5-d192-45ee-b805-74fcb0227043 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:05.812319 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e34d5-d192-45ee-b805-74fcb0227043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:05.877787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3b3e34d5-d192-45ee-b805-74fcb0227043 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:05.880519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3b3e34d5-d192-45ee-b805-74fcb0227043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:06.063072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:06.064636 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:06.105316 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 918/1817] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:06.214346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e34d5-d192-45ee-b805-74fcb0227043 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:06.216499 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3b3e34d5-d192-45ee-b805-74fcb0227043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:06.314619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04f107-986c-44b8-b99d-40ae765e1124 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:06.344591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ff32e-41b5-4cf0-9819-31827a9b662a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:06.346515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ff32e-41b5-4cf0-9819-31827a9b662a service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:06.346803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ff32e-41b5-4cf0-9819-31827a9b662a service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:06.348388 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ff32e-41b5-4cf0-9819-31827a9b662a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:06.352963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-535ff32e-41b5-4cf0-9819-31827a9b662a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:06.397574 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ff32e-41b5-4cf0-9819-31827a9b662a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:06.401002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ff32e-41b5-4cf0-9819-31827a9b662a service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:06.408942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e34d5-d192-45ee-b805-74fcb0227043 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:06.420731 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd361f09-fb2b-4b72-9dc8-26f8c254ea3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:06.422765 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd361f09-fb2b-4b72-9dc8-26f8c254ea3c service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:06.423128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd361f09-fb2b-4b72-9dc8-26f8c254ea3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:06.424409 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd361f09-fb2b-4b72-9dc8-26f8c254ea3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:06.472227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 900/1818] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:04:06.489733 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd361f09-fb2b-4b72-9dc8-26f8c254ea3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:06.499206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd361f09-fb2b-4b72-9dc8-26f8c254ea3c service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:06.544227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 919/1819] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:07.006444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ff32e-41b5-4cf0-9819-31827a9b662a service nova] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:07.009563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-535ff32e-41b5-4cf0-9819-31827a9b662a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:07.056009 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ff32e-41b5-4cf0-9819-31827a9b662a service nova] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:07.087772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:07.089427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:07.094517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:07.095352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] PATH_INFO: `/v3/projects/b0d0c6be13ab4762a045f62033cf4b83` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:07.099594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d0c6be13ab4762a045f62033cf4b83)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:07.107148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:07.138460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:07.257498 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d0c6be13ab4762a045f62033cf4b83', 'request_id': 'req-5a94234d-007a-48b9-9473-0afe6fcce957'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:07.264296 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d0c6be13ab4762a045f62033cf4b83', 'request_id': 'req-5a94234d-007a-48b9-9473-0afe6fcce957'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:07.272778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d0c6be13ab4762a045f62033cf4b83', 'request_id': 'req-5a94234d-007a-48b9-9473-0afe6fcce957'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:07.293115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] The token cache is being invalidate because project b0d0c6be13ab4762a045f62033cf4b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:07.293510 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:07.294290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:07.307088 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 901/1820] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:07 2022] DELETE /identity/v3/projects/b0d0c6be13ab4762a045f62033cf4b83 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:07.312596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815020d-6795-4865-a21f-666b853ebde0 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:07.313237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815020d-6795-4865-a21f-666b853ebde0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:07.313237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815020d-6795-4865-a21f-666b853ebde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:07.356975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2815020d-6795-4865-a21f-666b853ebde0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:07.358792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2815020d-6795-4865-a21f-666b853ebde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:07.426131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:07.430924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:07.534820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 920/1821] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:07.544722 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a7c65-4bf0-4eae-b721-9be3ad1547b4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:07.545011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a7c65-4bf0-4eae-b721-9be3ad1547b4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:07.545296 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a7c65-4bf0-4eae-b721-9be3ad1547b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:07.606032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a75a7c65-4bf0-4eae-b721-9be3ad1547b4 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:07.612043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a75a7c65-4bf0-4eae-b721-9be3ad1547b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:07.615577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94234d-007a-48b9-9473-0afe6fcce957 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:07.630213 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:07.630890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:07.631181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:07.631465 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da admin admin] PATH_INFO: `/v3/projects/5133ac552e584b56ab39d0956482743f` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:07.632790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5133ac552e584b56ab39d0956482743f)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:07.635112 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:07.653855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 921/1822] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:07.660774 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a7c65-4bf0-4eae-b721-9be3ad1547b4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:07.684703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a7c65-4bf0-4eae-b721-9be3ad1547b4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:07.714715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd97e2-7aa6-4f71-bbfa-840f0afef6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:07.715174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd97e2-7aa6-4f71-bbfa-840f0afef6de admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:07.718674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd97e2-7aa6-4f71-bbfa-840f0afef6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:07.718961 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd97e2-7aa6-4f71-bbfa-840f0afef6de admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:07.719654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd97e2-7aa6-4f71-bbfa-840f0afef6de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:07.720046 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd97e2-7aa6-4f71-bbfa-840f0afef6de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:07.728089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd97e2-7aa6-4f71-bbfa-840f0afef6de admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:07.729968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:07.792452 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5133ac552e584b56ab39d0956482743f', 'request_id': 'req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:07.799696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 922/1823] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:04:07.803093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd97e2-7aa6-4f71-bbfa-840f0afef6de admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:07.819265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5133ac552e584b56ab39d0956482743f', 'request_id': 'req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:07.832140 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5133ac552e584b56ab39d0956482743f', 'request_id': 'req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:07.839383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd97e2-7aa6-4f71-bbfa-840f0afef6de admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:07.874858 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da admin admin] The token cache is being invalidate because project 5133ac552e584b56ab39d0956482743f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:07.875309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:07.882231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d3fa1841-0c8e-42ae-9161-766bd5d3f6da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:07.884510 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 902/1824] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:07 2022] DELETE /identity/v3/projects/5133ac552e584b56ab39d0956482743f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:04:07.889769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e45d1c-e484-4aaf-8d4f-e37972356970 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:07.890162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e45d1c-e484-4aaf-8d4f-e37972356970 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:07.890548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e45d1c-e484-4aaf-8d4f-e37972356970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:07.924280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-84e45d1c-e484-4aaf-8d4f-e37972356970 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:07.932838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-84e45d1c-e484-4aaf-8d4f-e37972356970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:07.971865 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c732af-5a54-4d08-8518-b548a5904b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:07.972717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c732af-5a54-4d08-8518-b548a5904b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:07.973124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c732af-5a54-4d08-8518-b548a5904b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:07.973525 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c732af-5a54-4d08-8518-b548a5904b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:07.974299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c732af-5a54-4d08-8518-b548a5904b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:07.976628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c732af-5a54-4d08-8518-b548a5904b19 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:07.995208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:08.104252 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 923/1825] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:07 2022] POST /identity/v3/projects => generated 387 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:08.104252 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c732af-5a54-4d08-8518-b548a5904b19 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:08.109720 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-48c732af-5a54-4d08-8518-b548a5904b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:08.132063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 903/1826] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:08.133481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e45d1c-e484-4aaf-8d4f-e37972356970 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:08.137911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-84e45d1c-e484-4aaf-8d4f-e37972356970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:08.176171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e45d1c-e484-4aaf-8d4f-e37972356970 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:08.244074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c732af-5a54-4d08-8518-b548a5904b19 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:08.250394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27276d6-d5a4-4a41-9651-cd409d5ada55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:08.251484 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27276d6-d5a4-4a41-9651-cd409d5ada55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:08.252150 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27276d6-d5a4-4a41-9651-cd409d5ada55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:08.252505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27276d6-d5a4-4a41-9651-cd409d5ada55 admin admin] PATH_INFO: `/v3/users/6858f2586a344ef188c076aee5ccf771` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:08.253877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27276d6-d5a4-4a41-9651-cd409d5ada55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6858f2586a344ef188c076aee5ccf771)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:08.256456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27276d6-d5a4-4a41-9651-cd409d5ada55 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:08.308781 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b92790-e0db-4088-8eab-5a3b9ed2205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:08.309628 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b92790-e0db-4088-8eab-5a3b9ed2205e admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:08.309922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b92790-e0db-4088-8eab-5a3b9ed2205e admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:08.310201 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b92790-e0db-4088-8eab-5a3b9ed2205e admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:08.310990 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b92790-e0db-4088-8eab-5a3b9ed2205e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:08.313664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b92790-e0db-4088-8eab-5a3b9ed2205e admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:08.352228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 904/1827] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:08 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:08.354707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a1f12-a476-47b2-b195-05a3bdf30b13 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:08.355551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a1f12-a476-47b2-b195-05a3bdf30b13 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:08.356011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a1f12-a476-47b2-b195-05a3bdf30b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:08.356253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f27276d6-d5a4-4a41-9651-cd409d5ada55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6858f2586a344ef188c076aee5ccf771'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:08.381176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f27276d6-d5a4-4a41-9651-cd409d5ada55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6858f2586a344ef188c076aee5ccf771'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:08.404474 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f27276d6-d5a4-4a41-9651-cd409d5ada55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6858f2586a344ef188c076aee5ccf771'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:08.405984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f27276d6-d5a4-4a41-9651-cd409d5ada55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6858f2586a344ef188c076aee5ccf771'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:08.408828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-7a5a1f12-a476-47b2-b195-05a3bdf30b13 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:08.413625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7a5a1f12-a476-47b2-b195-05a3bdf30b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:08.434675 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f27276d6-d5a4-4a41-9651-cd409d5ada55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6858f2586a344ef188c076aee5ccf771'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:08.437365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:08.441153 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 905/1828] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:08.442096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a1f12-a476-47b2-b195-05a3bdf30b13 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:08.445544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 924/1829] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:08 2022] DELETE /identity/v3/users/6858f2586a344ef188c076aee5ccf771 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:08.446238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7a5a1f12-a476-47b2-b195-05a3bdf30b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:08.450707 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27276d6-d5a4-4a41-9651-cd409d5ada55 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:08.466680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a1f12-a476-47b2-b195-05a3bdf30b13 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:08.609557 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fc08f-917f-4eed-8179-544d1226a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:08.610342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27276d6-d5a4-4a41-9651-cd409d5ada55 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:08.616186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fc08f-917f-4eed-8179-544d1226a12b admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:08.617033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fc08f-917f-4eed-8179-544d1226a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:08.617033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fc08f-917f-4eed-8179-544d1226a12b admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:08.617597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fc08f-917f-4eed-8179-544d1226a12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:08.619539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419bab8-c632-4b29-b8e8-f289abb59485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:08.619869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fc08f-917f-4eed-8179-544d1226a12b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:08.620884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419bab8-c632-4b29-b8e8-f289abb59485 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:08.620884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419bab8-c632-4b29-b8e8-f289abb59485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:08.621486 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419bab8-c632-4b29-b8e8-f289abb59485 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:08.622593 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419bab8-c632-4b29-b8e8-f289abb59485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:08.622863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419bab8-c632-4b29-b8e8-f289abb59485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:08.626896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419bab8-c632-4b29-b8e8-f289abb59485 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:08.636698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 906/1830] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:08.636698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3cc37-e6cb-4fe4-8a75-4304565090e3 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:08.636698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3cc37-e6cb-4fe4-8a75-4304565090e3 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:08.636698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3cc37-e6cb-4fe4-8a75-4304565090e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:08.649974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 925/1831] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:04:08.651632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c361eb-4e52-443f-adc9-e6286f2e2875 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:08.652076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c361eb-4e52-443f-adc9-e6286f2e2875 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:08.652446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c361eb-4e52-443f-adc9-e6286f2e2875 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:08.655030 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 926/1832] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 08:04:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:08.655626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c361eb-4e52-443f-adc9-e6286f2e2875 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:08.663387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-8ee3cc37-e6cb-4fe4-8a75-4304565090e3 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:08.666231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8ee3cc37-e6cb-4fe4-8a75-4304565090e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:08.672650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c361eb-4e52-443f-adc9-e6286f2e2875 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:08.679359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff733e8-536e-4718-8bdb-711f03f5abed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:08.681205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff733e8-536e-4718-8bdb-711f03f5abed admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:08.681747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff733e8-536e-4718-8bdb-711f03f5abed admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:08.682130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff733e8-536e-4718-8bdb-711f03f5abed admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:08.682266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 907/1833] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:08.683045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff733e8-536e-4718-8bdb-711f03f5abed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:08.683255 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3cc37-e6cb-4fe4-8a75-4304565090e3 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:08.685090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff733e8-536e-4718-8bdb-711f03f5abed admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:08.695576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3cc37-e6cb-4fe4-8a75-4304565090e3 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:08.702393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da574b-66d3-43da-8052-58218788b612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:08.703020 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da574b-66d3-43da-8052-58218788b612 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:08.703307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da574b-66d3-43da-8052-58218788b612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:08.703577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da574b-66d3-43da-8052-58218788b612 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:08.704248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da574b-66d3-43da-8052-58218788b612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:08.706134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da574b-66d3-43da-8052-58218788b612 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:08.706992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 927/1834] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:08.708802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ab01a-1feb-45ce-86d5-d78458f03bbb None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:08.709199 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ab01a-1feb-45ce-86d5-d78458f03bbb None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:08.709575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ab01a-1feb-45ce-86d5-d78458f03bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:08.738963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f06ab01a-1feb-45ce-86d5-d78458f03bbb None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:08.740596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f06ab01a-1feb-45ce-86d5-d78458f03bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:08.785545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 908/1835] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:08 2022] POST /identity/v3/projects => generated 361 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:08.785545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da574b-66d3-43da-8052-58218788b612 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:08.901161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:08.982530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 928/1836] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 08:04:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:08.983561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ab01a-1feb-45ce-86d5-d78458f03bbb None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:09.003352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ab01a-1feb-45ce-86d5-d78458f03bbb None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:09.088955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da574b-66d3-43da-8052-58218788b612 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:09.106535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32980a5-e68c-42b4-92da-0b307b16a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:09.107535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32980a5-e68c-42b4-92da-0b307b16a0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:09.108762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32980a5-e68c-42b4-92da-0b307b16a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:09.109280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32980a5-e68c-42b4-92da-0b307b16a0c8 admin admin] PATH_INFO: `/v3/projects/0820b11df7704b49b154af94fcbffc34/users/dc85c640190a4888a6e6f5c1b8fe23b5/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:09.110612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b6353-be01-433c-9f93-f80fe87e1628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:09.111319 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b6353-be01-433c-9f93-f80fe87e1628 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:09.111627 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b6353-be01-433c-9f93-f80fe87e1628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:09.112065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b6353-be01-433c-9f93-f80fe87e1628 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:09.112587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b6353-be01-433c-9f93-f80fe87e1628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:09.114759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b6353-be01-433c-9f93-f80fe87e1628 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:09.143128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32980a5-e68c-42b4-92da-0b307b16a0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0820b11df7704b49b154af94fcbffc34, user_id=dc85c640190a4888a6e6f5c1b8fe23b5, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:09.146304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32980a5-e68c-42b4-92da-0b307b16a0c8 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:09.155172 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 929/1837] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:08 2022] POST /identity/v3/users => generated 281 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:09.158710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b6353-be01-433c-9f93-f80fe87e1628 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:09.162412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fb7b6353-be01-433c-9f93-f80fe87e1628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:09.166538 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 909/1838] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:08 2022] PUT /identity/v3/projects/0820b11df7704b49b154af94fcbffc34/users/dc85c640190a4888a6e6f5c1b8fe23b5/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:09.167257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32980a5-e68c-42b4-92da-0b307b16a0c8 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:09.179253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:09.291053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b6353-be01-433c-9f93-f80fe87e1628 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:09.296578 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32980a5-e68c-42b4-92da-0b307b16a0c8 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:09.307034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2796a7b-e05e-4f63-82bc-e82d5a8af15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:09.307841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2796a7b-e05e-4f63-82bc-e82d5a8af15b admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:09.308184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2796a7b-e05e-4f63-82bc-e82d5a8af15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:09.308556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2796a7b-e05e-4f63-82bc-e82d5a8af15b admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:09.309227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2796a7b-e05e-4f63-82bc-e82d5a8af15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:09.310830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2796a7b-e05e-4f63-82bc-e82d5a8af15b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:09.335831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 910/1839] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:09.337241 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bf4f2-d393-47e5-82e0-be5a46313475 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:09.337530 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bf4f2-d393-47e5-82e0-be5a46313475 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:09.337861 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bf4f2-d393-47e5-82e0-be5a46313475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:09.358808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7817a-3bda-43ce-bd98-9171fc7a419f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:09.359542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7817a-3bda-43ce-bd98-9171fc7a419f service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:09.359721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7817a-3bda-43ce-bd98-9171fc7a419f service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:09.360117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7817a-3bda-43ce-bd98-9171fc7a419f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:09.372673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7817a-3bda-43ce-bd98-9171fc7a419f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:09.374830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7817a-3bda-43ce-bd98-9171fc7a419f service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:09.379383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b68bf4f2-d393-47e5-82e0-be5a46313475 None None] MFA Rules not processed for user `dc85c640190a4888a6e6f5c1b8fe23b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:09.380882 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b68bf4f2-d393-47e5-82e0-be5a46313475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:09.388405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 930/1840] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:09.388960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7817a-3bda-43ce-bd98-9171fc7a419f service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:09.391150 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-80b7817a-3bda-43ce-bd98-9171fc7a419f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:09.483220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7817a-3bda-43ce-bd98-9171fc7a419f service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:09.490756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54575cc7-6bf1-41b5-9a44-84a664ea82b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:09.491623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54575cc7-6bf1-41b5-9a44-84a664ea82b3 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:09.492128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54575cc7-6bf1-41b5-9a44-84a664ea82b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:09.492412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54575cc7-6bf1-41b5-9a44-84a664ea82b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:09.505511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54575cc7-6bf1-41b5-9a44-84a664ea82b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:09.507291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54575cc7-6bf1-41b5-9a44-84a664ea82b3 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:09.523685 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 931/1841] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:09.525263 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54575cc7-6bf1-41b5-9a44-84a664ea82b3 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:09.538569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54575cc7-6bf1-41b5-9a44-84a664ea82b3 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:09.544946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eafcaa-05bf-4eb1-b0af-318e77ff1c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:09.545706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eafcaa-05bf-4eb1-b0af-318e77ff1c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:09.545990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eafcaa-05bf-4eb1-b0af-318e77ff1c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:09.546265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eafcaa-05bf-4eb1-b0af-318e77ff1c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:09.546927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eafcaa-05bf-4eb1-b0af-318e77ff1c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:09.548884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eafcaa-05bf-4eb1-b0af-318e77ff1c93 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:09.550143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 911/1842] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:09.555557 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bf4f2-d393-47e5-82e0-be5a46313475 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:09.569799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 932/1843] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:09.578819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eafcaa-05bf-4eb1-b0af-318e77ff1c93 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:09.600271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bf4f2-d393-47e5-82e0-be5a46313475 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:09.604354 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eafcaa-05bf-4eb1-b0af-318e77ff1c93 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:09.613906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf73fa3-5877-45b2-94a6-52c435d12a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:09.614465 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf73fa3-5877-45b2-94a6-52c435d12a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:09.614859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf73fa3-5877-45b2-94a6-52c435d12a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:09.615136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf73fa3-5877-45b2-94a6-52c435d12a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:09.617512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf73fa3-5877-45b2-94a6-52c435d12a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:09.621062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599707f-da93-4504-bd8d-df09ea3e3e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:09.621929 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599707f-da93-4504-bd8d-df09ea3e3e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:09.622439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599707f-da93-4504-bd8d-df09ea3e3e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:09.622831 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599707f-da93-4504-bd8d-df09ea3e3e6f admin admin] PATH_INFO: `/v3/projects/0d71218316f446ed8a2e701a40c6ee24/users/17f32fa4ed1245b3bb1439b1ccc6ed95/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:09.625014 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf73fa3-5877-45b2-94a6-52c435d12a23 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:09.663984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599707f-da93-4504-bd8d-df09ea3e3e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d71218316f446ed8a2e701a40c6ee24, user_id=17f32fa4ed1245b3bb1439b1ccc6ed95, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:09.672039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599707f-da93-4504-bd8d-df09ea3e3e6f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:09.698159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 912/1844] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:09 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:04:09.703023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf73fa3-5877-45b2-94a6-52c435d12a23 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:09.705980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 933/1845] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:09 2022] PUT /identity/v3/projects/0d71218316f446ed8a2e701a40c6ee24/users/17f32fa4ed1245b3bb1439b1ccc6ed95/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:09.720450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c5e8d-11ee-4ea7-a440-2f52fdd95ad4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:09.721441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c5e8d-11ee-4ea7-a440-2f52fdd95ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:09.731850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c5e8d-11ee-4ea7-a440-2f52fdd95ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:09.732624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:09.775575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:09.788058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e48c5e8d-11ee-4ea7-a440-2f52fdd95ad4 None None] MFA Rules not processed for user `17f32fa4ed1245b3bb1439b1ccc6ed95`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:09.790621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e48c5e8d-11ee-4ea7-a440-2f52fdd95ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:09.898556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf73fa3-5877-45b2-94a6-52c435d12a23 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:09.901816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 934/1846] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:09.930139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b5f55-b027-481b-8d63-2ba880eff651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:09.931259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b5f55-b027-481b-8d63-2ba880eff651 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:09.931460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b5f55-b027-481b-8d63-2ba880eff651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:09.931762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b5f55-b027-481b-8d63-2ba880eff651 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:09.932479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b5f55-b027-481b-8d63-2ba880eff651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:09.940798 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b5f55-b027-481b-8d63-2ba880eff651 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:09.951890 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c5e8d-11ee-4ea7-a440-2f52fdd95ad4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:09.957694 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e48c5e8d-11ee-4ea7-a440-2f52fdd95ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:09.985029 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 913/1847] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:09 2022] POST /identity/v3/users => generated 300 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:09.991082 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b5f55-b027-481b-8d63-2ba880eff651 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:10.020246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b5f55-b027-481b-8d63-2ba880eff651 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:10.034375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9be278-eeec-4101-8f96-8be8c3dd7fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:10.036157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be278-eeec-4101-8f96-8be8c3dd7fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:10.037793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be278-eeec-4101-8f96-8be8c3dd7fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:10.038090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be278-eeec-4101-8f96-8be8c3dd7fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:10.040571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9be278-eeec-4101-8f96-8be8c3dd7fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:10.046075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9be278-eeec-4101-8f96-8be8c3dd7fb4 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:10.083288 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 914/1848] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:10.087856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9be278-eeec-4101-8f96-8be8c3dd7fb4 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:10.102532 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c5e8d-11ee-4ea7-a440-2f52fdd95ad4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:10.115590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d031e-8130-47e0-a250-ef9e2ed2480d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:10.116298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d031e-8130-47e0-a250-ef9e2ed2480d service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:10.116999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d031e-8130-47e0-a250-ef9e2ed2480d service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:10.116999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d031e-8130-47e0-a250-ef9e2ed2480d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:10.118396 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9be278-eeec-4101-8f96-8be8c3dd7fb4 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:10.131648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f993c-22b7-4ea6-b4b4-486935944258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:10.133111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f993c-22b7-4ea6-b4b4-486935944258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:10.133487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f993c-22b7-4ea6-b4b4-486935944258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:10.133684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f993c-22b7-4ea6-b4b4-486935944258 admin admin] PATH_INFO: `/v3/projects/86da44614f0e4161b0793d4597fc5d19/users/2634190c62b84a698b921c9cf0bfd7fe/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:10.142089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d031e-8130-47e0-a250-ef9e2ed2480d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:10.143633 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d031e-8130-47e0-a250-ef9e2ed2480d service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:10.168334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 935/1849] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:10.169416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d031e-8130-47e0-a250-ef9e2ed2480d service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:10.171206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1a2d031e-8130-47e0-a250-ef9e2ed2480d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:10.174946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f993c-22b7-4ea6-b4b4-486935944258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86da44614f0e4161b0793d4597fc5d19, user_id=2634190c62b84a698b921c9cf0bfd7fe, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:10.177419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f993c-22b7-4ea6-b4b4-486935944258 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:10.215612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 915/1850] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:10 2022] PUT /identity/v3/projects/86da44614f0e4161b0793d4597fc5d19/users/2634190c62b84a698b921c9cf0bfd7fe/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:04:10.217597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f993c-22b7-4ea6-b4b4-486935944258 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:10.219292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d031e-8130-47e0-a250-ef9e2ed2480d service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:10.360265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f993c-22b7-4ea6-b4b4-486935944258 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:10.373238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:10.376042 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:10.376698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:10.377367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:10.377653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:10.378367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:10.378776 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49 admin admin] PATH_INFO: `/v3/projects/41b5c483724d492299e6416d3a1fa47c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:10.380023 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b5c483724d492299e6416d3a1fa47c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:10.381797 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] PATH_INFO: `/v3/users/17f32fa4ed1245b3bb1439b1ccc6ed95` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:10.382120 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:10.385530 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f32fa4ed1245b3bb1439b1ccc6ed95)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:10.388690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:10.497048 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f32fa4ed1245b3bb1439b1ccc6ed95'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.508907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f32fa4ed1245b3bb1439b1ccc6ed95'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.509572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f32fa4ed1245b3bb1439b1ccc6ed95'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.510793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f32fa4ed1245b3bb1439b1ccc6ed95'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.514888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:10.521083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b5c483724d492299e6416d3a1fa47c', 'request_id': 'req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.534026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:10.542747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b5c483724d492299e6416d3a1fa47c', 'request_id': 'req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.548338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f32fa4ed1245b3bb1439b1ccc6ed95'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.559845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b5c483724d492299e6416d3a1fa47c', 'request_id': 'req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.583778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 916/1851] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:10 2022] DELETE /identity/v3/users/17f32fa4ed1245b3bb1439b1ccc6ed95 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:10.583778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:10.584367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49 admin admin] The token cache is being invalidate because project 41b5c483724d492299e6416d3a1fa47c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:10.584367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.585472 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-24f214b8-6610-41e8-8ba9-43d7dd1d5f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.586163 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:10.587671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 936/1852] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:10 2022] DELETE /identity/v3/projects/41b5c483724d492299e6416d3a1fa47c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:10.589753 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dc97b-fa10-4d27-9068-a1cac54474f5 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:10.590348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dc97b-fa10-4d27-9068-a1cac54474f5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:10.590710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dc97b-fa10-4d27-9068-a1cac54474f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:10.624743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d20dc97b-fa10-4d27-9068-a1cac54474f5 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:10.626327 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d20dc97b-fa10-4d27-9068-a1cac54474f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:10.728796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 937/1853] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:10.730889 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dc97b-fa10-4d27-9068-a1cac54474f5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:10.736277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d20dc97b-fa10-4d27-9068-a1cac54474f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:10.739299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f632326-28fd-4a55-8005-6aed8524d537 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:10.744974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f46f6d-cb55-4abe-9c6d-102ff38682c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:10.745640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f46f6d-cb55-4abe-9c6d-102ff38682c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:10.745957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f46f6d-cb55-4abe-9c6d-102ff38682c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:10.746198 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f46f6d-cb55-4abe-9c6d-102ff38682c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:10.753903 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f46f6d-cb55-4abe-9c6d-102ff38682c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:10.753903 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f46f6d-cb55-4abe-9c6d-102ff38682c4 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:10.761767 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dc97b-fa10-4d27-9068-a1cac54474f5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:10.770395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 917/1854] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:10.772555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6489adb-f6b7-498e-863a-ec1b5a770ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:10.773793 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6489adb-f6b7-498e-863a-ec1b5a770ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:10.774587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6489adb-f6b7-498e-863a-ec1b5a770ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:10.775256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6489adb-f6b7-498e-863a-ec1b5a770ce3 admin admin] PATH_INFO: `/v3/users/40cc264bba8e47b9a3b64a10ee50df17` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:10.776229 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f46f6d-cb55-4abe-9c6d-102ff38682c4 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:10.777925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6489adb-f6b7-498e-863a-ec1b5a770ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40cc264bba8e47b9a3b64a10ee50df17)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:10.781641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6489adb-f6b7-498e-863a-ec1b5a770ce3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:10.782557 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-19f46f6d-cb55-4abe-9c6d-102ff38682c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:10.832637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f46f6d-cb55-4abe-9c6d-102ff38682c4 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:10.847307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fd5e8-a2d7-46fa-8d5f-e112c184bda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:10.848194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fd5e8-a2d7-46fa-8d5f-e112c184bda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:10.848483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fd5e8-a2d7-46fa-8d5f-e112c184bda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:10.848767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fd5e8-a2d7-46fa-8d5f-e112c184bda3 admin admin] PATH_INFO: `/v3/projects/86da44614f0e4161b0793d4597fc5d19/users/2634190c62b84a698b921c9cf0bfd7fe/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:10.853270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fd5e8-a2d7-46fa-8d5f-e112c184bda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86da44614f0e4161b0793d4597fc5d19, user_id=2634190c62b84a698b921c9cf0bfd7fe, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:10.860771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fd5e8-a2d7-46fa-8d5f-e112c184bda3 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:10.874425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a6489adb-f6b7-498e-863a-ec1b5a770ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40cc264bba8e47b9a3b64a10ee50df17'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.889175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 918/1855] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:10 2022] PUT /identity/v3/projects/86da44614f0e4161b0793d4597fc5d19/users/2634190c62b84a698b921c9cf0bfd7fe/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:10.901220 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fd5e8-a2d7-46fa-8d5f-e112c184bda3 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:10.905092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b11fd5e8-a2d7-46fa-8d5f-e112c184bda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:10.908420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a6489adb-f6b7-498e-863a-ec1b5a770ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40cc264bba8e47b9a3b64a10ee50df17'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.918188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a6489adb-f6b7-498e-863a-ec1b5a770ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40cc264bba8e47b9a3b64a10ee50df17'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.919227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a6489adb-f6b7-498e-863a-ec1b5a770ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40cc264bba8e47b9a3b64a10ee50df17'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.950983 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a6489adb-f6b7-498e-863a-ec1b5a770ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40cc264bba8e47b9a3b64a10ee50df17'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:10.967745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 938/1856] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:10 2022] DELETE /identity/v3/users/40cc264bba8e47b9a3b64a10ee50df17 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:10.994941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bb084-3cdc-4d1f-ab54-b5f0ed7b9f40 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:10.998057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bb084-3cdc-4d1f-ab54-b5f0ed7b9f40 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:11.003475 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bb084-3cdc-4d1f-ab54-b5f0ed7b9f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:11.069858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a06bb084-3cdc-4d1f-ab54-b5f0ed7b9f40 None None] MFA Rules not processed for user `2634190c62b84a698b921c9cf0bfd7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:11.072201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a06bb084-3cdc-4d1f-ab54-b5f0ed7b9f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:11.078302 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fd5e8-a2d7-46fa-8d5f-e112c184bda3 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:11.158840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:11.230072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:11.244495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:11.244952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:11.245250 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] PATH_INFO: `/v3/projects/426f6e7767b7440fba84b4c2f68d400a` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:11.253729 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426f6e7767b7440fba84b4c2f68d400a)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:11.259674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 939/1857] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:11.263456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bb084-3cdc-4d1f-ab54-b5f0ed7b9f40 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:11.264517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:11.270610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a06bb084-3cdc-4d1f-ab54-b5f0ed7b9f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:11.289074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:11.401105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426f6e7767b7440fba84b4c2f68d400a', 'request_id': 'req-a225c2c2-b6ab-4a03-9916-232adc0f1b83'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.414671 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426f6e7767b7440fba84b4c2f68d400a', 'request_id': 'req-a225c2c2-b6ab-4a03-9916-232adc0f1b83'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.429329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bb084-3cdc-4d1f-ab54-b5f0ed7b9f40 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:11.434143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426f6e7767b7440fba84b4c2f68d400a', 'request_id': 'req-a225c2c2-b6ab-4a03-9916-232adc0f1b83'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.457561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] The token cache is being invalidate because project 426f6e7767b7440fba84b4c2f68d400a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:11.457854 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.458523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.462852 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 919/1858] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:10 2022] DELETE /identity/v3/projects/426f6e7767b7440fba84b4c2f68d400a => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:11.462852 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:11.462852 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:11.538804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fb513-1e52-4bc3-848a-baa4423a8ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:11.539502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fb513-1e52-4bc3-848a-baa4423a8ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:11.539885 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fb513-1e52-4bc3-848a-baa4423a8ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:11.540281 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fb513-1e52-4bc3-848a-baa4423a8ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:11.542132 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c77fb513-1e52-4bc3-848a-baa4423a8ed4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:11.577608 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225c2c2-b6ab-4a03-9916-232adc0f1b83 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:11.583829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c6e23-fa61-47a2-91b6-410635397122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:11.584699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c6e23-fa61-47a2-91b6-410635397122 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:11.584987 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c6e23-fa61-47a2-91b6-410635397122 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:11.585265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c6e23-fa61-47a2-91b6-410635397122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:11.587719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6e1c6e23-fa61-47a2-91b6-410635397122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:11.662365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fb513-1e52-4bc3-848a-baa4423a8ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:11.664384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fb513-1e52-4bc3-848a-baa4423a8ed4 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:11.675942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 940/1859] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:11.676917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fb513-1e52-4bc3-848a-baa4423a8ed4 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:11.678635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c77fb513-1e52-4bc3-848a-baa4423a8ed4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:11.682428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c6e23-fa61-47a2-91b6-410635397122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:11.683912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c6e23-fa61-47a2-91b6-410635397122 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:11.691121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fb513-1e52-4bc3-848a-baa4423a8ed4 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:11.694182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 920/1860] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:11.695088 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c6e23-fa61-47a2-91b6-410635397122 service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:11.696643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6e1c6e23-fa61-47a2-91b6-410635397122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:11.697250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:11.698084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:11.698527 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:11.698964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] PATH_INFO: `/v3/projects/b413e9fa3f474be885052571724f6543` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:11.700318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b413e9fa3f474be885052571724f6543)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:11.702279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:11.712023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c6e23-fa61-47a2-91b6-410635397122 service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:11.719142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711b348-1e85-4777-87ec-deecd19dca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:11.720324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711b348-1e85-4777-87ec-deecd19dca7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:11.720579 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711b348-1e85-4777-87ec-deecd19dca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:11.720858 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711b348-1e85-4777-87ec-deecd19dca7f admin admin] PATH_INFO: `/v3/users/3bcb0124269e4c7fb083fcd20d1de16e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:11.722022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711b348-1e85-4777-87ec-deecd19dca7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bcb0124269e4c7fb083fcd20d1de16e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:11.724367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711b348-1e85-4777-87ec-deecd19dca7f admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:11.753731 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:11.771491 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b413e9fa3f474be885052571724f6543', 'request_id': 'req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.784768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b413e9fa3f474be885052571724f6543', 'request_id': 'req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.793211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:11.793675 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b413e9fa3f474be885052571724f6543', 'request_id': 'req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.796118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d711b348-1e85-4777-87ec-deecd19dca7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bcb0124269e4c7fb083fcd20d1de16e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.813477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d711b348-1e85-4777-87ec-deecd19dca7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bcb0124269e4c7fb083fcd20d1de16e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.814272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d711b348-1e85-4777-87ec-deecd19dca7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bcb0124269e4c7fb083fcd20d1de16e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.815879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d711b348-1e85-4777-87ec-deecd19dca7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bcb0124269e4c7fb083fcd20d1de16e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.816034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] The token cache is being invalidate because project b413e9fa3f474be885052571724f6543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:11.816206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.817050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.822536 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 941/1861] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:11 2022] DELETE /identity/v3/projects/b413e9fa3f474be885052571724f6543 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:11.823438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:11.825008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:11.835640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d711b348-1e85-4777-87ec-deecd19dca7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bcb0124269e4c7fb083fcd20d1de16e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:11.852839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 921/1862] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:11 2022] DELETE /identity/v3/users/3bcb0124269e4c7fb083fcd20d1de16e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:11.854385 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f76ee9-3cae-42a4-802b-1d1bb70ce59b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:11.854695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f76ee9-3cae-42a4-802b-1d1bb70ce59b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:11.854975 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f76ee9-3cae-42a4-802b-1d1bb70ce59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:11.878435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-52f76ee9-3cae-42a4-802b-1d1bb70ce59b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:11.883026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-52f76ee9-3cae-42a4-802b-1d1bb70ce59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:11.933698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a5c3a-18ce-44ca-8928-4e8dd3ec9433 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:11.988470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 922/1863] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:11.997781 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec10669-a72f-46b5-bb9d-c03158495ec1 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:11.998517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec10669-a72f-46b5-bb9d-c03158495ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.003595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec10669-a72f-46b5-bb9d-c03158495ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.033510 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-5ec10669-a72f-46b5-bb9d-c03158495ec1 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:12.034916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5ec10669-a72f-46b5-bb9d-c03158495ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:12.042056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3fcd9-9169-42f2-b7c1-1792353a4354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:12.042719 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3fcd9-9169-42f2-b7c1-1792353a4354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.043000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3fcd9-9169-42f2-b7c1-1792353a4354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.043280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3fcd9-9169-42f2-b7c1-1792353a4354 admin admin] PATH_INFO: `/v3/users/dc85c640190a4888a6e6f5c1b8fe23b5` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.044502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 923/1864] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:12.047933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3fcd9-9169-42f2-b7c1-1792353a4354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc85c640190a4888a6e6f5c1b8fe23b5)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:12.048863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec10669-a72f-46b5-bb9d-c03158495ec1 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:12.050083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3fcd9-9169-42f2-b7c1-1792353a4354 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:12.062071 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec10669-a72f-46b5-bb9d-c03158495ec1 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:12.069577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca419f-618d-4ca1-8543-a03dca109700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:12.070536 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca419f-618d-4ca1-8543-a03dca109700 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.070919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca419f-618d-4ca1-8543-a03dca109700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.071357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca419f-618d-4ca1-8543-a03dca109700 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.072231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca419f-618d-4ca1-8543-a03dca109700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:12.072627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca419f-618d-4ca1-8543-a03dca109700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:12.075201 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca419f-618d-4ca1-8543-a03dca109700 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:12.091450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 924/1865] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:04:12.097832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca419f-618d-4ca1-8543-a03dca109700 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:12.109935 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca419f-618d-4ca1-8543-a03dca109700 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:12.115581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642c31b-f059-4120-897a-2ec0b527ad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:12.116464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642c31b-f059-4120-897a-2ec0b527ad75 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.116841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642c31b-f059-4120-897a-2ec0b527ad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.117190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642c31b-f059-4120-897a-2ec0b527ad75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.117908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642c31b-f059-4120-897a-2ec0b527ad75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:12.120055 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642c31b-f059-4120-897a-2ec0b527ad75 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:12.122409 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-49d3fcd9-9169-42f2-b7c1-1792353a4354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc85c640190a4888a6e6f5c1b8fe23b5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.135579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-49d3fcd9-9169-42f2-b7c1-1792353a4354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc85c640190a4888a6e6f5c1b8fe23b5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.168425 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 925/1866] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:12 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:12.169333 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642c31b-f059-4120-897a-2ec0b527ad75 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:12.171565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-49d3fcd9-9169-42f2-b7c1-1792353a4354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc85c640190a4888a6e6f5c1b8fe23b5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.176593 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-49d3fcd9-9169-42f2-b7c1-1792353a4354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc85c640190a4888a6e6f5c1b8fe23b5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.198308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:12.212427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-49d3fcd9-9169-42f2-b7c1-1792353a4354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc85c640190a4888a6e6f5c1b8fe23b5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.222906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 942/1867] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:11 2022] DELETE /identity/v3/users/dc85c640190a4888a6e6f5c1b8fe23b5 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:12.226752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3c057-f1b7-44ea-97a2-bfc2e4ca7b18 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.226991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3c057-f1b7-44ea-97a2-bfc2e4ca7b18 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.227269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3c057-f1b7-44ea-97a2-bfc2e4ca7b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.262066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8ff3c057-f1b7-44ea-97a2-bfc2e4ca7b18 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:12.266110 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8ff3c057-f1b7-44ea-97a2-bfc2e4ca7b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:12.291101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642c31b-f059-4120-897a-2ec0b527ad75 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:12.345898 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:12.362660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 943/1868] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:12.362660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3c057-f1b7-44ea-97a2-bfc2e4ca7b18 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:12.362660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8ff3c057-f1b7-44ea-97a2-bfc2e4ca7b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:12.381363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3c057-f1b7-44ea-97a2-bfc2e4ca7b18 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:12.387107 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:12.387862 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.388217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.388558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] PATH_INFO: `/v3/projects/0d71218316f446ed8a2e701a40c6ee24` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.390437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d71218316f446ed8a2e701a40c6ee24)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:12.392567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:12.392994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c2929-34d6-445c-87c8-3a7fd26908cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:12.393741 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c2929-34d6-445c-87c8-3a7fd26908cb admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.394090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c2929-34d6-445c-87c8-3a7fd26908cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.394487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c2929-34d6-445c-87c8-3a7fd26908cb admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.404427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c2929-34d6-445c-87c8-3a7fd26908cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:12.407892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c2929-34d6-445c-87c8-3a7fd26908cb admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:12.439499 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 926/1869] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:12 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:12.441359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c2929-34d6-445c-87c8-3a7fd26908cb admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:12.443412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-739c2929-34d6-445c-87c8-3a7fd26908cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:12.450897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d71218316f446ed8a2e701a40c6ee24', 'request_id': 'req-528c36ce-5806-4adb-bf61-421e1397b3a5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.455903 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c2929-34d6-445c-87c8-3a7fd26908cb admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:12.457693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d71218316f446ed8a2e701a40c6ee24', 'request_id': 'req-528c36ce-5806-4adb-bf61-421e1397b3a5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.464095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d71218316f446ed8a2e701a40c6ee24', 'request_id': 'req-528c36ce-5806-4adb-bf61-421e1397b3a5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.477782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] The token cache is being invalidate because project 0d71218316f446ed8a2e701a40c6ee24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:12.478002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.478645 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.480210 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 944/1870] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:12 2022] DELETE /identity/v3/projects/0d71218316f446ed8a2e701a40c6ee24 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:12.480975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:12.482240 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:12.520006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78251c-b737-41bd-8150-7109aa102023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:12.520641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78251c-b737-41bd-8150-7109aa102023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.520921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78251c-b737-41bd-8150-7109aa102023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.521195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78251c-b737-41bd-8150-7109aa102023 admin admin] PATH_INFO: `/v3/projects/0dd8ca4fa8eb43259ec3c6f52457d1d9` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.522374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78251c-b737-41bd-8150-7109aa102023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd8ca4fa8eb43259ec3c6f52457d1d9)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:12.524333 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78251c-b737-41bd-8150-7109aa102023 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:12.543397 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c36ce-5806-4adb-bf61-421e1397b3a5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:12.547869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107155a-f40d-4f4b-8080-5d76c2017ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:12.548492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107155a-f40d-4f4b-8080-5d76c2017ecd service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.548775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107155a-f40d-4f4b-8080-5d76c2017ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.549051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107155a-f40d-4f4b-8080-5d76c2017ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.551289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c107155a-f40d-4f4b-8080-5d76c2017ecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:12.565682 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107155a-f40d-4f4b-8080-5d76c2017ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:12.567544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107155a-f40d-4f4b-8080-5d76c2017ecd service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:12.576743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a78251c-b737-41bd-8150-7109aa102023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd8ca4fa8eb43259ec3c6f52457d1d9', 'request_id': 'req-0a78251c-b737-41bd-8150-7109aa102023'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.578469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 945/1871] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:12.579293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107155a-f40d-4f4b-8080-5d76c2017ecd service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:12.580688 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c107155a-f40d-4f4b-8080-5d76c2017ecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:12.583712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a78251c-b737-41bd-8150-7109aa102023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd8ca4fa8eb43259ec3c6f52457d1d9', 'request_id': 'req-0a78251c-b737-41bd-8150-7109aa102023'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.590572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a78251c-b737-41bd-8150-7109aa102023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd8ca4fa8eb43259ec3c6f52457d1d9', 'request_id': 'req-0a78251c-b737-41bd-8150-7109aa102023'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.592429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107155a-f40d-4f4b-8080-5d76c2017ecd service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:12.602893 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:12.604716 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a78251c-b737-41bd-8150-7109aa102023 admin admin] The token cache is being invalidate because project 0dd8ca4fa8eb43259ec3c6f52457d1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:12.605330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a78251c-b737-41bd-8150-7109aa102023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.605880 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a78251c-b737-41bd-8150-7109aa102023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:12.612317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 927/1872] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:12 2022] DELETE /identity/v3/projects/0dd8ca4fa8eb43259ec3c6f52457d1d9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:12.612317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcf70b-0ca6-4f0e-a7b6-2a17c3e0b4fd None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.612317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcf70b-0ca6-4f0e-a7b6-2a17c3e0b4fd None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.612317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcf70b-0ca6-4f0e-a7b6-2a17c3e0b4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.632379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-dfdcf70b-0ca6-4f0e-a7b6-2a17c3e0b4fd None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:12.633688 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-dfdcf70b-0ca6-4f0e-a7b6-2a17c3e0b4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:12.680583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd26b36-2619-4787-8cd3-5c4c64033c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:12.681350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd26b36-2619-4787-8cd3-5c4c64033c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.681698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd26b36-2619-4787-8cd3-5c4c64033c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.682031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd26b36-2619-4787-8cd3-5c4c64033c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.683561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd26b36-2619-4787-8cd3-5c4c64033c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:12.685854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd26b36-2619-4787-8cd3-5c4c64033c72 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:12.692106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:12.706165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 946/1873] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:12.706165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2be22-0da0-4539-8536-39cf69e881ce None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.706165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2be22-0da0-4539-8536-39cf69e881ce None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.706165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2be22-0da0-4539-8536-39cf69e881ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.724089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 928/1874] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:12.725204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcf70b-0ca6-4f0e-a7b6-2a17c3e0b4fd None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:12.726989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-58d2be22-0da0-4539-8536-39cf69e881ce None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:12.728353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-58d2be22-0da0-4539-8536-39cf69e881ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:12.731410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-dfdcf70b-0ca6-4f0e-a7b6-2a17c3e0b4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:12.744809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 947/1875] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:12.746344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c4f33-bc4e-47ba-8b17-a72c05bebbb1 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.746669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c4f33-bc4e-47ba-8b17-a72c05bebbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.746950 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c4f33-bc4e-47ba-8b17-a72c05bebbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.752068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcf70b-0ca6-4f0e-a7b6-2a17c3e0b4fd None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:12.757299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a3964-c21d-45b8-a233-736613adcdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:12.757918 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a3964-c21d-45b8-a233-736613adcdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.758203 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a3964-c21d-45b8-a233-736613adcdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.758557 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a3964-c21d-45b8-a233-736613adcdd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.759238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a3964-c21d-45b8-a233-736613adcdd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:12.761136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a3964-c21d-45b8-a233-736613adcdd3 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:12.769285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0e5c4f33-bc4e-47ba-8b17-a72c05bebbb1 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:12.770542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0e5c4f33-bc4e-47ba-8b17-a72c05bebbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:12.775691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 929/1876] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:12.775691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a81f7a-640c-4960-ac10-e79026a47d07 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.775691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a81f7a-640c-4960-ac10-e79026a47d07 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.775691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a81f7a-640c-4960-ac10-e79026a47d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.782639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 948/1877] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:12.783589 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c4f33-bc4e-47ba-8b17-a72c05bebbb1 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:12.796588 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c4f33-bc4e-47ba-8b17-a72c05bebbb1 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:12.799866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d9a81f7a-640c-4960-ac10-e79026a47d07 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:12.801281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d9a81f7a-640c-4960-ac10-e79026a47d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:12.801417 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5ae28-1da3-47f6-b764-cd8802eb99f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:12.802378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5ae28-1da3-47f6-b764-cd8802eb99f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.802665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5ae28-1da3-47f6-b764-cd8802eb99f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.802940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5ae28-1da3-47f6-b764-cd8802eb99f5 admin admin] PATH_INFO: `/v3/projects/9ca80fdc60454569b3d64fcdb27c87f9/users/6e92f13b37694abbad5dfeef57de2966/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.812402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 930/1878] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:12.813653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a81f7a-640c-4960-ac10-e79026a47d07 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:12.826021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5ae28-1da3-47f6-b764-cd8802eb99f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca80fdc60454569b3d64fcdb27c87f9, user_id=6e92f13b37694abbad5dfeef57de2966, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:12.826963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a81f7a-640c-4960-ac10-e79026a47d07 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:12.829810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5ae28-1da3-47f6-b764-cd8802eb99f5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:12.837900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a9e7-5ff0-4138-b82d-64d8af7b1972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:12.838526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a9e7-5ff0-4138-b82d-64d8af7b1972 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.839392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a9e7-5ff0-4138-b82d-64d8af7b1972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.839674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a9e7-5ff0-4138-b82d-64d8af7b1972 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.840390 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a9e7-5ff0-4138-b82d-64d8af7b1972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:12.840682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a9e7-5ff0-4138-b82d-64d8af7b1972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:12.844320 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a9e7-5ff0-4138-b82d-64d8af7b1972 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:12.851865 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 949/1879] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:12 2022] PUT /identity/v3/projects/9ca80fdc60454569b3d64fcdb27c87f9/users/6e92f13b37694abbad5dfeef57de2966/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:12.853330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5ae28-1da3-47f6-b764-cd8802eb99f5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:12.857637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 931/1880] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:04:12.862413 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfcd76-76c5-45d8-a6e4-c587f13e4835 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.862768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfcd76-76c5-45d8-a6e4-c587f13e4835 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.863145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfcd76-76c5-45d8-a6e4-c587f13e4835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.918925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-12dfcd76-76c5-45d8-a6e4-c587f13e4835 None None] MFA Rules not processed for user `6e92f13b37694abbad5dfeef57de2966`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:12.920832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-12dfcd76-76c5-45d8-a6e4-c587f13e4835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:12.938452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5ae28-1da3-47f6-b764-cd8802eb99f5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:12.945218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ca73c-becd-4c7b-8bed-03c5d894190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:12.956278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ca73c-becd-4c7b-8bed-03c5d894190b admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.956278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ca73c-becd-4c7b-8bed-03c5d894190b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.956278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ca73c-becd-4c7b-8bed-03c5d894190b admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.956278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ca73c-becd-4c7b-8bed-03c5d894190b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:12.956278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ca73c-becd-4c7b-8bed-03c5d894190b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:12.956278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ca73c-becd-4c7b-8bed-03c5d894190b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:12.964761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 950/1881] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:04:12.965672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ca73c-becd-4c7b-8bed-03c5d894190b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:12.978162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ca73c-becd-4c7b-8bed-03c5d894190b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:12.984914 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4080d2a-11bb-4568-82fc-06acb9738771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:12.985820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4080d2a-11bb-4568-82fc-06acb9738771 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:12.986292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4080d2a-11bb-4568-82fc-06acb9738771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:12.986893 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4080d2a-11bb-4568-82fc-06acb9738771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:12.987714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4080d2a-11bb-4568-82fc-06acb9738771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:12.989985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4080d2a-11bb-4568-82fc-06acb9738771 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.036237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 932/1882] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:04:13.036237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfcd76-76c5-45d8-a6e4-c587f13e4835 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.056437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 951/1883] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:12 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:13.057886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfcd76-76c5-45d8-a6e4-c587f13e4835 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.061108 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4080d2a-11bb-4568-82fc-06acb9738771 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.125816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:13.160289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4080d2a-11bb-4568-82fc-06acb9738771 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.173156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfb20e-5873-44bf-a787-3ba3e61519e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.175271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfb20e-5873-44bf-a787-3ba3e61519e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.175811 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfb20e-5873-44bf-a787-3ba3e61519e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.176348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfb20e-5873-44bf-a787-3ba3e61519e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.177586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfb20e-5873-44bf-a787-3ba3e61519e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.179992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfb20e-5873-44bf-a787-3ba3e61519e0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.186571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b10bc7-1c1c-4691-8fd6-5668e853a979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.187592 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b10bc7-1c1c-4691-8fd6-5668e853a979 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.188877 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b10bc7-1c1c-4691-8fd6-5668e853a979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.188877 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b10bc7-1c1c-4691-8fd6-5668e853a979 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.189992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b10bc7-1c1c-4691-8fd6-5668e853a979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.191875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b10bc7-1c1c-4691-8fd6-5668e853a979 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.232254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 952/1884] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:13 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:13.234472 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfb20e-5873-44bf-a787-3ba3e61519e0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.244617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 933/1885] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:13 2022] POST /identity/v3/projects => generated 387 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:13.245917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b10bc7-1c1c-4691-8fd6-5668e853a979 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.250134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-51b10bc7-1c1c-4691-8fd6-5668e853a979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:13.331772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:13.340510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfb20e-5873-44bf-a787-3ba3e61519e0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.382234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b10bc7-1c1c-4691-8fd6-5668e853a979 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.387424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.388200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.388547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.388891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] PATH_INFO: `/v3/projects/0820b11df7704b49b154af94fcbffc34` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.391064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0820b11df7704b49b154af94fcbffc34)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.393103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.448565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0820b11df7704b49b154af94fcbffc34', 'request_id': 'req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:13.451361 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cf5b8-ffd5-45c9-9fae-5c53031c5a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.452593 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cf5b8-ffd5-45c9-9fae-5c53031c5a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.453355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cf5b8-ffd5-45c9-9fae-5c53031c5a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.453355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cf5b8-ffd5-45c9-9fae-5c53031c5a0a admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.454153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cf5b8-ffd5-45c9-9fae-5c53031c5a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.456314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cf5b8-ffd5-45c9-9fae-5c53031c5a0a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.456738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0820b11df7704b49b154af94fcbffc34', 'request_id': 'req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:13.463757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0820b11df7704b49b154af94fcbffc34', 'request_id': 'req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:13.480199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] The token cache is being invalidate because project 0820b11df7704b49b154af94fcbffc34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:13.480586 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:13.481030 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 953/1886] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:13 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:13.481387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:13.482128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cf5b8-ffd5-45c9-9fae-5c53031c5a0a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.484652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-068cf5b8-ffd5-45c9-9fae-5c53031c5a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:13.486773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 934/1887] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:13 2022] DELETE /identity/v3/projects/0820b11df7704b49b154af94fcbffc34 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:13.488129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.489882 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:13.500562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cf5b8-ffd5-45c9-9fae-5c53031c5a0a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.578150 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2e6eb-dc10-4ff2-ba7b-bc4d28a5df0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.579028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2e6eb-dc10-4ff2-ba7b-bc4d28a5df0e admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.579416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2e6eb-dc10-4ff2-ba7b-bc4d28a5df0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.579847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2e6eb-dc10-4ff2-ba7b-bc4d28a5df0e admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.580722 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2e6eb-dc10-4ff2-ba7b-bc4d28a5df0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.583040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2e6eb-dc10-4ff2-ba7b-bc4d28a5df0e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.588642 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc89b9b-be8f-4b57-830c-e58b2e0d2861 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.595389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411290f-8b29-4241-9b09-dac64b948075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.596498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:13.597525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411290f-8b29-4241-9b09-dac64b948075 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.598059 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411290f-8b29-4241-9b09-dac64b948075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.598390 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411290f-8b29-4241-9b09-dac64b948075 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.599124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411290f-8b29-4241-9b09-dac64b948075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.602183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411290f-8b29-4241-9b09-dac64b948075 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.614647 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 954/1888] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:13 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:13.616176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2e6eb-dc10-4ff2-ba7b-bc4d28a5df0e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.618427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-baa2e6eb-dc10-4ff2-ba7b-bc4d28a5df0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:13.641704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 935/1889] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:13 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:13.642795 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411290f-8b29-4241-9b09-dac64b948075 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.644766 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4411290f-8b29-4241-9b09-dac64b948075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:13.648350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2e6eb-dc10-4ff2-ba7b-bc4d28a5df0e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.653690 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84426883-10cd-453b-8ce4-92e71bcdd69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.654499 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84426883-10cd-453b-8ce4-92e71bcdd69f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.654946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84426883-10cd-453b-8ce4-92e71bcdd69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.655323 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84426883-10cd-453b-8ce4-92e71bcdd69f admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.656422 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84426883-10cd-453b-8ce4-92e71bcdd69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.659128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84426883-10cd-453b-8ce4-92e71bcdd69f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.661936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411290f-8b29-4241-9b09-dac64b948075 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.667364 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.668094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.668380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.668827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] PATH_INFO: `/v3/users/2634190c62b84a698b921c9cf0bfd7fe` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.670031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2634190c62b84a698b921c9cf0bfd7fe)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.672508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.672937 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 955/1890] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:13.673960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84426883-10cd-453b-8ce4-92e71bcdd69f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.685241 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84426883-10cd-453b-8ce4-92e71bcdd69f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.690641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7df0bb-a2d1-46da-b60f-897dd19c1c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.691433 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7df0bb-a2d1-46da-b60f-897dd19c1c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.691861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7df0bb-a2d1-46da-b60f-897dd19c1c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.692237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7df0bb-a2d1-46da-b60f-897dd19c1c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.693023 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7df0bb-a2d1-46da-b60f-897dd19c1c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.694859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7df0bb-a2d1-46da-b60f-897dd19c1c1e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.707629 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 956/1891] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:13.708912 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7df0bb-a2d1-46da-b60f-897dd19c1c1e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.722746 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7df0bb-a2d1-46da-b60f-897dd19c1c1e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.728961 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f595d6-2f5a-4cbf-985c-efee452a4841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.729826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f595d6-2f5a-4cbf-985c-efee452a4841 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.730209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f595d6-2f5a-4cbf-985c-efee452a4841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.730583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f595d6-2f5a-4cbf-985c-efee452a4841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.731348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f595d6-2f5a-4cbf-985c-efee452a4841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.733234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f595d6-2f5a-4cbf-985c-efee452a4841 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.737415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2634190c62b84a698b921c9cf0bfd7fe'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:13.739393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:13.747963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 957/1892] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:13.747963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f595d6-2f5a-4cbf-985c-efee452a4841 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.751275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2634190c62b84a698b921c9cf0bfd7fe'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:13.752066 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2634190c62b84a698b921c9cf0bfd7fe'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:13.752846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2634190c62b84a698b921c9cf0bfd7fe'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:13.760515 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f595d6-2f5a-4cbf-985c-efee452a4841 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.765637 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76092c39-abdb-4a4b-97ad-3ff17bc0eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.766359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76092c39-abdb-4a4b-97ad-3ff17bc0eb8b admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.766720 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76092c39-abdb-4a4b-97ad-3ff17bc0eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.767104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76092c39-abdb-4a4b-97ad-3ff17bc0eb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.767926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76092c39-abdb-4a4b-97ad-3ff17bc0eb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.769318 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2634190c62b84a698b921c9cf0bfd7fe'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:13.769755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76092c39-abdb-4a4b-97ad-3ff17bc0eb8b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.788357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 936/1893] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:13 2022] DELETE /identity/v3/users/2634190c62b84a698b921c9cf0bfd7fe => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:13.788558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 958/1894] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:13.788668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.788843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76092c39-abdb-4a4b-97ad-3ff17bc0eb8b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.789027 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:13.790735 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-76092c39-abdb-4a4b-97ad-3ff17bc0eb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:13.806265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76092c39-abdb-4a4b-97ad-3ff17bc0eb8b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.893205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3772641-ec84-4953-adff-63538c57f512 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.902815 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9b86e-2e2d-4309-95e1-4d153d36d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.903692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8721913-5514-4cce-a7c8-99dd2f447921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.904047 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9b86e-2e2d-4309-95e1-4d153d36d83c admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.904339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9b86e-2e2d-4309-95e1-4d153d36d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.906041 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9b86e-2e2d-4309-95e1-4d153d36d83c admin admin] PATH_INFO: `/v3/projects/87cf2d6b3a874d31808c00269b9e9501/users/69d40134626a4053a865210eb695aacb/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.906619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8721913-5514-4cce-a7c8-99dd2f447921 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.907364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8721913-5514-4cce-a7c8-99dd2f447921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.910448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8721913-5514-4cce-a7c8-99dd2f447921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.911296 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8721913-5514-4cce-a7c8-99dd2f447921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.914035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8721913-5514-4cce-a7c8-99dd2f447921 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.930334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 959/1895] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:13.931576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8721913-5514-4cce-a7c8-99dd2f447921 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.933369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a8721913-5514-4cce-a7c8-99dd2f447921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:13.939843 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9b86e-2e2d-4309-95e1-4d153d36d83c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cf2d6b3a874d31808c00269b9e9501, user_id=69d40134626a4053a865210eb695aacb, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.943417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9b86e-2e2d-4309-95e1-4d153d36d83c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.947355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8721913-5514-4cce-a7c8-99dd2f447921 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.953171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fd969-f062-4549-93d3-7edef1693cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.953853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fd969-f062-4549-93d3-7edef1693cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.954133 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fd969-f062-4549-93d3-7edef1693cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.954407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fd969-f062-4549-93d3-7edef1693cd1 admin admin] PATH_INFO: `/v3/projects/293b1486f17b4404b9c371d2bc6d320c/users/2d57111910ed4f4d9b56f64eb51d1d3d/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.965829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 937/1896] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:13 2022] PUT /identity/v3/projects/87cf2d6b3a874d31808c00269b9e9501/users/69d40134626a4053a865210eb695aacb/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:13.972425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fd969-f062-4549-93d3-7edef1693cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293b1486f17b4404b9c371d2bc6d320c, user_id=2d57111910ed4f4d9b56f64eb51d1d3d, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.972817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9b86e-2e2d-4309-95e1-4d153d36d83c admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.975646 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fd969-f062-4549-93d3-7edef1693cd1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.994817 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 960/1897] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:13 2022] PUT /identity/v3/projects/293b1486f17b4404b9c371d2bc6d320c/users/2d57111910ed4f4d9b56f64eb51d1d3d/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:14.005791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fd969-f062-4549-93d3-7edef1693cd1 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:14.087154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9b86e-2e2d-4309-95e1-4d153d36d83c admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:14.089299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fd969-f062-4549-93d3-7edef1693cd1 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:14.095404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc81cec-6e5e-4915-8b7a-b20f3a84d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:14.095985 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0db29-a91e-40bb-9f85-718fafc5eb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:14.096140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc81cec-6e5e-4915-8b7a-b20f3a84d578 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:14.096326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc81cec-6e5e-4915-8b7a-b20f3a84d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:14.096595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc81cec-6e5e-4915-8b7a-b20f3a84d578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:14.097246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc81cec-6e5e-4915-8b7a-b20f3a84d578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:14.097503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0db29-a91e-40bb-9f85-718fafc5eb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:14.097881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0db29-a91e-40bb-9f85-718fafc5eb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:14.098384 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0db29-a91e-40bb-9f85-718fafc5eb03 admin admin] PATH_INFO: `/v3/projects/b2428290a0fa4ea1b2174413d712acfd/users/c88407d58cbe402d824ba672d49572f5/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:14.098856 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc81cec-6e5e-4915-8b7a-b20f3a84d578 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:14.118692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 961/1898] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:14.118692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0838-6c53-4876-ab0f-ced96361c3a7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:14.118692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0838-6c53-4876-ab0f-ced96361c3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:14.118692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0838-6c53-4876-ab0f-ced96361c3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:14.122391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0db29-a91e-40bb-9f85-718fafc5eb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2428290a0fa4ea1b2174413d712acfd, user_id=c88407d58cbe402d824ba672d49572f5, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:14.126375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0db29-a91e-40bb-9f85-718fafc5eb03 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:14.152932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 938/1899] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:13 2022] PUT /identity/v3/projects/b2428290a0fa4ea1b2174413d712acfd/users/c88407d58cbe402d824ba672d49572f5/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:14.158160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0db29-a91e-40bb-9f85-718fafc5eb03 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:14.179289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-60cd0838-6c53-4876-ab0f-ced96361c3a7 None None] MFA Rules not processed for user `2d57111910ed4f4d9b56f64eb51d1d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:14.180121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-60cd0838-6c53-4876-ab0f-ced96361c3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:14.190544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:14.264157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:14.296170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 962/1900] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:14.300307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1a762-e49e-45b0-8695-d51174b7259e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:14.301149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1a762-e49e-45b0-8695-d51174b7259e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:14.301780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1a762-e49e-45b0-8695-d51174b7259e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:14.340415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0db29-a91e-40bb-9f85-718fafc5eb03 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:14.347111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abc70a-a43d-49d8-a240-bd5487391567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:14.347892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abc70a-a43d-49d8-a240-bd5487391567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:14.348185 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abc70a-a43d-49d8-a240-bd5487391567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:14.348473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abc70a-a43d-49d8-a240-bd5487391567 admin admin] PATH_INFO: `/v3/projects/87cf2d6b3a874d31808c00269b9e9501/users/69d40134626a4053a865210eb695aacb/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:14.351499 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-84d1a762-e49e-45b0-8695-d51174b7259e None None] MFA Rules not processed for user `c88407d58cbe402d824ba672d49572f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:14.352234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abc70a-a43d-49d8-a240-bd5487391567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cf2d6b3a874d31808c00269b9e9501, user_id=69d40134626a4053a865210eb695aacb, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:14.353398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-84d1a762-e49e-45b0-8695-d51174b7259e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:14.366572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abc70a-a43d-49d8-a240-bd5487391567 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:14.388588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 939/1901] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:14 2022] PUT /identity/v3/projects/87cf2d6b3a874d31808c00269b9e9501/users/69d40134626a4053a865210eb695aacb/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:14.390117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abc70a-a43d-49d8-a240-bd5487391567 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:14.479463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 963/1902] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:14.480931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1a762-e49e-45b0-8695-d51174b7259e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:14.488876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-84d1a762-e49e-45b0-8695-d51174b7259e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:14.505275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abc70a-a43d-49d8-a240-bd5487391567 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:14.507311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1a762-e49e-45b0-8695-d51174b7259e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:14.510216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d39e15-8c20-4b65-a3ce-e30c4a26ad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:14.510841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39e15-8c20-4b65-a3ce-e30c4a26ad44 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:14.511136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39e15-8c20-4b65-a3ce-e30c4a26ad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:14.511420 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39e15-8c20-4b65-a3ce-e30c4a26ad44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:14.512086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d39e15-8c20-4b65-a3ce-e30c4a26ad44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:14.513257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:14.514325 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d39e15-8c20-4b65-a3ce-e30c4a26ad44 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:14.514955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:14.515397 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:14.515849 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] PATH_INFO: `/v3/projects/86da44614f0e4161b0793d4597fc5d19` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:14.517569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=86da44614f0e4161b0793d4597fc5d19)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:14.519824 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:14.545503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 940/1903] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:14 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:14.546973 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91ed9-aeab-406d-86e6-8ef1c3ad4b4b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:14.547266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91ed9-aeab-406d-86e6-8ef1c3ad4b4b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:14.547547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91ed9-aeab-406d-86e6-8ef1c3ad4b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:14.584088 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-c0d91ed9-aeab-406d-86e6-8ef1c3ad4b4b None None] MFA Rules not processed for user `69d40134626a4053a865210eb695aacb`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:14.587941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-c0d91ed9-aeab-406d-86e6-8ef1c3ad4b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:14.602656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86da44614f0e4161b0793d4597fc5d19', 'request_id': 'req-2a3b552b-3373-48dc-b153-7876a657ec0b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:14.609899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86da44614f0e4161b0793d4597fc5d19', 'request_id': 'req-2a3b552b-3373-48dc-b153-7876a657ec0b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:14.617018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86da44614f0e4161b0793d4597fc5d19', 'request_id': 'req-2a3b552b-3373-48dc-b153-7876a657ec0b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:14.631546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] The token cache is being invalidate because project 86da44614f0e4161b0793d4597fc5d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:14.631948 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:14.632656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:14.634452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 964/1904] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:14 2022] DELETE /identity/v3/projects/86da44614f0e4161b0793d4597fc5d19 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:14.635257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:14.636921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:14.671934 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:14.675480 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 941/1905] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:14.676377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d91ed9-aeab-406d-86e6-8ef1c3ad4b4b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:14.677982 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-c0d91ed9-aeab-406d-86e6-8ef1c3ad4b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:14.736838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:14.737413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b552b-3373-48dc-b153-7876a657ec0b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:14.742831 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d1bb9-65e1-46be-9d5f-9b4049b9a8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:14.743385 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d1bb9-65e1-46be-9d5f-9b4049b9a8bb admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:14.743668 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d1bb9-65e1-46be-9d5f-9b4049b9a8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:14.743974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d1bb9-65e1-46be-9d5f-9b4049b9a8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:14.744606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d1bb9-65e1-46be-9d5f-9b4049b9a8bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:14.746726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d1bb9-65e1-46be-9d5f-9b4049b9a8bb admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:14.768337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d91ed9-aeab-406d-86e6-8ef1c3ad4b4b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:14.774441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d503b94-30f8-409f-8e17-a976659a848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:14.775109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d503b94-30f8-409f-8e17-a976659a848e admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:14.775334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d503b94-30f8-409f-8e17-a976659a848e admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:14.775608 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d503b94-30f8-409f-8e17-a976659a848e admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:14.776304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d503b94-30f8-409f-8e17-a976659a848e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:14.778316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d503b94-30f8-409f-8e17-a976659a848e admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:14.783091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 965/1906] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:14 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:14.783091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164861d4-f3af-4bfe-9e97-40ba4ed9bb6a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:14.783091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164861d4-f3af-4bfe-9e97-40ba4ed9bb6a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:14.783091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164861d4-f3af-4bfe-9e97-40ba4ed9bb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:14.802402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 942/1907] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:14 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:14.803248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d503b94-30f8-409f-8e17-a976659a848e admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:14.804981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4d503b94-30f8-409f-8e17-a976659a848e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:14.808058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-164861d4-f3af-4bfe-9e97-40ba4ed9bb6a None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:14.809371 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-164861d4-f3af-4bfe-9e97-40ba4ed9bb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:14.900308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 966/1908] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:14.901546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164861d4-f3af-4bfe-9e97-40ba4ed9bb6a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:14.914717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164861d4-f3af-4bfe-9e97-40ba4ed9bb6a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:14.921200 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d173ab-3aec-4c04-95dc-ff2efe116374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:14.921570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d173ab-3aec-4c04-95dc-ff2efe116374 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:14.921908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d173ab-3aec-4c04-95dc-ff2efe116374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:14.922183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d173ab-3aec-4c04-95dc-ff2efe116374 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:14.922850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d173ab-3aec-4c04-95dc-ff2efe116374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:14.925034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d173ab-3aec-4c04-95dc-ff2efe116374 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:14.925801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d503b94-30f8-409f-8e17-a976659a848e admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:14.952905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 967/1909] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:14 2022] POST /identity/v3/users => generated 300 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:14.954526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d173ab-3aec-4c04-95dc-ff2efe116374 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:14.966066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d173ab-3aec-4c04-95dc-ff2efe116374 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:14.976506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6b0af-80c6-45d2-946b-681a0581d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:14.977293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6b0af-80c6-45d2-946b-681a0581d479 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:14.977764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6b0af-80c6-45d2-946b-681a0581d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:14.978207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6b0af-80c6-45d2-946b-681a0581d479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:14.980049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6b0af-80c6-45d2-946b-681a0581d479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:14.982459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6b0af-80c6-45d2-946b-681a0581d479 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:15.009191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae951173-334d-496b-a8f4-9372be97e9a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:15.010155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae951173-334d-496b-a8f4-9372be97e9a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:15.010830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae951173-334d-496b-a8f4-9372be97e9a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:15.011337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae951173-334d-496b-a8f4-9372be97e9a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:15.016114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 968/1910] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:15.016114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933b95-2e21-44a9-89c0-68abe116e01b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:15.016114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933b95-2e21-44a9-89c0-68abe116e01b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:15.017374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933b95-2e21-44a9-89c0-68abe116e01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:15.046179 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-79933b95-2e21-44a9-89c0-68abe116e01b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:15.048538 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-79933b95-2e21-44a9-89c0-68abe116e01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:15.063209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 969/1911] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:15.064504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79933b95-2e21-44a9-89c0-68abe116e01b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:15.077095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79933b95-2e21-44a9-89c0-68abe116e01b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:15.084387 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9e3aa-4709-4334-9e10-c205a65a6844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:15.085158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9e3aa-4709-4334-9e10-c205a65a6844 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:15.086080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9e3aa-4709-4334-9e10-c205a65a6844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:15.086080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9e3aa-4709-4334-9e10-c205a65a6844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:15.087051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9e3aa-4709-4334-9e10-c205a65a6844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:15.088953 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9e3aa-4709-4334-9e10-c205a65a6844 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:15.104650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 970/1912] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:15.105344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9e3aa-4709-4334-9e10-c205a65a6844 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:15.117523 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9e3aa-4709-4334-9e10-c205a65a6844 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:15.124254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4148e-99c8-4c47-b789-c27316f2530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:15.125170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4148e-99c8-4c47-b789-c27316f2530f admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:15.125517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4148e-99c8-4c47-b789-c27316f2530f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:15.125865 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4148e-99c8-4c47-b789-c27316f2530f admin admin] PATH_INFO: `/v3/projects/8ab06fa5f1a949eab26cdae30e2b0e27/users/0aeb1d539a3344bfba7c51ef13589c85/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:15.129588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae951173-334d-496b-a8f4-9372be97e9a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:15.131842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae951173-334d-496b-a8f4-9372be97e9a1 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:15.146259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 943/1913] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:15.147180 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae951173-334d-496b-a8f4-9372be97e9a1 service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:15.153244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4148e-99c8-4c47-b789-c27316f2530f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab06fa5f1a949eab26cdae30e2b0e27, user_id=0aeb1d539a3344bfba7c51ef13589c85, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:15.156286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4148e-99c8-4c47-b789-c27316f2530f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:15.171772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae951173-334d-496b-a8f4-9372be97e9a1 service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:15.180542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 971/1914] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:15 2022] PUT /identity/v3/projects/8ab06fa5f1a949eab26cdae30e2b0e27/users/0aeb1d539a3344bfba7c51ef13589c85/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:15.181086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4148e-99c8-4c47-b789-c27316f2530f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:15.246674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:15.329174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:15.335492 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c972c89-7480-4f99-abcb-1f77bae49703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:15.337069 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c972c89-7480-4f99-abcb-1f77bae49703 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:15.337513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c972c89-7480-4f99-abcb-1f77bae49703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:15.338099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c972c89-7480-4f99-abcb-1f77bae49703 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:15.339990 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c972c89-7480-4f99-abcb-1f77bae49703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:15.340501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c972c89-7480-4f99-abcb-1f77bae49703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:15.343705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c972c89-7480-4f99-abcb-1f77bae49703 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:15.369457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 944/1915] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:04:15.371094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c972c89-7480-4f99-abcb-1f77bae49703 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:15.388650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4148e-99c8-4c47-b789-c27316f2530f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:15.391354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c972c89-7480-4f99-abcb-1f77bae49703 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:15.398843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66721c1d-4e5f-45cf-8aaa-ddbe5386393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:15.399055 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411021ba-2252-492f-8ae0-78aa0e9ae8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:15.399980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66721c1d-4e5f-45cf-8aaa-ddbe5386393b admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:15.400159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411021ba-2252-492f-8ae0-78aa0e9ae8ad admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:15.400440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66721c1d-4e5f-45cf-8aaa-ddbe5386393b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:15.400612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411021ba-2252-492f-8ae0-78aa0e9ae8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:15.400885 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66721c1d-4e5f-45cf-8aaa-ddbe5386393b admin admin] PATH_INFO: `/v3/projects/901dff56e5d640fba4f987e58a399cce/users/b4e2e37ba9714a0c9ace59baaba72a76/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:15.401043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411021ba-2252-492f-8ae0-78aa0e9ae8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:15.402108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411021ba-2252-492f-8ae0-78aa0e9ae8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:15.405994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411021ba-2252-492f-8ae0-78aa0e9ae8ad admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:15.433827 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66721c1d-4e5f-45cf-8aaa-ddbe5386393b admin admin] RBAC: Authorizing `identity:create_grant(project_id=901dff56e5d640fba4f987e58a399cce, user_id=b4e2e37ba9714a0c9ace59baaba72a76, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:15.434955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 945/1916] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:15.437153 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411021ba-2252-492f-8ae0-78aa0e9ae8ad admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:15.439753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-411021ba-2252-492f-8ae0-78aa0e9ae8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:15.443092 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66721c1d-4e5f-45cf-8aaa-ddbe5386393b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:15.467033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411021ba-2252-492f-8ae0-78aa0e9ae8ad admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:15.469123 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 972/1917] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:15 2022] PUT /identity/v3/projects/901dff56e5d640fba4f987e58a399cce/users/b4e2e37ba9714a0c9ace59baaba72a76/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:15.470616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66721c1d-4e5f-45cf-8aaa-ddbe5386393b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:15.587837 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66721c1d-4e5f-45cf-8aaa-ddbe5386393b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:15.591204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:15.593166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614577e-5acb-45be-95d5-10f6249b5905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:15.593762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:15.594392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:15.594804 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] PATH_INFO: `/v3/users/6e92f13b37694abbad5dfeef57de2966` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:15.596245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e92f13b37694abbad5dfeef57de2966)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:15.598337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:15.605260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614577e-5acb-45be-95d5-10f6249b5905 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:15.605622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614577e-5acb-45be-95d5-10f6249b5905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:15.605963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614577e-5acb-45be-95d5-10f6249b5905 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:15.606674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614577e-5acb-45be-95d5-10f6249b5905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:15.613696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614577e-5acb-45be-95d5-10f6249b5905 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:15.667773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 973/1918] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:15 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:15.668995 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614577e-5acb-45be-95d5-10f6249b5905 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:15.703165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e92f13b37694abbad5dfeef57de2966'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:15.714796 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e92f13b37694abbad5dfeef57de2966'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:15.716127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e92f13b37694abbad5dfeef57de2966'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:15.717106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e92f13b37694abbad5dfeef57de2966'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:15.737938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e92f13b37694abbad5dfeef57de2966'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:15.755392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 946/1919] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:15 2022] DELETE /identity/v3/users/6e92f13b37694abbad5dfeef57de2966 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:15.756939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:15.759972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:15.778727 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614577e-5acb-45be-95d5-10f6249b5905 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:15.818280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:15.852535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:15.863710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48ec87-2037-4e00-9b51-f70de38e9104 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:15.871171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14f89d-8a4e-41c4-b342-319a53f87313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:15.871902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f89d-8a4e-41c4-b342-319a53f87313 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:15.872245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f89d-8a4e-41c4-b342-319a53f87313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:15.872579 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f89d-8a4e-41c4-b342-319a53f87313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:15.872773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb743eea-f687-43e5-9df0-06a15f8de472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:15.873926 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14f89d-8a4e-41c4-b342-319a53f87313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:15.874957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb743eea-f687-43e5-9df0-06a15f8de472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:15.875549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb743eea-f687-43e5-9df0-06a15f8de472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:15.876053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb743eea-f687-43e5-9df0-06a15f8de472 admin admin] PATH_INFO: `/v3/projects/8ab06fa5f1a949eab26cdae30e2b0e27/users/0aeb1d539a3344bfba7c51ef13589c85/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:15.876443 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14f89d-8a4e-41c4-b342-319a53f87313 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:15.878459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb743eea-f687-43e5-9df0-06a15f8de472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab06fa5f1a949eab26cdae30e2b0e27, user_id=0aeb1d539a3344bfba7c51ef13589c85, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:15.881730 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb743eea-f687-43e5-9df0-06a15f8de472 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:15.896706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 947/1920] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:15.896706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14f89d-8a4e-41c4-b342-319a53f87313 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:15.899355 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5c14f89d-8a4e-41c4-b342-319a53f87313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:15.902012 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 974/1921] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:15 2022] PUT /identity/v3/projects/8ab06fa5f1a949eab26cdae30e2b0e27/users/0aeb1d539a3344bfba7c51ef13589c85/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:15.903780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7de31-4e6c-400d-b44c-334338fd5ee5 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:15.904244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7de31-4e6c-400d-b44c-334338fd5ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:15.904692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7de31-4e6c-400d-b44c-334338fd5ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:15.923481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14f89d-8a4e-41c4-b342-319a53f87313 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:15.934343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7fc7de31-4e6c-400d-b44c-334338fd5ee5 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:15.935830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7fc7de31-4e6c-400d-b44c-334338fd5ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:16.009675 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 975/1922] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:16.010928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7de31-4e6c-400d-b44c-334338fd5ee5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:16.021151 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b535f-a1c7-483d-ad20-4143f8821a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:16.021782 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b535f-a1c7-483d-ad20-4143f8821a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:16.022079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b535f-a1c7-483d-ad20-4143f8821a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:16.022362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b535f-a1c7-483d-ad20-4143f8821a92 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:16.023219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b535f-a1c7-483d-ad20-4143f8821a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:16.026240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b535f-a1c7-483d-ad20-4143f8821a92 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:16.031162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7de31-4e6c-400d-b44c-334338fd5ee5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:16.036431 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cf6d2-579b-49ba-b816-63d581191768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:16.037122 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cf6d2-579b-49ba-b816-63d581191768 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:16.037404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cf6d2-579b-49ba-b816-63d581191768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:16.037678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cf6d2-579b-49ba-b816-63d581191768 admin admin] PATH_INFO: `/v3/projects/901dff56e5d640fba4f987e58a399cce/users/b4e2e37ba9714a0c9ace59baaba72a76/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:16.039899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cf6d2-579b-49ba-b816-63d581191768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=901dff56e5d640fba4f987e58a399cce, user_id=b4e2e37ba9714a0c9ace59baaba72a76, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:16.042792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cf6d2-579b-49ba-b816-63d581191768 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:16.057045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 976/1923] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:16 2022] PUT /identity/v3/projects/901dff56e5d640fba4f987e58a399cce/users/b4e2e37ba9714a0c9ace59baaba72a76/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:16.058564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949d835-6147-41f1-bb6a-856aaf94ef59 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:16.058914 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949d835-6147-41f1-bb6a-856aaf94ef59 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:16.059241 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949d835-6147-41f1-bb6a-856aaf94ef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:16.064211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 948/1924] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:15 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:16.068022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b535f-a1c7-483d-ad20-4143f8821a92 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:16.069818 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-9d4b535f-a1c7-483d-ad20-4143f8821a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:16.099053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f949d835-6147-41f1-bb6a-856aaf94ef59 None None] MFA Rules not processed for user `0aeb1d539a3344bfba7c51ef13589c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:16.100943 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f949d835-6147-41f1-bb6a-856aaf94ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:16.162557 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b535f-a1c7-483d-ad20-4143f8821a92 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:16.231263 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 977/1925] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:16.232775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440cf83-0cdb-43f9-870e-0b92d13a43e5 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:16.233725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440cf83-0cdb-43f9-870e-0b92d13a43e5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:16.233869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440cf83-0cdb-43f9-870e-0b92d13a43e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:16.257323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffbf2b-7069-4a23-9341-fedafa9735bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:16.258339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffbf2b-7069-4a23-9341-fedafa9735bf service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:16.258830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffbf2b-7069-4a23-9341-fedafa9735bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:16.259927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffbf2b-7069-4a23-9341-fedafa9735bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:16.266379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7440cf83-0cdb-43f9-870e-0b92d13a43e5 None None] MFA Rules not processed for user `b4e2e37ba9714a0c9ace59baaba72a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:16.267815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7440cf83-0cdb-43f9-870e-0b92d13a43e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:16.301621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:16.320223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:16.343057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffbf2b-7069-4a23-9341-fedafa9735bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:16.344997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffbf2b-7069-4a23-9341-fedafa9735bf service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:16.347880 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 978/1926] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:16.348926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440cf83-0cdb-43f9-870e-0b92d13a43e5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:16.358811 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 949/1927] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:16.359700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffbf2b-7069-4a23-9341-fedafa9735bf service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:16.361162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0dffbf2b-7069-4a23-9341-fedafa9735bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:16.366935 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440cf83-0cdb-43f9-870e-0b92d13a43e5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:16.375094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b0a70-6236-4945-afa8-dfd8e7f4e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:16.376826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b0a70-6236-4945-afa8-dfd8e7f4e6bc admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:16.377334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b0a70-6236-4945-afa8-dfd8e7f4e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:16.378066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b0a70-6236-4945-afa8-dfd8e7f4e6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:16.379553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b0a70-6236-4945-afa8-dfd8e7f4e6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:16.382014 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b0a70-6236-4945-afa8-dfd8e7f4e6bc admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:16.396269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 979/1928] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:16.397478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b0a70-6236-4945-afa8-dfd8e7f4e6bc admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:16.400068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ec8b0a70-6236-4945-afa8-dfd8e7f4e6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:16.459705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffbf2b-7069-4a23-9341-fedafa9735bf service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:16.465792 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0483e-cdd9-4180-8adb-e2b16ef814e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:16.466505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0483e-cdd9-4180-8adb-e2b16ef814e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:16.466857 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0483e-cdd9-4180-8adb-e2b16ef814e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:16.467380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0483e-cdd9-4180-8adb-e2b16ef814e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:16.471777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5bd0483e-cdd9-4180-8adb-e2b16ef814e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:16.472305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b0a70-6236-4945-afa8-dfd8e7f4e6bc admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:16.476832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc8ebe-e206-4852-bcc6-9daa412b1622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:16.477460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc8ebe-e206-4852-bcc6-9daa412b1622 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:16.477819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc8ebe-e206-4852-bcc6-9daa412b1622 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:16.478171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc8ebe-e206-4852-bcc6-9daa412b1622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:16.490607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc8ebe-e206-4852-bcc6-9daa412b1622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:16.492233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc8ebe-e206-4852-bcc6-9daa412b1622 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:16.516320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 980/1929] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:16.517603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc8ebe-e206-4852-bcc6-9daa412b1622 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:16.546628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc8ebe-e206-4852-bcc6-9daa412b1622 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:16.566869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd9421-d761-4a7f-bf1b-3e5dc33df6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:16.568563 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd9421-d761-4a7f-bf1b-3e5dc33df6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:16.569833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd9421-d761-4a7f-bf1b-3e5dc33df6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:16.571194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd9421-d761-4a7f-bf1b-3e5dc33df6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:16.572146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd9421-d761-4a7f-bf1b-3e5dc33df6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:16.574487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd9421-d761-4a7f-bf1b-3e5dc33df6f4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:16.588281 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 981/1930] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:16.592111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd9421-d761-4a7f-bf1b-3e5dc33df6f4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:16.605769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0483e-cdd9-4180-8adb-e2b16ef814e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:16.607214 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd9421-d761-4a7f-bf1b-3e5dc33df6f4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:16.611367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0483e-cdd9-4180-8adb-e2b16ef814e8 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:16.616065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c860e6-605d-448b-ab68-ba76d44a1341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:16.617370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c860e6-605d-448b-ab68-ba76d44a1341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:16.618762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c860e6-605d-448b-ab68-ba76d44a1341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:16.620869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c860e6-605d-448b-ab68-ba76d44a1341 admin admin] PATH_INFO: `/v3/projects/429dfdc4a0a849028956867339c28b3a/users/788260309f02486d8bed9eb0a2fd146c/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:16.647922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c860e6-605d-448b-ab68-ba76d44a1341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=429dfdc4a0a849028956867339c28b3a, user_id=788260309f02486d8bed9eb0a2fd146c, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:16.652013 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c860e6-605d-448b-ab68-ba76d44a1341 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:16.664016 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 950/1931] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:16.684406 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 982/1932] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:16 2022] PUT /identity/v3/projects/429dfdc4a0a849028956867339c28b3a/users/788260309f02486d8bed9eb0a2fd146c/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:04:16.696712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91a871-f6b9-42bc-a757-309037daf278 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:16.697022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91a871-f6b9-42bc-a757-309037daf278 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:16.697254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91a871-f6b9-42bc-a757-309037daf278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:16.731315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-5a91a871-f6b9-42bc-a757-309037daf278 None None] MFA Rules not processed for user `788260309f02486d8bed9eb0a2fd146c`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:16.733359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5a91a871-f6b9-42bc-a757-309037daf278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:16.834369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c860e6-605d-448b-ab68-ba76d44a1341 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:16.837931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 951/1933] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:16.947700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c860e6-605d-448b-ab68-ba76d44a1341 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:16.963362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea7a2e-bc0d-41a3-b149-caa4ee3f039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:16.965114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea7a2e-bc0d-41a3-b149-caa4ee3f039e admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:16.965851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea7a2e-bc0d-41a3-b149-caa4ee3f039e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:16.967657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea7a2e-bc0d-41a3-b149-caa4ee3f039e admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:16.969907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea7a2e-bc0d-41a3-b149-caa4ee3f039e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:16.976842 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea7a2e-bc0d-41a3-b149-caa4ee3f039e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:17.045788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 983/1934] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:16 2022] POST /identity/v3/projects => generated 379 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:17.050030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91a871-f6b9-42bc-a757-309037daf278 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:17.067844 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91a871-f6b9-42bc-a757-309037daf278 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:17.078808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:17.213148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6ec53-5896-4b55-a9af-5044f8cf21e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:17.213784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6ec53-5896-4b55-a9af-5044f8cf21e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:17.214072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6ec53-5896-4b55-a9af-5044f8cf21e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:17.214350 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6ec53-5896-4b55-a9af-5044f8cf21e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:17.215005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6ec53-5896-4b55-a9af-5044f8cf21e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:17.216991 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6ec53-5896-4b55-a9af-5044f8cf21e5 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:17.268947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 952/1935] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:17 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:04:17.275342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea7a2e-bc0d-41a3-b149-caa4ee3f039e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:17.287695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea7a2e-bc0d-41a3-b149-caa4ee3f039e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:17.292441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e2acc-f51a-4925-b586-839c84747f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:17.293069 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e2acc-f51a-4925-b586-839c84747f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:17.293351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e2acc-f51a-4925-b586-839c84747f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:17.293627 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e2acc-f51a-4925-b586-839c84747f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:17.294281 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e2acc-f51a-4925-b586-839c84747f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:17.296519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e2acc-f51a-4925-b586-839c84747f51 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:17.308763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 984/1936] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:17.313963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6ec53-5896-4b55-a9af-5044f8cf21e5 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:17.325500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6ec53-5896-4b55-a9af-5044f8cf21e5 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:17.344490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c94f55-25f4-4c54-802c-5042727b87c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:17.345433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c94f55-25f4-4c54-802c-5042727b87c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:17.347664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c94f55-25f4-4c54-802c-5042727b87c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:17.347664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c94f55-25f4-4c54-802c-5042727b87c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:17.350436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c94f55-25f4-4c54-802c-5042727b87c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:17.355802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c94f55-25f4-4c54-802c-5042727b87c5 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:17.382023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 953/1937] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:17.384777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e2acc-f51a-4925-b586-839c84747f51 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:17.402492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e2acc-f51a-4925-b586-839c84747f51 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:17.422364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a74e51-3576-4f2d-a775-1c1c84f4d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:17.425620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a74e51-3576-4f2d-a775-1c1c84f4d978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:17.426120 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a74e51-3576-4f2d-a775-1c1c84f4d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:17.426780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a74e51-3576-4f2d-a775-1c1c84f4d978 admin admin] PATH_INFO: `/v3/projects/c0351d6d0369427d8556cbf936a6fd23/users/3da21a5e7c134423bde302cc69796ccb/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:17.486668 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:17.496639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a74e51-3576-4f2d-a775-1c1c84f4d978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0351d6d0369427d8556cbf936a6fd23, user_id=3da21a5e7c134423bde302cc69796ccb, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:17.502162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a74e51-3576-4f2d-a775-1c1c84f4d978 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:17.524393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 985/1938] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:17 2022] PUT /identity/v3/projects/c0351d6d0369427d8556cbf936a6fd23/users/3da21a5e7c134423bde302cc69796ccb/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:17.546003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bbcfa-0c31-4a0e-b886-971034b03184 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:17.546289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bbcfa-0c31-4a0e-b886-971034b03184 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:17.546637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bbcfa-0c31-4a0e-b886-971034b03184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:17.578127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a74e51-3576-4f2d-a775-1c1c84f4d978 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:17.579980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-47a74e51-3576-4f2d-a775-1c1c84f4d978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:17.589099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-360bbcfa-0c31-4a0e-b886-971034b03184 None None] MFA Rules not processed for user `3da21a5e7c134423bde302cc69796ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:17.591478 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-360bbcfa-0c31-4a0e-b886-971034b03184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:17.661817 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a74e51-3576-4f2d-a775-1c1c84f4d978 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:17.671439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:17.672136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:17.672422 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:17.672691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] PATH_INFO: `/v3/projects/9ca80fdc60454569b3d64fcdb27c87f9` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:17.673866 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca80fdc60454569b3d64fcdb27c87f9)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:17.676048 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:17.746808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 954/1939] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:17.753117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bbcfa-0c31-4a0e-b886-971034b03184 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:17.766757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca80fdc60454569b3d64fcdb27c87f9', 'request_id': 'req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:17.776594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bbcfa-0c31-4a0e-b886-971034b03184 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:17.795636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca80fdc60454569b3d64fcdb27c87f9', 'request_id': 'req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:17.809532 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca80fdc60454569b3d64fcdb27c87f9', 'request_id': 'req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:17.830548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] The token cache is being invalidate because project 9ca80fdc60454569b3d64fcdb27c87f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:17.830891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:17.832103 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:17.834794 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 986/1940] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:17 2022] DELETE /identity/v3/projects/9ca80fdc60454569b3d64fcdb27c87f9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:17.838891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:17.841119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:17.865657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a3769-4704-461c-8b52-b9fe09c122d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:17.866638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a3769-4704-461c-8b52-b9fe09c122d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:17.866638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a3769-4704-461c-8b52-b9fe09c122d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:17.866906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a3769-4704-461c-8b52-b9fe09c122d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:17.867532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a3769-4704-461c-8b52-b9fe09c122d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:17.869455 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a3769-4704-461c-8b52-b9fe09c122d0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:17.917190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 955/1941] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:17 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:17.918506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a3769-4704-461c-8b52-b9fe09c122d0 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:17.922158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2f5a3769-4704-461c-8b52-b9fe09c122d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:17.927136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:17.946136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc0fe7-75ab-424e-87a9-e75be8a11fb2 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:17.984893 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:18.011434 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a3769-4704-461c-8b52-b9fe09c122d0 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:18.017736 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:18.018383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:18.018666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:18.019393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] PATH_INFO: `/v3/users/c88407d58cbe402d824ba672d49572f5` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:18.020694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88407d58cbe402d824ba672d49572f5)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:18.022759 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:18.036099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863c376-1d97-4341-a2fd-064680bd67a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:18.036949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863c376-1d97-4341-a2fd-064680bd67a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:18.037063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863c376-1d97-4341-a2fd-064680bd67a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:18.037293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863c376-1d97-4341-a2fd-064680bd67a2 admin admin] PATH_INFO: `/v3/users/69d40134626a4053a865210eb695aacb` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:18.038791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863c376-1d97-4341-a2fd-064680bd67a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d40134626a4053a865210eb695aacb)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:18.041156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863c376-1d97-4341-a2fd-064680bd67a2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:18.084648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88407d58cbe402d824ba672d49572f5'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:18.094740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88407d58cbe402d824ba672d49572f5'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:18.095676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88407d58cbe402d824ba672d49572f5'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:18.096981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88407d58cbe402d824ba672d49572f5'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:18.113095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88407d58cbe402d824ba672d49572f5'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:18.118675 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9863c376-1d97-4341-a2fd-064680bd67a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d40134626a4053a865210eb695aacb'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:18.135046 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9863c376-1d97-4341-a2fd-064680bd67a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d40134626a4053a865210eb695aacb'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:18.140372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 956/1942] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:17 2022] DELETE /identity/v3/users/c88407d58cbe402d824ba672d49572f5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:18.140372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:18.140372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:18.147851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9863c376-1d97-4341-a2fd-064680bd67a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d40134626a4053a865210eb695aacb'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:18.148907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9863c376-1d97-4341-a2fd-064680bd67a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d40134626a4053a865210eb695aacb'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:18.166127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9863c376-1d97-4341-a2fd-064680bd67a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d40134626a4053a865210eb695aacb'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:18.175687 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 987/1943] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:17 2022] DELETE /identity/v3/users/69d40134626a4053a865210eb695aacb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:04:18.177312 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d051b97-aac5-435c-bf48-9259406fbe36 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:18.177607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d051b97-aac5-435c-bf48-9259406fbe36 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:18.177889 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d051b97-aac5-435c-bf48-9259406fbe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:18.202048 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2d051b97-aac5-435c-bf48-9259406fbe36 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:18.203612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2d051b97-aac5-435c-bf48-9259406fbe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:18.218032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f2ada-4ada-4110-a702-4c04b54586b7 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:18.264779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:18.284214 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 988/1944] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:18.298226 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d051b97-aac5-435c-bf48-9259406fbe36 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:18.301233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2d051b97-aac5-435c-bf48-9259406fbe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:18.352324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b1e06-3b63-4eb0-9d23-39eadb317b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:18.353214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b1e06-3b63-4eb0-9d23-39eadb317b80 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:18.353644 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b1e06-3b63-4eb0-9d23-39eadb317b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:18.354063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b1e06-3b63-4eb0-9d23-39eadb317b80 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:18.355473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b1e06-3b63-4eb0-9d23-39eadb317b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:18.357842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b1e06-3b63-4eb0-9d23-39eadb317b80 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:18.378580 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:18.385128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d051b97-aac5-435c-bf48-9259406fbe36 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:18.392179 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77aef26-e5b1-4093-8b76-e8ecef51f7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:18.394237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aef26-e5b1-4093-8b76-e8ecef51f7ee service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:18.395135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aef26-e5b1-4093-8b76-e8ecef51f7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:18.396243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aef26-e5b1-4093-8b76-e8ecef51f7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:18.402765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 957/1945] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:18 2022] POST /identity/v3/users => generated 296 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:18.408652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77aef26-e5b1-4093-8b76-e8ecef51f7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:18.408859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b1e06-3b63-4eb0-9d23-39eadb317b80 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:18.410295 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77aef26-e5b1-4093-8b76-e8ecef51f7ee service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:18.411166 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-072b1e06-3b63-4eb0-9d23-39eadb317b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:18.423153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 989/1946] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:04:18.438465 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b1e06-3b63-4eb0-9d23-39eadb317b80 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:18.462905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cf0d1-b791-4e8f-8776-0ffd7d572f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:18.463934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cf0d1-b791-4e8f-8776-0ffd7d572f3b admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:18.464496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cf0d1-b791-4e8f-8776-0ffd7d572f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:18.464946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cf0d1-b791-4e8f-8776-0ffd7d572f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:18.465881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cf0d1-b791-4e8f-8776-0ffd7d572f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:18.468609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cf0d1-b791-4e8f-8776-0ffd7d572f3b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:18.488012 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c3b96-2b37-45f9-ad91-b1f91d04c572 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:18.488669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c3b96-2b37-45f9-ad91-b1f91d04c572 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:18.489597 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c3b96-2b37-45f9-ad91-b1f91d04c572 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:18.492363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 990/1947] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 08:04:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:18.501173 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c3b96-2b37-45f9-ad91-b1f91d04c572 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:18.501694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 958/1948] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:04:18.518583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9b98-093c-4c03-aa62-5cbd9bd7b539 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:18.519504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9b98-093c-4c03-aa62-5cbd9bd7b539 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:18.520392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9b98-093c-4c03-aa62-5cbd9bd7b539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:18.539104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c3b96-2b37-45f9-ad91-b1f91d04c572 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:18.562543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b397e-12aa-4d05-a4df-2f73f8c6402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:18.563423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b397e-12aa-4d05-a4df-2f73f8c6402b admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:18.563632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b397e-12aa-4d05-a4df-2f73f8c6402b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:18.564018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b397e-12aa-4d05-a4df-2f73f8c6402b admin admin] PATH_INFO: `/v3/projects/513ae2d4935245bab08b435fbbcb6f09/users/eadb4ae1a754468a83ef30445194c435/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:18.569537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-6dbb9b98-093c-4c03-aa62-5cbd9bd7b539 None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:18.571052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6dbb9b98-093c-4c03-aa62-5cbd9bd7b539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:18.622451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b397e-12aa-4d05-a4df-2f73f8c6402b admin admin] RBAC: Authorizing `identity:create_grant(project_id=513ae2d4935245bab08b435fbbcb6f09, user_id=eadb4ae1a754468a83ef30445194c435, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:18.629211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b397e-12aa-4d05-a4df-2f73f8c6402b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:18.662827 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 991/1949] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:18 2022] PUT /identity/v3/projects/513ae2d4935245bab08b435fbbcb6f09/users/eadb4ae1a754468a83ef30445194c435/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:18.663653 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b397e-12aa-4d05-a4df-2f73f8c6402b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:18.752448 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 959/1950] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 08:04:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:18.753847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b397e-12aa-4d05-a4df-2f73f8c6402b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:18.760099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d28e06-2c8f-4523-a566-c0f5783ccab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:18.760820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d28e06-2c8f-4523-a566-c0f5783ccab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:18.761166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d28e06-2c8f-4523-a566-c0f5783ccab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:18.761586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d28e06-2c8f-4523-a566-c0f5783ccab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:18.769596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d28e06-2c8f-4523-a566-c0f5783ccab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:18.771552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d28e06-2c8f-4523-a566-c0f5783ccab5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:18.786541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 992/1951] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:18.790752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9b98-093c-4c03-aa62-5cbd9bd7b539 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:18.824732 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9b98-093c-4c03-aa62-5cbd9bd7b539 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:18.868074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a667c6-7e19-459e-aae1-9c026dc6aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:18.870399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a667c6-7e19-459e-aae1-9c026dc6aac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:18.874196 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a667c6-7e19-459e-aae1-9c026dc6aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:18.874663 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a667c6-7e19-459e-aae1-9c026dc6aac5 admin admin] PATH_INFO: `/v3/projects/513ae2d4935245bab08b435fbbcb6f09/users/eadb4ae1a754468a83ef30445194c435/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:18.888442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a667c6-7e19-459e-aae1-9c026dc6aac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513ae2d4935245bab08b435fbbcb6f09, user_id=eadb4ae1a754468a83ef30445194c435, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:18.904924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a667c6-7e19-459e-aae1-9c026dc6aac5 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:18.950844 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 960/1952] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:18 2022] PUT /identity/v3/projects/513ae2d4935245bab08b435fbbcb6f09/users/eadb4ae1a754468a83ef30445194c435/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:18.954820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227bf62-5121-4ef1-b59d-26ffe9dbfd7c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:18.955525 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227bf62-5121-4ef1-b59d-26ffe9dbfd7c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:18.956618 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227bf62-5121-4ef1-b59d-26ffe9dbfd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:18.983545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a667c6-7e19-459e-aae1-9c026dc6aac5 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:18.986721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d8a667c6-7e19-459e-aae1-9c026dc6aac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:19.003096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3227bf62-5121-4ef1-b59d-26ffe9dbfd7c None None] MFA Rules not processed for user `eadb4ae1a754468a83ef30445194c435`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:19.004560 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3227bf62-5121-4ef1-b59d-26ffe9dbfd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:19.116936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 993/1953] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:19.133671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227bf62-5121-4ef1-b59d-26ffe9dbfd7c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:19.135381 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3227bf62-5121-4ef1-b59d-26ffe9dbfd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:19.230990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:19.242363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227bf62-5121-4ef1-b59d-26ffe9dbfd7c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:19.249809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b414b-004d-4f4a-92e1-a495b036c52b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:19.250437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b414b-004d-4f4a-92e1-a495b036c52b service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:19.250714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b414b-004d-4f4a-92e1-a495b036c52b service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:19.250981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b414b-004d-4f4a-92e1-a495b036c52b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:19.253444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a667c6-7e19-459e-aae1-9c026dc6aac5 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:19.265694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db016e71-bf31-42f8-bf75-6c707e91cddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:19.266380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b414b-004d-4f4a-92e1-a495b036c52b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:19.267260 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db016e71-bf31-42f8-bf75-6c707e91cddf service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:19.268017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db016e71-bf31-42f8-bf75-6c707e91cddf service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:19.269031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db016e71-bf31-42f8-bf75-6c707e91cddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:19.269217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b414b-004d-4f4a-92e1-a495b036c52b service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:19.288740 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 994/1954] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:19.290546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b414b-004d-4f4a-92e1-a495b036c52b service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:19.292826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0d8b414b-004d-4f4a-92e1-a495b036c52b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:19.298766 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db016e71-bf31-42f8-bf75-6c707e91cddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:19.300835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db016e71-bf31-42f8-bf75-6c707e91cddf service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:19.317904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 961/1955] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:04:19.322614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db016e71-bf31-42f8-bf75-6c707e91cddf service nova] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:19.329108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-db016e71-bf31-42f8-bf75-6c707e91cddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:19.364222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:19.405376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b414b-004d-4f4a-92e1-a495b036c52b service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:19.412762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:19.414377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:19.414377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:19.415554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] PATH_INFO: `/v3/projects/87cf2d6b3a874d31808c00269b9e9501` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:19.422123 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87cf2d6b3a874d31808c00269b9e9501)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:19.425251 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:19.481772 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87cf2d6b3a874d31808c00269b9e9501', 'request_id': 'req-1af510aa-e6d9-467c-aa59-853ec9c92362'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:19.482223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db016e71-bf31-42f8-bf75-6c707e91cddf service nova] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:19.489830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87cf2d6b3a874d31808c00269b9e9501', 'request_id': 'req-1af510aa-e6d9-467c-aa59-853ec9c92362'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:19.498818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87cf2d6b3a874d31808c00269b9e9501', 'request_id': 'req-1af510aa-e6d9-467c-aa59-853ec9c92362'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:19.517517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] The token cache is being invalidate because project 87cf2d6b3a874d31808c00269b9e9501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:19.518886 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:19.519838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:19.522309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 995/1956] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:19 2022] DELETE /identity/v3/projects/87cf2d6b3a874d31808c00269b9e9501 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:19.523354 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:19.527420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:19.599722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:19.600710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:19.601333 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:19.601619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b admin admin] PATH_INFO: `/v3/projects/b2428290a0fa4ea1b2174413d712acfd` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:19.602811 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2428290a0fa4ea1b2174413d712acfd)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:19.604931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:19.646058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af510aa-e6d9-467c-aa59-853ec9c92362 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:19.653396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7a98d-809e-4fb3-9995-c19068973c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:19.655094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7a98d-809e-4fb3-9995-c19068973c7a service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:19.655756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7a98d-809e-4fb3-9995-c19068973c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:19.656324 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7a98d-809e-4fb3-9995-c19068973c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:19.659602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-69c7a98d-809e-4fb3-9995-c19068973c7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:19.680399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2428290a0fa4ea1b2174413d712acfd', 'request_id': 'req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:19.688941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2428290a0fa4ea1b2174413d712acfd', 'request_id': 'req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:19.697681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2428290a0fa4ea1b2174413d712acfd', 'request_id': 'req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:19.716763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b admin admin] The token cache is being invalidate because project b2428290a0fa4ea1b2174413d712acfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:19.717487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:19.718344 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a4e54ad-5e30-47f3-b258-c68c2d637e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:19.720454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 962/1957] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:19 2022] DELETE /identity/v3/projects/b2428290a0fa4ea1b2174413d712acfd => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:19.721653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5200f52-afa5-4fdc-bbfe-365dae556d88 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:19.722007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5200f52-afa5-4fdc-bbfe-365dae556d88 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:19.722485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5200f52-afa5-4fdc-bbfe-365dae556d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:19.749441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:19.755095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b5200f52-afa5-4fdc-bbfe-365dae556d88 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:19.756926 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b5200f52-afa5-4fdc-bbfe-365dae556d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:19.814479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7a98d-809e-4fb3-9995-c19068973c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:19.817571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7a98d-809e-4fb3-9995-c19068973c7a service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:19.830351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:19.842821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 996/1958] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:19.845374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7a98d-809e-4fb3-9995-c19068973c7a service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:19.848538 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-69c7a98d-809e-4fb3-9995-c19068973c7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:19.865900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 963/1959] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:19.874980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b33f-82eb-402a-94c5-8ec30cde1342 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:19.875553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b33f-82eb-402a-94c5-8ec30cde1342 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:19.876798 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b33f-82eb-402a-94c5-8ec30cde1342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:19.878331 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7a98d-809e-4fb3-9995-c19068973c7a service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:19.888651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:19.891769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:19.892130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:19.892317 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] PATH_INFO: `/v3/users/b4e2e37ba9714a0c9ace59baaba72a76` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:19.896724 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e2e37ba9714a0c9ace59baaba72a76)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:19.898770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:19.923830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-f114b33f-82eb-402a-94c5-8ec30cde1342 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:19.929127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f114b33f-82eb-402a-94c5-8ec30cde1342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:19.969490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 964/1960] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:19.976398 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114b33f-82eb-402a-94c5-8ec30cde1342 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:20.013219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114b33f-82eb-402a-94c5-8ec30cde1342 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:20.024649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437932f-83bc-4500-8256-c0ba48567783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:20.026055 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437932f-83bc-4500-8256-c0ba48567783 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:20.026608 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437932f-83bc-4500-8256-c0ba48567783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:20.027110 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437932f-83bc-4500-8256-c0ba48567783 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:20.028417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437932f-83bc-4500-8256-c0ba48567783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:20.028938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437932f-83bc-4500-8256-c0ba48567783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:20.033641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437932f-83bc-4500-8256-c0ba48567783 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:20.091978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 965/1961] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:04:20.093289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e2e37ba9714a0c9ace59baaba72a76'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:20.104655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437932f-83bc-4500-8256-c0ba48567783 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:20.130913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e2e37ba9714a0c9ace59baaba72a76'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:20.140746 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437932f-83bc-4500-8256-c0ba48567783 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:20.159553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e2e37ba9714a0c9ace59baaba72a76'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:20.164873 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e2e37ba9714a0c9ace59baaba72a76'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:20.188418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92ada1-2f08-40bf-87c9-35d994eaf969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:20.192186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92ada1-2f08-40bf-87c9-35d994eaf969 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:20.193096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92ada1-2f08-40bf-87c9-35d994eaf969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:20.196660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92ada1-2f08-40bf-87c9-35d994eaf969 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:20.205350 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b92ada1-2f08-40bf-87c9-35d994eaf969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:20.210081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e2e37ba9714a0c9ace59baaba72a76'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:20.213666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b92ada1-2f08-40bf-87c9-35d994eaf969 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:20.234788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 997/1962] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:19 2022] DELETE /identity/v3/users/b4e2e37ba9714a0c9ace59baaba72a76 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:20.235860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:20.240235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:20.331052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 966/1963] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:20 2022] POST /identity/v3/projects => generated 409 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:20.335822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92ada1-2f08-40bf-87c9-35d994eaf969 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:20.341552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2b92ada1-2f08-40bf-87c9-35d994eaf969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:20.455137 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399ba0f-4af8-472e-974b-4986a18a3d7d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:20.500936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92ada1-2f08-40bf-87c9-35d994eaf969 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:20.509759 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeecbb5-f8b2-4583-aa68-3ae6ff0450f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:20.511543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeecbb5-f8b2-4583-aa68-3ae6ff0450f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:20.512020 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeecbb5-f8b2-4583-aa68-3ae6ff0450f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:20.512447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeecbb5-f8b2-4583-aa68-3ae6ff0450f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:20.513463 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeecbb5-f8b2-4583-aa68-3ae6ff0450f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:20.517556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeecbb5-f8b2-4583-aa68-3ae6ff0450f6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:20.571778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 967/1964] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:20 2022] POST /identity/v3/users => generated 305 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:20.575524 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeecbb5-f8b2-4583-aa68-3ae6ff0450f6 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:20.577058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:20.593692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f3c3d-f8dc-4196-b3dd-e6b50b602422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:20.595022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f3c3d-f8dc-4196-b3dd-e6b50b602422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:20.595835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f3c3d-f8dc-4196-b3dd-e6b50b602422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:20.596530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f3c3d-f8dc-4196-b3dd-e6b50b602422 admin admin] PATH_INFO: `/v3/users/2d57111910ed4f4d9b56f64eb51d1d3d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:20.597929 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f3c3d-f8dc-4196-b3dd-e6b50b602422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d57111910ed4f4d9b56f64eb51d1d3d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:20.600054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f3c3d-f8dc-4196-b3dd-e6b50b602422 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:20.605602 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeecbb5-f8b2-4583-aa68-3ae6ff0450f6 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:20.624244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee4b1d-ab8d-4177-8069-c845d6d63482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:20.625147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee4b1d-ab8d-4177-8069-c845d6d63482 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:20.625586 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee4b1d-ab8d-4177-8069-c845d6d63482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:20.626637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee4b1d-ab8d-4177-8069-c845d6d63482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:20.627519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee4b1d-ab8d-4177-8069-c845d6d63482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:20.629461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee4b1d-ab8d-4177-8069-c845d6d63482 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:20.674150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 968/1965] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:04:20.679620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee4b1d-ab8d-4177-8069-c845d6d63482 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:20.709280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee4b1d-ab8d-4177-8069-c845d6d63482 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:20.731954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129062e-fb9b-4a42-b37f-71f9788b66c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:20.733384 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129062e-fb9b-4a42-b37f-71f9788b66c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:20.733673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129062e-fb9b-4a42-b37f-71f9788b66c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:20.738234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129062e-fb9b-4a42-b37f-71f9788b66c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:20.739024 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129062e-fb9b-4a42-b37f-71f9788b66c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:20.751670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-484f3c3d-f8dc-4196-b3dd-e6b50b602422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d57111910ed4f4d9b56f64eb51d1d3d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:20.752684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129062e-fb9b-4a42-b37f-71f9788b66c5 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:20.765930 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-484f3c3d-f8dc-4196-b3dd-e6b50b602422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d57111910ed4f4d9b56f64eb51d1d3d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:20.786526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 969/1966] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:20.787474 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129062e-fb9b-4a42-b37f-71f9788b66c5 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:20.789326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-484f3c3d-f8dc-4196-b3dd-e6b50b602422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d57111910ed4f4d9b56f64eb51d1d3d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:20.791442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-484f3c3d-f8dc-4196-b3dd-e6b50b602422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d57111910ed4f4d9b56f64eb51d1d3d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:20.814408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129062e-fb9b-4a42-b37f-71f9788b66c5 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:20.829232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2deafd4-7fc5-463a-b800-ead564e46379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:20.830199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2deafd4-7fc5-463a-b800-ead564e46379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:20.830488 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2deafd4-7fc5-463a-b800-ead564e46379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:20.830772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2deafd4-7fc5-463a-b800-ead564e46379 admin admin] PATH_INFO: `/v3/projects/f6de3a7de1a94c4dab7ac0ab312d549f/users/546e78ab8be64d69af156e1c4a39284a/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:20.833329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-484f3c3d-f8dc-4196-b3dd-e6b50b602422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d57111910ed4f4d9b56f64eb51d1d3d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:20.847615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 998/1967] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:20 2022] DELETE /identity/v3/users/2d57111910ed4f4d9b56f64eb51d1d3d => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:20.849656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2deafd4-7fc5-463a-b800-ead564e46379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6de3a7de1a94c4dab7ac0ab312d549f, user_id=546e78ab8be64d69af156e1c4a39284a, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:20.850215 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202405f-dc2f-4b2d-88c9-fe20f1c8021e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:20.850554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202405f-dc2f-4b2d-88c9-fe20f1c8021e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:20.850829 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202405f-dc2f-4b2d-88c9-fe20f1c8021e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:20.852667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2deafd4-7fc5-463a-b800-ead564e46379 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:20.876817 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6202405f-dc2f-4b2d-88c9-fe20f1c8021e None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:20.878339 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6202405f-dc2f-4b2d-88c9-fe20f1c8021e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:20.881402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 970/1968] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:20 2022] PUT /identity/v3/projects/f6de3a7de1a94c4dab7ac0ab312d549f/users/546e78ab8be64d69af156e1c4a39284a/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:20.883483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffca86d-6089-4e49-8a5b-154561d855c4 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:20.883806 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffca86d-6089-4e49-8a5b-154561d855c4 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:20.884085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffca86d-6089-4e49-8a5b-154561d855c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:20.924792 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-7ffca86d-6089-4e49-8a5b-154561d855c4 None None] MFA Rules not processed for user `546e78ab8be64d69af156e1c4a39284a`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:20.926052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7ffca86d-6089-4e49-8a5b-154561d855c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:20.959001 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 999/1969] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:20.965896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202405f-dc2f-4b2d-88c9-fe20f1c8021e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:20.968675 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6202405f-dc2f-4b2d-88c9-fe20f1c8021e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:20.988614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:21.020351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 971/1970] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:20 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:21.024646 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffca86d-6089-4e49-8a5b-154561d855c4 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:21.026015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7ffca86d-6089-4e49-8a5b-154561d855c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:21.037021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202405f-dc2f-4b2d-88c9-fe20f1c8021e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:21.040022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffca86d-6089-4e49-8a5b-154561d855c4 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:21.040901 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d157d00-d4ad-4e92-b034-c4b47ad4c64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:21.041505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d157d00-d4ad-4e92-b034-c4b47ad4c64c service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.041783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d157d00-d4ad-4e92-b034-c4b47ad4c64c service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.042062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d157d00-d4ad-4e92-b034-c4b47ad4c64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.045160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e9598-cd31-4b82-b01e-b8cab49030aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:21.045784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e9598-cd31-4b82-b01e-b8cab49030aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.046064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e9598-cd31-4b82-b01e-b8cab49030aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.046335 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e9598-cd31-4b82-b01e-b8cab49030aa admin admin] PATH_INFO: `/v3/projects/901dff56e5d640fba4f987e58a399cce` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.047454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e9598-cd31-4b82-b01e-b8cab49030aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=901dff56e5d640fba4f987e58a399cce)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:21.050360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e9598-cd31-4b82-b01e-b8cab49030aa admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:21.052334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d157d00-d4ad-4e92-b034-c4b47ad4c64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:21.053820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d157d00-d4ad-4e92-b034-c4b47ad4c64c service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:21.064984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1000/1971] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:04:21.065806 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d157d00-d4ad-4e92-b034-c4b47ad4c64c service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:21.067675 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6d157d00-d4ad-4e92-b034-c4b47ad4c64c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:21.082254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d157d00-d4ad-4e92-b034-c4b47ad4c64c service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:21.088098 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd21f8-c008-41be-abc5-fd660a7d2d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:21.088868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd21f8-c008-41be-abc5-fd660a7d2d30 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.089268 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd21f8-c008-41be-abc5-fd660a7d2d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.089547 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd21f8-c008-41be-abc5-fd660a7d2d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.090186 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd21f8-c008-41be-abc5-fd660a7d2d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:21.092317 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd21f8-c008-41be-abc5-fd660a7d2d30 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:21.105619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-605e9598-cd31-4b82-b01e-b8cab49030aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901dff56e5d640fba4f987e58a399cce', 'request_id': 'req-605e9598-cd31-4b82-b01e-b8cab49030aa'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:21.114624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-605e9598-cd31-4b82-b01e-b8cab49030aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901dff56e5d640fba4f987e58a399cce', 'request_id': 'req-605e9598-cd31-4b82-b01e-b8cab49030aa'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:21.123044 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-605e9598-cd31-4b82-b01e-b8cab49030aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901dff56e5d640fba4f987e58a399cce', 'request_id': 'req-605e9598-cd31-4b82-b01e-b8cab49030aa'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:21.123794 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:21.141613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1001/1972] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:21 2022] POST /identity/v3/projects => generated 409 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:21.146503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd21f8-c008-41be-abc5-fd660a7d2d30 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:21.154231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-605e9598-cd31-4b82-b01e-b8cab49030aa admin admin] The token cache is being invalidate because project 901dff56e5d640fba4f987e58a399cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:21.154231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-605e9598-cd31-4b82-b01e-b8cab49030aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:21.154231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-605e9598-cd31-4b82-b01e-b8cab49030aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:21.169184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 972/1973] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:21 2022] DELETE /identity/v3/projects/901dff56e5d640fba4f987e58a399cce => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:21.169184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732ae31-3744-479d-a5e7-6b230dcfb54d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.169184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732ae31-3744-479d-a5e7-6b230dcfb54d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.169184 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732ae31-3744-479d-a5e7-6b230dcfb54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.210212 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-3732ae31-3744-479d-a5e7-6b230dcfb54d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:21.211510 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-3732ae31-3744-479d-a5e7-6b230dcfb54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:21.280697 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd21f8-c008-41be-abc5-fd660a7d2d30 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:21.286136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59082b6e-0352-46bd-9b14-4de0ee2b59f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:21.286775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59082b6e-0352-46bd-9b14-4de0ee2b59f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.287068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59082b6e-0352-46bd-9b14-4de0ee2b59f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.287350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59082b6e-0352-46bd-9b14-4de0ee2b59f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.288138 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59082b6e-0352-46bd-9b14-4de0ee2b59f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:21.290742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59082b6e-0352-46bd-9b14-4de0ee2b59f2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:21.299885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 973/1974] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:21.307387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33846b-b5c2-452d-884d-035ee79275c3 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.307676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33846b-b5c2-452d-884d-035ee79275c3 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.308036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33846b-b5c2-452d-884d-035ee79275c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.316947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1002/1975] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:21 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:21.320924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59082b6e-0352-46bd-9b14-4de0ee2b59f2 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:21.324341 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-59082b6e-0352-46bd-9b14-4de0ee2b59f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:21.334205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-1f33846b-b5c2-452d-884d-035ee79275c3 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:21.336336 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1f33846b-b5c2-452d-884d-035ee79275c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:21.344064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59082b6e-0352-46bd-9b14-4de0ee2b59f2 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:21.346364 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 974/1976] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:21.350841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33846b-b5c2-452d-884d-035ee79275c3 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:21.366208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76071e7-a127-446a-9aa7-6aef29706781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:21.366208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76071e7-a127-446a-9aa7-6aef29706781 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.366208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76071e7-a127-446a-9aa7-6aef29706781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.366208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76071e7-a127-446a-9aa7-6aef29706781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.366652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76071e7-a127-446a-9aa7-6aef29706781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:21.366728 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33846b-b5c2-452d-884d-035ee79275c3 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:21.366807 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76071e7-a127-446a-9aa7-6aef29706781 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:21.367684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d45139-8588-42ba-840c-1bacb2c4f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:21.368337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d45139-8588-42ba-840c-1bacb2c4f8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.368624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d45139-8588-42ba-840c-1bacb2c4f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.369090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d45139-8588-42ba-840c-1bacb2c4f8e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.369756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d45139-8588-42ba-840c-1bacb2c4f8e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:21.370063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d45139-8588-42ba-840c-1bacb2c4f8e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:21.371714 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d45139-8588-42ba-840c-1bacb2c4f8e8 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:21.379840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1003/1977] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:21.383792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76071e7-a127-446a-9aa7-6aef29706781 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:21.385996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 975/1978] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:04:21.390774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d45139-8588-42ba-840c-1bacb2c4f8e8 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:21.400828 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76071e7-a127-446a-9aa7-6aef29706781 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:21.402402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d45139-8588-42ba-840c-1bacb2c4f8e8 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:21.408210 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae088e-45fe-4023-8d63-8836750520e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:21.408966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae088e-45fe-4023-8d63-8836750520e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.409344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae088e-45fe-4023-8d63-8836750520e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.409774 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae088e-45fe-4023-8d63-8836750520e7 admin admin] PATH_INFO: `/v3/projects/b8e17a39ceda45b091b474c4436862aa/users/ab7536a0cb6844e2bb7b0dd708fa613a/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.424274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2a0bb-4ed5-402e-98e0-83a7310bd5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:21.425243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2a0bb-4ed5-402e-98e0-83a7310bd5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.425523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2a0bb-4ed5-402e-98e0-83a7310bd5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.425929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2a0bb-4ed5-402e-98e0-83a7310bd5e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.426665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2a0bb-4ed5-402e-98e0-83a7310bd5e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:21.429602 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2a0bb-4ed5-402e-98e0-83a7310bd5e2 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:21.450319 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae088e-45fe-4023-8d63-8836750520e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e17a39ceda45b091b474c4436862aa, user_id=ab7536a0cb6844e2bb7b0dd708fa613a, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:21.460288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae088e-45fe-4023-8d63-8836750520e7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:21.475138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 976/1979] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:21 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:04:21.476166 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2a0bb-4ed5-402e-98e0-83a7310bd5e2 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:21.478229 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-40b2a0bb-4ed5-402e-98e0-83a7310bd5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:21.497298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1004/1980] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:21 2022] PUT /identity/v3/projects/b8e17a39ceda45b091b474c4436862aa/users/ab7536a0cb6844e2bb7b0dd708fa613a/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:04:21.497298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae088e-45fe-4023-8d63-8836750520e7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:21.531678 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:21.582671 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2a0bb-4ed5-402e-98e0-83a7310bd5e2 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:21.607497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae088e-45fe-4023-8d63-8836750520e7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:21.627298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd68c8-2c44-40dd-a092-5f96fba315d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:21.630158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd68c8-2c44-40dd-a092-5f96fba315d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.630459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd68c8-2c44-40dd-a092-5f96fba315d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.630742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd68c8-2c44-40dd-a092-5f96fba315d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.631442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd68c8-2c44-40dd-a092-5f96fba315d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:21.633510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd68c8-2c44-40dd-a092-5f96fba315d9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:21.661657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1005/1981] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:21 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:21.662358 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd68c8-2c44-40dd-a092-5f96fba315d9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:21.676238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:21.677128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.677425 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.677703 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] PATH_INFO: `/v3/projects/293b1486f17b4404b9c371d2bc6d320c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.679049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=293b1486f17b4404b9c371d2bc6d320c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:21.682230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:21.689204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd68c8-2c44-40dd-a092-5f96fba315d9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:21.694482 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e52593-7516-4a7f-92fc-8c8d9d0c131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:21.703161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e52593-7516-4a7f-92fc-8c8d9d0c131f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.703345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e52593-7516-4a7f-92fc-8c8d9d0c131f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.703608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e52593-7516-4a7f-92fc-8c8d9d0c131f admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.704422 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e52593-7516-4a7f-92fc-8c8d9d0c131f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:21.706288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e52593-7516-4a7f-92fc-8c8d9d0c131f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:21.721618 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1006/1982] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:21.722756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e52593-7516-4a7f-92fc-8c8d9d0c131f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:21.736270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e52593-7516-4a7f-92fc-8c8d9d0c131f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:21.759788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293b1486f17b4404b9c371d2bc6d320c', 'request_id': 'req-fb5b088c-2897-4849-a868-e5de05faf7e1'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:21.772633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293b1486f17b4404b9c371d2bc6d320c', 'request_id': 'req-fb5b088c-2897-4849-a868-e5de05faf7e1'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:21.777716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:21.785169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293b1486f17b4404b9c371d2bc6d320c', 'request_id': 'req-fb5b088c-2897-4849-a868-e5de05faf7e1'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:21.806095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] The token cache is being invalidate because project 293b1486f17b4404b9c371d2bc6d320c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:21.806695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:21.808209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:21.811399 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 977/1983] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:21 2022] DELETE /identity/v3/projects/293b1486f17b4404b9c371d2bc6d320c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:21.812541 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:21.814788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:21.847109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f6b98-cc89-4ca7-841a-6f2a6e0b8d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:21.848492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f6b98-cc89-4ca7-841a-6f2a6e0b8d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.849806 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f6b98-cc89-4ca7-841a-6f2a6e0b8d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.850359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f6b98-cc89-4ca7-841a-6f2a6e0b8d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.851932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f6b98-cc89-4ca7-841a-6f2a6e0b8d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:21.855987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f6b98-cc89-4ca7-841a-6f2a6e0b8d54 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:21.899025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1007/1984] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:21.900026 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f6b98-cc89-4ca7-841a-6f2a6e0b8d54 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:21.902109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a28f6b98-cc89-4ca7-841a-6f2a6e0b8d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:21.929070 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f6b98-cc89-4ca7-841a-6f2a6e0b8d54 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:21.940365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30f928-1069-4658-abd2-a528545af8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:21.941341 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30f928-1069-4658-abd2-a528545af8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:21.956613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30f928-1069-4658-abd2-a528545af8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:21.957204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30f928-1069-4658-abd2-a528545af8b3 admin admin] PATH_INFO: `/v3/users/0aeb1d539a3344bfba7c51ef13589c85` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:21.959027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30f928-1069-4658-abd2-a528545af8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aeb1d539a3344bfba7c51ef13589c85)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:21.962663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30f928-1069-4658-abd2-a528545af8b3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:21.996486 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b088c-2897-4849-a868-e5de05faf7e1 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:22.011079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7167b72-8cdb-456a-9413-647bfc8e086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:22.011793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7167b72-8cdb-456a-9413-647bfc8e086d admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:22.012081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7167b72-8cdb-456a-9413-647bfc8e086d admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:22.012356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7167b72-8cdb-456a-9413-647bfc8e086d admin admin] PATH_INFO: `/v3/projects/b8e17a39ceda45b091b474c4436862aa/users/ab7536a0cb6844e2bb7b0dd708fa613a/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:22.017738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7167b72-8cdb-456a-9413-647bfc8e086d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e17a39ceda45b091b474c4436862aa, user_id=ab7536a0cb6844e2bb7b0dd708fa613a, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:22.020566 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7167b72-8cdb-456a-9413-647bfc8e086d admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:22.027652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:22.054805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5a30f928-1069-4658-abd2-a528545af8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aeb1d539a3344bfba7c51ef13589c85'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:22.070834 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 978/1985] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:21 2022] PUT /identity/v3/projects/b8e17a39ceda45b091b474c4436862aa/users/ab7536a0cb6844e2bb7b0dd708fa613a/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:22.070834 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7167b72-8cdb-456a-9413-647bfc8e086d admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:22.071469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5a30f928-1069-4658-abd2-a528545af8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aeb1d539a3344bfba7c51ef13589c85'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:22.073430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a7167b72-8cdb-456a-9413-647bfc8e086d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:22.096198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5a30f928-1069-4658-abd2-a528545af8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aeb1d539a3344bfba7c51ef13589c85'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:22.096482 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5a30f928-1069-4658-abd2-a528545af8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aeb1d539a3344bfba7c51ef13589c85'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:22.118800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5a30f928-1069-4658-abd2-a528545af8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aeb1d539a3344bfba7c51ef13589c85'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:22.132568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1008/1986] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:21 2022] DELETE /identity/v3/users/0aeb1d539a3344bfba7c51ef13589c85 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:22.134376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a83c-882f-44be-b409-7dec2052b1bd None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:22.134730 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a83c-882f-44be-b409-7dec2052b1bd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:22.135076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a83c-882f-44be-b409-7dec2052b1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:22.175668 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f8b5a83c-882f-44be-b409-7dec2052b1bd None None] MFA Rules not processed for user `ab7536a0cb6844e2bb7b0dd708fa613a`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:22.177579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f8b5a83c-882f-44be-b409-7dec2052b1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:22.222493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7167b72-8cdb-456a-9413-647bfc8e086d admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:22.284758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1009/1987] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:22 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:22.297256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5a83c-882f-44be-b409-7dec2052b1bd None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:22.302948 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f8b5a83c-882f-44be-b409-7dec2052b1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:22.316121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7845b4-ee5c-4754-9e76-df26c8e38d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:22.317054 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7845b4-ee5c-4754-9e76-df26c8e38d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:22.317183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7845b4-ee5c-4754-9e76-df26c8e38d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:22.317388 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7845b4-ee5c-4754-9e76-df26c8e38d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:22.318381 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7845b4-ee5c-4754-9e76-df26c8e38d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:22.331928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7845b4-ee5c-4754-9e76-df26c8e38d5b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:22.353651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 979/1988] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:22.354738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7845b4-ee5c-4754-9e76-df26c8e38d5b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:22.356502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-9e7845b4-ee5c-4754-9e76-df26c8e38d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:22.360065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:22.377408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7845b4-ee5c-4754-9e76-df26c8e38d5b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:22.384391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e933f8a-b597-4bdd-b9d0-53381e89d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:22.385297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933f8a-b597-4bdd-b9d0-53381e89d5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:22.385798 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933f8a-b597-4bdd-b9d0-53381e89d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:22.385946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933f8a-b597-4bdd-b9d0-53381e89d5a1 admin admin] PATH_INFO: `/v3/projects/a34658d4e5874704827edeca2114a85b/users/931e02eaa26f4b428934e25aa4cd9b83/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:22.405471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e933f8a-b597-4bdd-b9d0-53381e89d5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34658d4e5874704827edeca2114a85b, user_id=931e02eaa26f4b428934e25aa4cd9b83, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:22.409192 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e933f8a-b597-4bdd-b9d0-53381e89d5a1 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:22.410517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5a83c-882f-44be-b409-7dec2052b1bd None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:22.415958 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec50c3-7a68-408a-8cc6-c228f26fc68c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:22.416628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec50c3-7a68-408a-8cc6-c228f26fc68c service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:22.417045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec50c3-7a68-408a-8cc6-c228f26fc68c service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:22.417374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec50c3-7a68-408a-8cc6-c228f26fc68c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:22.430843 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 980/1989] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:22 2022] PUT /identity/v3/projects/a34658d4e5874704827edeca2114a85b/users/931e02eaa26f4b428934e25aa4cd9b83/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:22.432605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec50c3-7a68-408a-8cc6-c228f26fc68c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:22.434232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec50c3-7a68-408a-8cc6-c228f26fc68c service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:22.443669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c48f28-8033-4389-9c63-9f5462fcef45 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:22.443993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c48f28-8033-4389-9c63-9f5462fcef45 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:22.444301 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c48f28-8033-4389-9c63-9f5462fcef45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:22.470754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1010/1990] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:22 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:22.495832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-06c48f28-8033-4389-9c63-9f5462fcef45 None None] MFA Rules not processed for user `931e02eaa26f4b428934e25aa4cd9b83`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:22.497996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-06c48f28-8033-4389-9c63-9f5462fcef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:22.550981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec50c3-7a68-408a-8cc6-c228f26fc68c service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:22.553419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-66ec50c3-7a68-408a-8cc6-c228f26fc68c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:22.601122 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec50c3-7a68-408a-8cc6-c228f26fc68c service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:22.657369 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 981/1991] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:22.670288 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c48f28-8033-4389-9c63-9f5462fcef45 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:22.674981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-06c48f28-8033-4389-9c63-9f5462fcef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:22.684129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:22.706447 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:22.707152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:22.707506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:22.707985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] PATH_INFO: `/v3/projects/8ab06fa5f1a949eab26cdae30e2b0e27` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:22.709227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab06fa5f1a949eab26cdae30e2b0e27)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:22.711509 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:22.776790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab06fa5f1a949eab26cdae30e2b0e27', 'request_id': 'req-05c4b728-ed3b-4557-81a7-bfbf7770b929'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:22.782881 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab06fa5f1a949eab26cdae30e2b0e27', 'request_id': 'req-05c4b728-ed3b-4557-81a7-bfbf7770b929'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:22.789674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab06fa5f1a949eab26cdae30e2b0e27', 'request_id': 'req-05c4b728-ed3b-4557-81a7-bfbf7770b929'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:22.803911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c48f28-8033-4389-9c63-9f5462fcef45 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:22.806554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] The token cache is being invalidate because project 8ab06fa5f1a949eab26cdae30e2b0e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:22.806997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:22.807672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:22.809238 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1011/1992] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:22 2022] DELETE /identity/v3/projects/8ab06fa5f1a949eab26cdae30e2b0e27 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:22.810009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:22.812002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:22.866493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078c8d5-5a2d-417d-bdf9-0e32ef7ec874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:22.867382 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078c8d5-5a2d-417d-bdf9-0e32ef7ec874 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:22.867382 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078c8d5-5a2d-417d-bdf9-0e32ef7ec874 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:22.867662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078c8d5-5a2d-417d-bdf9-0e32ef7ec874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:22.869586 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7078c8d5-5a2d-417d-bdf9-0e32ef7ec874 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:22.880369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4b728-ed3b-4557-81a7-bfbf7770b929 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:22.884210 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e6e62-f281-403c-87f9-8c689bc8c2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:22.884834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e6e62-f281-403c-87f9-8c689bc8c2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:22.885119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e6e62-f281-403c-87f9-8c689bc8c2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:22.885397 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e6e62-f281-403c-87f9-8c689bc8c2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:22.887326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fe4e6e62-f281-403c-87f9-8c689bc8c2d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:22.903697 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:22.939977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078c8d5-5a2d-417d-bdf9-0e32ef7ec874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:22.941414 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078c8d5-5a2d-417d-bdf9-0e32ef7ec874 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:22.950289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 982/1993] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:22.951699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf845ec-3d89-410c-82fd-b1c4df692810 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:22.952063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf845ec-3d89-410c-82fd-b1c4df692810 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:22.952636 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf845ec-3d89-410c-82fd-b1c4df692810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:22.969350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e6e62-f281-403c-87f9-8c689bc8c2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:22.971482 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e6e62-f281-403c-87f9-8c689bc8c2d9 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:22.972927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-3bf845ec-3d89-410c-82fd-b1c4df692810 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:22.974195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-3bf845ec-3d89-410c-82fd-b1c4df692810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:22.980832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1012/1994] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:22 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:22.981649 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e6e62-f281-403c-87f9-8c689bc8c2d9 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:22.983471 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fe4e6e62-f281-403c-87f9-8c689bc8c2d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:23.040357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 983/1995] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:23.049670 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eb5a0-340e-42f7-939c-39b1adff9085 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:23.050038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eb5a0-340e-42f7-939c-39b1adff9085 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:23.050487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eb5a0-340e-42f7-939c-39b1adff9085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:23.055402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e6e62-f281-403c-87f9-8c689bc8c2d9 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:23.061361 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc4ca2-0fc9-498d-bf0f-4ee6a7e3176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:23.062074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc4ca2-0fc9-498d-bf0f-4ee6a7e3176d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:23.062442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc4ca2-0fc9-498d-bf0f-4ee6a7e3176d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:23.062783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc4ca2-0fc9-498d-bf0f-4ee6a7e3176d admin admin] PATH_INFO: `/v3/users/931e02eaa26f4b428934e25aa4cd9b83` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:23.064249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc4ca2-0fc9-498d-bf0f-4ee6a7e3176d admin admin] RBAC: Authorizing `identity:delete_user(user_id=931e02eaa26f4b428934e25aa4cd9b83)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:23.066254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc4ca2-0fc9-498d-bf0f-4ee6a7e3176d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:23.080591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-cf8eb5a0-340e-42f7-939c-39b1adff9085 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:23.082089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-cf8eb5a0-340e-42f7-939c-39b1adff9085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:23.090484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 984/1996] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:04:23.095145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eb5a0-340e-42f7-939c-39b1adff9085 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:23.111767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eb5a0-340e-42f7-939c-39b1adff9085 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:23.120172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800d490-f73d-42fb-bb24-4f6a415350e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:23.121570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800d490-f73d-42fb-bb24-4f6a415350e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:23.122054 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800d490-f73d-42fb-bb24-4f6a415350e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:23.122527 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800d490-f73d-42fb-bb24-4f6a415350e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:23.124040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800d490-f73d-42fb-bb24-4f6a415350e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:23.124724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800d490-f73d-42fb-bb24-4f6a415350e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:23.128206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800d490-f73d-42fb-bb24-4f6a415350e3 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:23.130996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:23.140001 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-abcc4ca2-0fc9-498d-bf0f-4ee6a7e3176d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931e02eaa26f4b428934e25aa4cd9b83'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:23.156543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 985/1997] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:04:23.163124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800d490-f73d-42fb-bb24-4f6a415350e3 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:23.164628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-abcc4ca2-0fc9-498d-bf0f-4ee6a7e3176d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931e02eaa26f4b428934e25aa4cd9b83'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:23.194458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-abcc4ca2-0fc9-498d-bf0f-4ee6a7e3176d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931e02eaa26f4b428934e25aa4cd9b83'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:23.197306 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-abcc4ca2-0fc9-498d-bf0f-4ee6a7e3176d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931e02eaa26f4b428934e25aa4cd9b83'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:23.207019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800d490-f73d-42fb-bb24-4f6a415350e3 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:23.229537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeb4f7-3abd-4f9e-8115-593eff640338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:23.232264 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeb4f7-3abd-4f9e-8115-593eff640338 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:23.232811 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeb4f7-3abd-4f9e-8115-593eff640338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:23.233295 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeb4f7-3abd-4f9e-8115-593eff640338 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:23.237076 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfeb4f7-3abd-4f9e-8115-593eff640338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:23.244762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfeb4f7-3abd-4f9e-8115-593eff640338 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:23.252767 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-abcc4ca2-0fc9-498d-bf0f-4ee6a7e3176d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931e02eaa26f4b428934e25aa4cd9b83'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:23.274483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1013/1998] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:22 2022] DELETE /identity/v3/users/931e02eaa26f4b428934e25aa4cd9b83 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:23.295897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0849055-81e7-4452-af07-9f70d71e57e5 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:23.295897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0849055-81e7-4452-af07-9f70d71e57e5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:23.295897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0849055-81e7-4452-af07-9f70d71e57e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:23.334338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 986/1999] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:23 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:23.338509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeb4f7-3abd-4f9e-8115-593eff640338 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:23.344236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-adfeb4f7-3abd-4f9e-8115-593eff640338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:23.345349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c0849055-81e7-4452-af07-9f70d71e57e5 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:23.346623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c0849055-81e7-4452-af07-9f70d71e57e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:23.380859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:23.442075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeb4f7-3abd-4f9e-8115-593eff640338 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:23.442075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f2c30-023c-47f2-868d-6c57f012c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:23.442075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f2c30-023c-47f2-868d-6c57f012c3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:23.442075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f2c30-023c-47f2-868d-6c57f012c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:23.442626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f2c30-023c-47f2-868d-6c57f012c3f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:23.442626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f2c30-023c-47f2-868d-6c57f012c3f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:23.442626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f2c30-023c-47f2-868d-6c57f012c3f2 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:23.450517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1014/2000] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:23.458781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0849055-81e7-4452-af07-9f70d71e57e5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:23.460229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c0849055-81e7-4452-af07-9f70d71e57e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:23.472281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 987/2001] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:23 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:23.476476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f2c30-023c-47f2-868d-6c57f012c3f2 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:23.494540 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f2c30-023c-47f2-868d-6c57f012c3f2 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:23.504306 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06308281-0c98-4e92-ae99-54b16eed4821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:23.505041 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06308281-0c98-4e92-ae99-54b16eed4821 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:23.505446 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06308281-0c98-4e92-ae99-54b16eed4821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:23.505823 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06308281-0c98-4e92-ae99-54b16eed4821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:23.506598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06308281-0c98-4e92-ae99-54b16eed4821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:23.508646 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06308281-0c98-4e92-ae99-54b16eed4821 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:23.520754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 988/2002] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:04:23.524553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06308281-0c98-4e92-ae99-54b16eed4821 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:23.535573 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06308281-0c98-4e92-ae99-54b16eed4821 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:23.540412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85f6a5-5712-44ed-89f6-e4a54c2baa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:23.541028 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85f6a5-5712-44ed-89f6-e4a54c2baa30 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:23.541309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85f6a5-5712-44ed-89f6-e4a54c2baa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:23.541413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0849055-81e7-4452-af07-9f70d71e57e5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:23.541581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85f6a5-5712-44ed-89f6-e4a54c2baa30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:23.542241 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85f6a5-5712-44ed-89f6-e4a54c2baa30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:23.544188 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85f6a5-5712-44ed-89f6-e4a54c2baa30 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:23.545833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ec4e6-880d-417d-b603-9eb96f1e9906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:23.546447 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ec4e6-880d-417d-b603-9eb96f1e9906 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:23.546779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ec4e6-880d-417d-b603-9eb96f1e9906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:23.547373 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ec4e6-880d-417d-b603-9eb96f1e9906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:23.556282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 989/2003] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:04:23.557458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ec4e6-880d-417d-b603-9eb96f1e9906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:23.558905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ec4e6-880d-417d-b603-9eb96f1e9906 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:23.561231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85f6a5-5712-44ed-89f6-e4a54c2baa30 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:23.569630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1015/2004] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:04:23.572561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85f6a5-5712-44ed-89f6-e4a54c2baa30 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:23.578034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170989d-3554-4fa8-998e-defeb96ea9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:23.578695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170989d-3554-4fa8-998e-defeb96ea9ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:23.578983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170989d-3554-4fa8-998e-defeb96ea9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:23.579259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170989d-3554-4fa8-998e-defeb96ea9ad admin admin] PATH_INFO: `/v3/projects/4d6d413bac1c4b9e98197c0c74edd821/users/b0b425309ac24db282c065d78750bd4f/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:23.595590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170989d-3554-4fa8-998e-defeb96ea9ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6d413bac1c4b9e98197c0c74edd821, user_id=b0b425309ac24db282c065d78750bd4f, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:23.598312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170989d-3554-4fa8-998e-defeb96ea9ad admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:23.614065 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 990/2005] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:23 2022] PUT /identity/v3/projects/4d6d413bac1c4b9e98197c0c74edd821/users/b0b425309ac24db282c065d78750bd4f/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:04:23.619636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb2dfb-198f-4043-9142-4842d25879a7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:23.619947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb2dfb-198f-4043-9142-4842d25879a7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:23.620277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb2dfb-198f-4043-9142-4842d25879a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:23.650355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f0cb2dfb-198f-4043-9142-4842d25879a7 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:23.651845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f0cb2dfb-198f-4043-9142-4842d25879a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:23.725356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170989d-3554-4fa8-998e-defeb96ea9ad admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:23.728386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f170989d-3554-4fa8-998e-defeb96ea9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:23.752724 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1016/2006] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:23.765253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb2dfb-198f-4043-9142-4842d25879a7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:23.768314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f0cb2dfb-198f-4043-9142-4842d25879a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:23.858170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170989d-3554-4fa8-998e-defeb96ea9ad admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:23.865520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:23.865767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:23.868780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:23.869302 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] PATH_INFO: `/v3/users/788260309f02486d8bed9eb0a2fd146c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:23.872947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb2dfb-198f-4043-9142-4842d25879a7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:23.873464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=788260309f02486d8bed9eb0a2fd146c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:23.877745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:23.878926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39106061-7127-4efc-8f62-d34934769d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:23.879624 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39106061-7127-4efc-8f62-d34934769d51 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:23.879935 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39106061-7127-4efc-8f62-d34934769d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:23.880210 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39106061-7127-4efc-8f62-d34934769d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:23.894248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39106061-7127-4efc-8f62-d34934769d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:23.896384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39106061-7127-4efc-8f62-d34934769d51 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:23.915815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1017/2007] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:23.923772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:23.984105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '788260309f02486d8bed9eb0a2fd146c'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:23.994293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '788260309f02486d8bed9eb0a2fd146c'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:23.995920 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '788260309f02486d8bed9eb0a2fd146c'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:23.996779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '788260309f02486d8bed9eb0a2fd146c'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:24.015357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '788260309f02486d8bed9eb0a2fd146c'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:24.036310 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 991/2008] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:23 2022] DELETE /identity/v3/users/788260309f02486d8bed9eb0a2fd146c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:24.039037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad0ead-d765-44b2-8448-3087fbf2ec7b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:24.040838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad0ead-d765-44b2-8448-3087fbf2ec7b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:24.040838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad0ead-d765-44b2-8448-3087fbf2ec7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:24.072703 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:24.073330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2bad0ead-d765-44b2-8448-3087fbf2ec7b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:24.074282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:24.078184 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2bad0ead-d765-44b2-8448-3087fbf2ec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:24.092882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:24.191149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1018/2009] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:24.228450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad0ead-d765-44b2-8448-3087fbf2ec7b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:24.230477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2bad0ead-d765-44b2-8448-3087fbf2ec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:24.234542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24897aae-00ce-4fff-83e8-78c5fec80072 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:24.243189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:24.243921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:24.244405 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:24.244690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022 admin admin] PATH_INFO: `/v3/projects/a34658d4e5874704827edeca2114a85b` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:24.246849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34658d4e5874704827edeca2114a85b)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:24.249137 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:24.314724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34658d4e5874704827edeca2114a85b', 'request_id': 'req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:24.321580 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34658d4e5874704827edeca2114a85b', 'request_id': 'req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:24.331888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34658d4e5874704827edeca2114a85b', 'request_id': 'req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:24.334676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad0ead-d765-44b2-8448-3087fbf2ec7b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:24.355436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022 admin admin] The token cache is being invalidate because project a34658d4e5874704827edeca2114a85b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:24.355436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:24.355436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8ede9a7e-6052-4dac-9c83-91ec0f1e2022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:24.357463 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 992/2010] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:24 2022] DELETE /identity/v3/projects/a34658d4e5874704827edeca2114a85b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:04:24.367843 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a97e1e-0284-45e8-9078-e2fedddd16cf None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:24.369365 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a97e1e-0284-45e8-9078-e2fedddd16cf None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:24.370661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a97e1e-0284-45e8-9078-e2fedddd16cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:24.452437 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-95a97e1e-0284-45e8-9078-e2fedddd16cf None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:24.453683 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-95a97e1e-0284-45e8-9078-e2fedddd16cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:24.507937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:24.535900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a46dd-3e46-4023-bbe2-654fad53d1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:24.536980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a46dd-3e46-4023-bbe2-654fad53d1da service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:24.537468 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a46dd-3e46-4023-bbe2-654fad53d1da service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:24.537940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a46dd-3e46-4023-bbe2-654fad53d1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:24.542618 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c81a46dd-3e46-4023-bbe2-654fad53d1da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:24.587261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 993/2011] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:04:24.589230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af168b22-7213-418a-b9bf-0bf66cad9897 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:24.589964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af168b22-7213-418a-b9bf-0bf66cad9897 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:24.590447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af168b22-7213-418a-b9bf-0bf66cad9897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:24.614062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-af168b22-7213-418a-b9bf-0bf66cad9897 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:24.615299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-af168b22-7213-418a-b9bf-0bf66cad9897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:24.629413 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 994/2012] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:24.630850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af168b22-7213-418a-b9bf-0bf66cad9897 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:24.642711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af168b22-7213-418a-b9bf-0bf66cad9897 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:24.648242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae228d-787b-4998-937f-f9f9b2316a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:24.648923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae228d-787b-4998-937f-f9f9b2316a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:24.649216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae228d-787b-4998-937f-f9f9b2316a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:24.649639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae228d-787b-4998-937f-f9f9b2316a55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:24.650485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae228d-787b-4998-937f-f9f9b2316a55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:24.650957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae228d-787b-4998-937f-f9f9b2316a55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:24.653145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae228d-787b-4998-937f-f9f9b2316a55 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:24.677692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 995/2013] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:04:24.679476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae228d-787b-4998-937f-f9f9b2316a55 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:24.705117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae228d-787b-4998-937f-f9f9b2316a55 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:24.720702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f372-9518-4b39-9082-a7f25ddba2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:24.721417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f372-9518-4b39-9082-a7f25ddba2ab admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:24.721572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f372-9518-4b39-9082-a7f25ddba2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:24.721966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f372-9518-4b39-9082-a7f25ddba2ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:24.722589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902f372-9518-4b39-9082-a7f25ddba2ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:24.729726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902f372-9518-4b39-9082-a7f25ddba2ab admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:24.811418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 996/2014] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:24 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:24.814208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f372-9518-4b39-9082-a7f25ddba2ab admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:24.817893 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a46dd-3e46-4023-bbe2-654fad53d1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:24.819388 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a46dd-3e46-4023-bbe2-654fad53d1da service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:24.862514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1019/2015] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:24.936130 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f372-9518-4b39-9082-a7f25ddba2ab admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:24.943596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522127f-6d82-4839-a68d-0d3e206f2ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:24.944332 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522127f-6d82-4839-a68d-0d3e206f2ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:24.944663 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522127f-6d82-4839-a68d-0d3e206f2ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:24.944939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522127f-6d82-4839-a68d-0d3e206f2ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:24.945650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522127f-6d82-4839-a68d-0d3e206f2ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:24.949177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522127f-6d82-4839-a68d-0d3e206f2ad4 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:24.990717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a46dd-3e46-4023-bbe2-654fad53d1da service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:25.002317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 997/2016] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:24 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:25.009827 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a46dd-3e46-4023-bbe2-654fad53d1da service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:25.023933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06398e07-9eab-4c8b-8e08-caafc1e43596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:25.026741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06398e07-9eab-4c8b-8e08-caafc1e43596 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:25.027844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06398e07-9eab-4c8b-8e08-caafc1e43596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:25.028505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06398e07-9eab-4c8b-8e08-caafc1e43596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:25.031685 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06398e07-9eab-4c8b-8e08-caafc1e43596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:25.035162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06398e07-9eab-4c8b-8e08-caafc1e43596 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:25.070451 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522127f-6d82-4839-a68d-0d3e206f2ad4 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:25.077479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1020/2017] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:25.084141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522127f-6d82-4839-a68d-0d3e206f2ad4 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:25.096726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d85d69-45a6-4ec8-a534-f45566d8ab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:25.097549 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d85d69-45a6-4ec8-a534-f45566d8ab51 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:25.097962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d85d69-45a6-4ec8-a534-f45566d8ab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:25.098459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d85d69-45a6-4ec8-a534-f45566d8ab51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:25.099397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d85d69-45a6-4ec8-a534-f45566d8ab51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:25.101236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d85d69-45a6-4ec8-a534-f45566d8ab51 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:25.120892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 998/2018] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:25.122258 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06398e07-9eab-4c8b-8e08-caafc1e43596 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:25.134863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06398e07-9eab-4c8b-8e08-caafc1e43596 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:25.140419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4174a7-dbfa-43e8-b5eb-275c11f8aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:25.140848 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4174a7-dbfa-43e8-b5eb-275c11f8aeab admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:25.141127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4174a7-dbfa-43e8-b5eb-275c11f8aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:25.141394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4174a7-dbfa-43e8-b5eb-275c11f8aeab admin admin] PATH_INFO: `/v3/projects/ca015190ccb0476ba05b5c6a91917abc/users/2ae6313cbfba45278b16b3187527d6fa/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:25.150677 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:25.159830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4174a7-dbfa-43e8-b5eb-275c11f8aeab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca015190ccb0476ba05b5c6a91917abc, user_id=2ae6313cbfba45278b16b3187527d6fa, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:25.162871 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4174a7-dbfa-43e8-b5eb-275c11f8aeab admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:25.180303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1021/2019] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:25 2022] PUT /identity/v3/projects/ca015190ccb0476ba05b5c6a91917abc/users/2ae6313cbfba45278b16b3187527d6fa/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:25.193948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43706a3-a98a-4c75-b942-5c54376b9ed4 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:25.195075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43706a3-a98a-4c75-b942-5c54376b9ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:25.195276 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43706a3-a98a-4c75-b942-5c54376b9ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:25.253260 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e43706a3-a98a-4c75-b942-5c54376b9ed4 None None] MFA Rules not processed for user `2ae6313cbfba45278b16b3187527d6fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:25.255247 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e43706a3-a98a-4c75-b942-5c54376b9ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:25.322154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:25.344220 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 999/2020] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:25.358348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4174a7-dbfa-43e8-b5eb-275c11f8aeab admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:25.361238 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5a4174a7-dbfa-43e8-b5eb-275c11f8aeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:25.462164 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4174a7-dbfa-43e8-b5eb-275c11f8aeab admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:25.468428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaafbf-ab74-4ac8-8497-40a19d00d627 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553916344aaf40ae8abb050540f10559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:25.469055 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaafbf-ab74-4ac8-8497-40a19d00d627 service glance] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:25.469334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaafbf-ab74-4ac8-8497-40a19d00d627 service glance] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:25.469604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaafbf-ab74-4ac8-8497-40a19d00d627 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:25.479097 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbaafbf-ab74-4ac8-8497-40a19d00d627 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:25.480650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbaafbf-ab74-4ac8-8497-40a19d00d627 service glance] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:25.494231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1022/2021] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:25.749285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb6cc0-5fb8-4048-a1d4-e41029842adb None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:25.749744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb6cc0-5fb8-4048-a1d4-e41029842adb None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:25.750165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb6cc0-5fb8-4048-a1d4-e41029842adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:25.816690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-9beb6cc0-5fb8-4048-a1d4-e41029842adb None None] MFA Rules not processed for user `b0b425309ac24db282c065d78750bd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:25.819189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-9beb6cc0-5fb8-4048-a1d4-e41029842adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:25.953397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1000/2022] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:25.960087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaafbf-ab74-4ac8-8497-40a19d00d627 service glance] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:25.961762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1bbaafbf-ab74-4ac8-8497-40a19d00d627 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:25.979915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb6cc0-5fb8-4048-a1d4-e41029842adb None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:25.982984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-9beb6cc0-5fb8-4048-a1d4-e41029842adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:26.128024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaafbf-ab74-4ac8-8497-40a19d00d627 service glance] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:26.139560 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb6cc0-5fb8-4048-a1d4-e41029842adb None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:26.141393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:26.142096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:26.142337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:26.142609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] PATH_INFO: `/v3/projects/429dfdc4a0a849028956867339c28b3a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:26.143866 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=429dfdc4a0a849028956867339c28b3a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:26.145836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:26.153505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b37eb5-8818-44da-9f97-882233217c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:26.154135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b37eb5-8818-44da-9f97-882233217c4e service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:26.154513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b37eb5-8818-44da-9f97-882233217c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:26.154902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b37eb5-8818-44da-9f97-882233217c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:26.165424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b37eb5-8818-44da-9f97-882233217c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:26.166871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b37eb5-8818-44da-9f97-882233217c4e service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:26.212070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1001/2023] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:26.272309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '429dfdc4a0a849028956867339c28b3a', 'request_id': 'req-8bd8c860-ae61-40d5-8a6f-41eec209b337'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:26.289961 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '429dfdc4a0a849028956867339c28b3a', 'request_id': 'req-8bd8c860-ae61-40d5-8a6f-41eec209b337'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:26.310376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '429dfdc4a0a849028956867339c28b3a', 'request_id': 'req-8bd8c860-ae61-40d5-8a6f-41eec209b337'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:26.329809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:26.335678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] The token cache is being invalidate because project 429dfdc4a0a849028956867339c28b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:26.336721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:26.338865 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:26.347011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1023/2024] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:25 2022] DELETE /identity/v3/projects/429dfdc4a0a849028956867339c28b3a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:26.351087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b37eb5-8818-44da-9f97-882233217c4e service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:26.377915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b37eb5-8818-44da-9f97-882233217c4e service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:26.614326 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fac9cd-ebea-4b6b-9c80-941e400ce870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:26.615716 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fac9cd-ebea-4b6b-9c80-941e400ce870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:26.617004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fac9cd-ebea-4b6b-9c80-941e400ce870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:26.618179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fac9cd-ebea-4b6b-9c80-941e400ce870 admin admin] PATH_INFO: `/v3/users/3da21a5e7c134423bde302cc69796ccb` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:26.620403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fac9cd-ebea-4b6b-9c80-941e400ce870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da21a5e7c134423bde302cc69796ccb)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:26.624219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fac9cd-ebea-4b6b-9c80-941e400ce870 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:26.707793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:26.769234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e9fac9cd-ebea-4b6b-9c80-941e400ce870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da21a5e7c134423bde302cc69796ccb'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:26.783329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e9fac9cd-ebea-4b6b-9c80-941e400ce870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da21a5e7c134423bde302cc69796ccb'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:26.784242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e9fac9cd-ebea-4b6b-9c80-941e400ce870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da21a5e7c134423bde302cc69796ccb'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:26.784998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e9fac9cd-ebea-4b6b-9c80-941e400ce870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da21a5e7c134423bde302cc69796ccb'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:26.831401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e9fac9cd-ebea-4b6b-9c80-941e400ce870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da21a5e7c134423bde302cc69796ccb'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:26.852343 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1002/2025] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:26 2022] DELETE /identity/v3/users/3da21a5e7c134423bde302cc69796ccb => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:28.090596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:28.093509 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:28.117114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8c860-ae61-40d5-8a6f-41eec209b337 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:28.173737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e8d04-8e8d-4eee-b6cd-4c5f65732629 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:28.174539 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e8d04-8e8d-4eee-b6cd-4c5f65732629 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:28.174539 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e8d04-8e8d-4eee-b6cd-4c5f65732629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:28.242087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-7f8e8d04-8e8d-4eee-b6cd-4c5f65732629 None None] MFA Rules not processed for user `b0b425309ac24db282c065d78750bd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:28.243381 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7f8e8d04-8e8d-4eee-b6cd-4c5f65732629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:28.258442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:28.259688 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:28.260714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:28.261313 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] PATH_INFO: `/v3/projects/c0351d6d0369427d8556cbf936a6fd23` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:28.263016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0351d6d0369427d8556cbf936a6fd23)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:28.265637 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:28.367080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1003/2026] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:04:28.412900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0351d6d0369427d8556cbf936a6fd23', 'request_id': 'req-6d1530bc-aead-4b06-9663-a5e7ca28fcae'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:28.428036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0351d6d0369427d8556cbf936a6fd23', 'request_id': 'req-6d1530bc-aead-4b06-9663-a5e7ca28fcae'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:28.437792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0351d6d0369427d8556cbf936a6fd23', 'request_id': 'req-6d1530bc-aead-4b06-9663-a5e7ca28fcae'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:28.467359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] The token cache is being invalidate because project c0351d6d0369427d8556cbf936a6fd23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:28.467664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:28.468358 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:28.471796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1024/2027] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:28 2022] DELETE /identity/v3/projects/c0351d6d0369427d8556cbf936a6fd23 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:28.478219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e8d04-8e8d-4eee-b6cd-4c5f65732629 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:28.480657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7f8e8d04-8e8d-4eee-b6cd-4c5f65732629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:28.519608 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e8d04-8e8d-4eee-b6cd-4c5f65732629 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:28.728561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a7bba-591b-4353-b3aa-9be40c21b878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:28.735721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a7bba-591b-4353-b3aa-9be40c21b878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:28.736769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a7bba-591b-4353-b3aa-9be40c21b878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:28.737707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a7bba-591b-4353-b3aa-9be40c21b878 admin admin] PATH_INFO: `/v3/users/eadb4ae1a754468a83ef30445194c435` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:28.744181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a7bba-591b-4353-b3aa-9be40c21b878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eadb4ae1a754468a83ef30445194c435)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:28.756806 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a7bba-591b-4353-b3aa-9be40c21b878 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:28.881694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-930a7bba-591b-4353-b3aa-9be40c21b878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eadb4ae1a754468a83ef30445194c435'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:28.892369 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:28.925751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-930a7bba-591b-4353-b3aa-9be40c21b878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eadb4ae1a754468a83ef30445194c435'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:28.927577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-930a7bba-591b-4353-b3aa-9be40c21b878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eadb4ae1a754468a83ef30445194c435'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:28.929212 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-930a7bba-591b-4353-b3aa-9be40c21b878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eadb4ae1a754468a83ef30445194c435'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:28.981795 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-930a7bba-591b-4353-b3aa-9be40c21b878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eadb4ae1a754468a83ef30445194c435'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:29.028395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1004/2028] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:28 2022] DELETE /identity/v3/users/eadb4ae1a754468a83ef30445194c435 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:30.017982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:30.023675 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:30.080227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1530bc-aead-4b06-9663-a5e7ca28fcae admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:30.214786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:30.215478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:30.215793 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:30.216950 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] PATH_INFO: `/v3/projects/513ae2d4935245bab08b435fbbcb6f09` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:30.234701 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=513ae2d4935245bab08b435fbbcb6f09)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:30.237483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:30.321555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:30.364672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513ae2d4935245bab08b435fbbcb6f09', 'request_id': 'req-62fd7692-e247-49f0-ad07-24ed24126f55'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:30.374070 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513ae2d4935245bab08b435fbbcb6f09', 'request_id': 'req-62fd7692-e247-49f0-ad07-24ed24126f55'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:30.396071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513ae2d4935245bab08b435fbbcb6f09', 'request_id': 'req-62fd7692-e247-49f0-ad07-24ed24126f55'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:30.452158 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] The token cache is being invalidate because project 513ae2d4935245bab08b435fbbcb6f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:30.458306 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:30.461443 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:30.475986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1025/2029] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:30 2022] DELETE /identity/v3/projects/513ae2d4935245bab08b435fbbcb6f09 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:30.477727 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8291ad4-c9fd-483e-ae4f-0bbc8224134d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:30.479294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8291ad4-c9fd-483e-ae4f-0bbc8224134d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:30.479835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8291ad4-c9fd-483e-ae4f-0bbc8224134d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:30.493833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:30.498188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:30.588440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e8291ad4-c9fd-483e-ae4f-0bbc8224134d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:30.593379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e8291ad4-c9fd-483e-ae4f-0bbc8224134d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:30.782464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd7692-e247-49f0-ad07-24ed24126f55 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:30.806081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918aa3a1-89a0-41b5-9fb2-2bb958596948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:30.806985 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1005/2030] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:30.816685 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aa3a1-89a0-41b5-9fb2-2bb958596948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:30.816973 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aa3a1-89a0-41b5-9fb2-2bb958596948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:30.817252 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aa3a1-89a0-41b5-9fb2-2bb958596948 admin admin] PATH_INFO: `/v3/users/546e78ab8be64d69af156e1c4a39284a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:30.823704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af69e3-cf73-4292-a256-dba36c27fb84 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:30.824247 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af69e3-cf73-4292-a256-dba36c27fb84 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:30.824669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af69e3-cf73-4292-a256-dba36c27fb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:30.830048 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918aa3a1-89a0-41b5-9fb2-2bb958596948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546e78ab8be64d69af156e1c4a39284a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:30.830048 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918aa3a1-89a0-41b5-9fb2-2bb958596948 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:30.867537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-11af69e3-cf73-4292-a256-dba36c27fb84 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:30.869362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-11af69e3-cf73-4292-a256-dba36c27fb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:30.889614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1006/2031] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:30.891720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af69e3-cf73-4292-a256-dba36c27fb84 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:30.932429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af69e3-cf73-4292-a256-dba36c27fb84 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:30.936859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-918aa3a1-89a0-41b5-9fb2-2bb958596948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546e78ab8be64d69af156e1c4a39284a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:30.947616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-918aa3a1-89a0-41b5-9fb2-2bb958596948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546e78ab8be64d69af156e1c4a39284a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:30.956485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ba392-03e8-4e52-ae37-9f64a611cc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:30.956874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-918aa3a1-89a0-41b5-9fb2-2bb958596948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546e78ab8be64d69af156e1c4a39284a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:30.957406 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ba392-03e8-4e52-ae37-9f64a611cc13 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:30.957840 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ba392-03e8-4e52-ae37-9f64a611cc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:30.958018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-918aa3a1-89a0-41b5-9fb2-2bb958596948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546e78ab8be64d69af156e1c4a39284a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:30.958253 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ba392-03e8-4e52-ae37-9f64a611cc13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:30.959306 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ba392-03e8-4e52-ae37-9f64a611cc13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:30.959791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ba392-03e8-4e52-ae37-9f64a611cc13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:30.962441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ba392-03e8-4e52-ae37-9f64a611cc13 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:30.977044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-918aa3a1-89a0-41b5-9fb2-2bb958596948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546e78ab8be64d69af156e1c4a39284a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:30.988481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1026/2032] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:30 2022] DELETE /identity/v3/users/546e78ab8be64d69af156e1c4a39284a => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:30.992962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42deaa-0a15-4d84-9952-128a1bcae81e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:30.993621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42deaa-0a15-4d84-9952-128a1bcae81e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:30.994164 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42deaa-0a15-4d84-9952-128a1bcae81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:31.031257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8e42deaa-0a15-4d84-9952-128a1bcae81e None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:31.032851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8e42deaa-0a15-4d84-9952-128a1bcae81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:31.035131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1007/2033] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:04:31.038133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ba392-03e8-4e52-ae37-9f64a611cc13 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:31.053268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5a7ba392-03e8-4e52-ae37-9f64a611cc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:31.095576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:31.118495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ba392-03e8-4e52-ae37-9f64a611cc13 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:31.137437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1027/2034] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:31.153860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42deaa-0a15-4d84-9952-128a1bcae81e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:31.156013 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8e42deaa-0a15-4d84-9952-128a1bcae81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:31.254292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41536e90-4b36-4c28-93e1-8c151e56ecfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:31.254840 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41536e90-4b36-4c28-93e1-8c151e56ecfe admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:31.255595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41536e90-4b36-4c28-93e1-8c151e56ecfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:31.255595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41536e90-4b36-4c28-93e1-8c151e56ecfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:31.260225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41536e90-4b36-4c28-93e1-8c151e56ecfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:31.260936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41536e90-4b36-4c28-93e1-8c151e56ecfe admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:31.280038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42deaa-0a15-4d84-9952-128a1bcae81e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:31.286114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affa4e3-e6c0-40de-87e7-26670ae847ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:31.287264 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affa4e3-e6c0-40de-87e7-26670ae847ec service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:31.287940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affa4e3-e6c0-40de-87e7-26670ae847ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:31.288298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affa4e3-e6c0-40de-87e7-26670ae847ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:31.323330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affa4e3-e6c0-40de-87e7-26670ae847ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:31.325067 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affa4e3-e6c0-40de-87e7-26670ae847ec service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:31.331228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1008/2035] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:31 2022] POST /identity/v3/projects => generated 385 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:31.332678 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41536e90-4b36-4c28-93e1-8c151e56ecfe admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:31.338333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1028/2036] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:04:31.390170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:31.435692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41536e90-4b36-4c28-93e1-8c151e56ecfe admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:31.445825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eea0f0-b07f-4029-9225-11e4c1334222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:31.446728 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eea0f0-b07f-4029-9225-11e4c1334222 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:31.447064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eea0f0-b07f-4029-9225-11e4c1334222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:31.447387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eea0f0-b07f-4029-9225-11e4c1334222 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:31.448102 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eea0f0-b07f-4029-9225-11e4c1334222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:31.450356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eea0f0-b07f-4029-9225-11e4c1334222 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:31.488022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1009/2037] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:31 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:31.493231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affa4e3-e6c0-40de-87e7-26670ae847ec service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:31.508235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affa4e3-e6c0-40de-87e7-26670ae847ec service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:31.514424 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882cf2b-7e1c-4e80-86ac-a95d50a05fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:31.515074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882cf2b-7e1c-4e80-86ac-a95d50a05fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:31.515365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882cf2b-7e1c-4e80-86ac-a95d50a05fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:31.515633 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882cf2b-7e1c-4e80-86ac-a95d50a05fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:31.516360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882cf2b-7e1c-4e80-86ac-a95d50a05fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:31.518318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882cf2b-7e1c-4e80-86ac-a95d50a05fa1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:31.542481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1029/2038] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:31.546931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eea0f0-b07f-4029-9225-11e4c1334222 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:31.559181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eea0f0-b07f-4029-9225-11e4c1334222 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:31.565895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90858f34-ced1-400f-b8f0-aabeb0c4dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:31.567439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90858f34-ced1-400f-b8f0-aabeb0c4dbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:31.567825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90858f34-ced1-400f-b8f0-aabeb0c4dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:31.568183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90858f34-ced1-400f-b8f0-aabeb0c4dbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:31.568979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90858f34-ced1-400f-b8f0-aabeb0c4dbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:31.571340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90858f34-ced1-400f-b8f0-aabeb0c4dbe6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:31.598959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1010/2039] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:31.603143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882cf2b-7e1c-4e80-86ac-a95d50a05fa1 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:31.619342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882cf2b-7e1c-4e80-86ac-a95d50a05fa1 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:31.635502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd5771-f819-4492-a20d-6552cc952ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:31.636536 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd5771-f819-4492-a20d-6552cc952ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:31.636960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd5771-f819-4492-a20d-6552cc952ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:31.637380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd5771-f819-4492-a20d-6552cc952ba4 admin admin] PATH_INFO: `/v3/projects/fa47e83732f64a789587efd59c0da54a/users/2682e6e4a9974989873b6310c60f7f36/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:31.660463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd5771-f819-4492-a20d-6552cc952ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa47e83732f64a789587efd59c0da54a, user_id=2682e6e4a9974989873b6310c60f7f36, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:31.663177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd5771-f819-4492-a20d-6552cc952ba4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:31.689624 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1030/2040] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:31 2022] PUT /identity/v3/projects/fa47e83732f64a789587efd59c0da54a/users/2682e6e4a9974989873b6310c60f7f36/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:31.705347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd5771-f819-4492-a20d-6552cc952ba4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:31.706466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ba50e-eff9-4256-8d8b-b868fde9db32 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:31.707217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ba50e-eff9-4256-8d8b-b868fde9db32 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:31.707529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ba50e-eff9-4256-8d8b-b868fde9db32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:31.707819 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-02cd5771-f819-4492-a20d-6552cc952ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:31.751557 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-167ba50e-eff9-4256-8d8b-b868fde9db32 None None] MFA Rules not processed for user `2682e6e4a9974989873b6310c60f7f36`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:31.753392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-167ba50e-eff9-4256-8d8b-b868fde9db32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:31.833227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd5771-f819-4492-a20d-6552cc952ba4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:31.838242 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:31.838885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1011/2041] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:31.839209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:31.839625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:31.840800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] PATH_INFO: `/v3/projects/f6de3a7de1a94c4dab7ac0ab312d549f` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:31.843635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6de3a7de1a94c4dab7ac0ab312d549f)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:31.844386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ba50e-eff9-4256-8d8b-b868fde9db32 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:31.846559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:31.855374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ba50e-eff9-4256-8d8b-b868fde9db32 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:31.866867 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f70225-7705-4fd2-84f0-994e71a690dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:31.867495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f70225-7705-4fd2-84f0-994e71a690dc admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:31.867808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f70225-7705-4fd2-84f0-994e71a690dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:31.868086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f70225-7705-4fd2-84f0-994e71a690dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:31.869778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f70225-7705-4fd2-84f0-994e71a690dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:31.871952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f70225-7705-4fd2-84f0-994e71a690dc admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:31.925623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1012/2042] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:31 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:31.930214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f70225-7705-4fd2-84f0-994e71a690dc admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:31.940600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6de3a7de1a94c4dab7ac0ab312d549f', 'request_id': 'req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:31.942103 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:31.969778 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6de3a7de1a94c4dab7ac0ab312d549f', 'request_id': 'req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:31.984587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6de3a7de1a94c4dab7ac0ab312d549f', 'request_id': 'req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:32.010713 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] The token cache is being invalidate because project f6de3a7de1a94c4dab7ac0ab312d549f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:32.010978 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:32.011622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:32.015786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1031/2043] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:31 2022] DELETE /identity/v3/projects/f6de3a7de1a94c4dab7ac0ab312d549f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:32.017382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:32.019044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:32.032904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f70225-7705-4fd2-84f0-994e71a690dc admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:32.038213 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba6651-7736-4727-a9aa-cff783327c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:32.039236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba6651-7736-4727-a9aa-cff783327c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:32.039236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba6651-7736-4727-a9aa-cff783327c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:32.039424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba6651-7736-4727-a9aa-cff783327c4b admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:32.040067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba6651-7736-4727-a9aa-cff783327c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:32.042008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba6651-7736-4727-a9aa-cff783327c4b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:32.066591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1013/2044] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:31 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:32.070685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba6651-7736-4727-a9aa-cff783327c4b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:32.072508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-79ba6651-7736-4727-a9aa-cff783327c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:32.092277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba6651-7736-4727-a9aa-cff783327c4b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:32.093991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5c080-f7e0-404b-bf2e-06bbcb3cc115 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:32.098422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee789eb-3324-4f5d-8434-eaba0f6f0413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:32.099166 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee789eb-3324-4f5d-8434-eaba0f6f0413 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:32.099308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:32.099494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee789eb-3324-4f5d-8434-eaba0f6f0413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:32.099911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee789eb-3324-4f5d-8434-eaba0f6f0413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:32.100028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:32.100225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:32.100501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] PATH_INFO: `/v3/users/ab7536a0cb6844e2bb7b0dd708fa613a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:32.100907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee789eb-3324-4f5d-8434-eaba0f6f0413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:32.102735 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7536a0cb6844e2bb7b0dd708fa613a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:32.102865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee789eb-3324-4f5d-8434-eaba0f6f0413 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:32.103759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:32.105831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:32.119963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1014/2045] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:04:32.121196 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee789eb-3324-4f5d-8434-eaba0f6f0413 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:32.133235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee789eb-3324-4f5d-8434-eaba0f6f0413 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:32.140278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e25554-d506-47d5-afa4-7101f95d182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:32.140953 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e25554-d506-47d5-afa4-7101f95d182f admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:32.141235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e25554-d506-47d5-afa4-7101f95d182f admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:32.141509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e25554-d506-47d5-afa4-7101f95d182f admin admin] PATH_INFO: `/v3/projects/76b7b84f7b3e42ecb44b55741bf83b2d/users/c523b05add3e4b43b22fbe4e70e7a311/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:32.161681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e25554-d506-47d5-afa4-7101f95d182f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b7b84f7b3e42ecb44b55741bf83b2d, user_id=c523b05add3e4b43b22fbe4e70e7a311, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:32.164485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e25554-d506-47d5-afa4-7101f95d182f admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:32.173821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7536a0cb6844e2bb7b0dd708fa613a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:32.188280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1015/2046] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:32 2022] PUT /identity/v3/projects/76b7b84f7b3e42ecb44b55741bf83b2d/users/c523b05add3e4b43b22fbe4e70e7a311/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:32.192246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e25554-d506-47d5-afa4-7101f95d182f admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:32.193502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7536a0cb6844e2bb7b0dd708fa613a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:32.202816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7536a0cb6844e2bb7b0dd708fa613a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:32.204511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7536a0cb6844e2bb7b0dd708fa613a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:32.221573 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7536a0cb6844e2bb7b0dd708fa613a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:32.228929 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1032/2047] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:32 2022] DELETE /identity/v3/users/ab7536a0cb6844e2bb7b0dd708fa613a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:32.277317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e25554-d506-47d5-afa4-7101f95d182f admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:32.391987 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3ff7b-6167-4abb-9607-1d66b1d80504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:32.392730 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3ff7b-6167-4abb-9607-1d66b1d80504 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:32.393135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3ff7b-6167-4abb-9607-1d66b1d80504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:32.393485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3ff7b-6167-4abb-9607-1d66b1d80504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:32.394860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3ff7b-6167-4abb-9607-1d66b1d80504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:32.398011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3ff7b-6167-4abb-9607-1d66b1d80504 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:32.413519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1016/2048] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:04:32.417375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:32.419300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:32.441944 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a17d7-21f7-4235-9c82-39901d08d6ab admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:32.448568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc51d80-8e40-4389-9240-1afb14eb4812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:32.449663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc51d80-8e40-4389-9240-1afb14eb4812 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:32.450252 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc51d80-8e40-4389-9240-1afb14eb4812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:32.450534 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc51d80-8e40-4389-9240-1afb14eb4812 admin admin] PATH_INFO: `/v3/projects/76b7b84f7b3e42ecb44b55741bf83b2d/users/c523b05add3e4b43b22fbe4e70e7a311/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:32.454267 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc51d80-8e40-4389-9240-1afb14eb4812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b7b84f7b3e42ecb44b55741bf83b2d, user_id=c523b05add3e4b43b22fbe4e70e7a311, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:32.460143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc51d80-8e40-4389-9240-1afb14eb4812 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:32.476508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1033/2049] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:32 2022] PUT /identity/v3/projects/76b7b84f7b3e42ecb44b55741bf83b2d/users/c523b05add3e4b43b22fbe4e70e7a311/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:32.486842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca548e4-4b63-4cfa-b3a8-b72ec244fcc2 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:32.487132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca548e4-4b63-4cfa-b3a8-b72ec244fcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:32.487583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca548e4-4b63-4cfa-b3a8-b72ec244fcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:32.554134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-4ca548e4-4b63-4cfa-b3a8-b72ec244fcc2 None None] MFA Rules not processed for user `c523b05add3e4b43b22fbe4e70e7a311`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:32.556789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4ca548e4-4b63-4cfa-b3a8-b72ec244fcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:32.753613 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1017/2050] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:32.776236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc51d80-8e40-4389-9240-1afb14eb4812 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:32.778298 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ecc51d80-8e40-4389-9240-1afb14eb4812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:32.861972 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:32.868304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca548e4-4b63-4cfa-b3a8-b72ec244fcc2 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:32.870067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4ca548e4-4b63-4cfa-b3a8-b72ec244fcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:32.876183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:32.889520 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc51d80-8e40-4389-9240-1afb14eb4812 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:32.893686 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31011256-7464-44e6-bd95-1d2e66d72ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:32.895192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31011256-7464-44e6-bd95-1d2e66d72ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:32.895648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31011256-7464-44e6-bd95-1d2e66d72ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:32.903425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31011256-7464-44e6-bd95-1d2e66d72ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:32.922249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-31011256-7464-44e6-bd95-1d2e66d72ac9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:32.972338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca548e4-4b63-4cfa-b3a8-b72ec244fcc2 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:32.979752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d149f67-a03e-4684-b3e6-d2a0849460e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:32.980417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d149f67-a03e-4684-b3e6-d2a0849460e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:32.980706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d149f67-a03e-4684-b3e6-d2a0849460e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:32.980984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d149f67-a03e-4684-b3e6-d2a0849460e2 admin admin] PATH_INFO: `/v3/projects/b8e17a39ceda45b091b474c4436862aa` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:32.982719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d149f67-a03e-4684-b3e6-d2a0849460e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e17a39ceda45b091b474c4436862aa)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:32.984702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d149f67-a03e-4684-b3e6-d2a0849460e2 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:32.999153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31011256-7464-44e6-bd95-1d2e66d72ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:33.001103 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31011256-7464-44e6-bd95-1d2e66d72ac9 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:33.011489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1034/2051] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:33.053563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8d149f67-a03e-4684-b3e6-d2a0849460e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e17a39ceda45b091b474c4436862aa', 'request_id': 'req-8d149f67-a03e-4684-b3e6-d2a0849460e2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:33.060822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8d149f67-a03e-4684-b3e6-d2a0849460e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e17a39ceda45b091b474c4436862aa', 'request_id': 'req-8d149f67-a03e-4684-b3e6-d2a0849460e2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:33.068434 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8d149f67-a03e-4684-b3e6-d2a0849460e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e17a39ceda45b091b474c4436862aa', 'request_id': 'req-8d149f67-a03e-4684-b3e6-d2a0849460e2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:33.101242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8d149f67-a03e-4684-b3e6-d2a0849460e2 admin admin] The token cache is being invalidate because project b8e17a39ceda45b091b474c4436862aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:33.101509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8d149f67-a03e-4684-b3e6-d2a0849460e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:33.102232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8d149f67-a03e-4684-b3e6-d2a0849460e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:33.103826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1018/2052] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:32 2022] DELETE /identity/v3/projects/b8e17a39ceda45b091b474c4436862aa => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:33.108918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6f808-8cc5-46e6-8f37-56d20bf53914 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:33.109335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6f808-8cc5-46e6-8f37-56d20bf53914 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:33.109469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6f808-8cc5-46e6-8f37-56d20bf53914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:33.137041 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a9e6f808-8cc5-46e6-8f37-56d20bf53914 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:33.139364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a9e6f808-8cc5-46e6-8f37-56d20bf53914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:33.260603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1035/2053] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:33.269288 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b9951-361f-4773-bda3-12fa0d67dac6 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:33.269702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b9951-361f-4773-bda3-12fa0d67dac6 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:33.270215 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b9951-361f-4773-bda3-12fa0d67dac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:33.305121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-484b9951-361f-4773-bda3-12fa0d67dac6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:33.306940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-484b9951-361f-4773-bda3-12fa0d67dac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:33.332717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1019/2054] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:33.339368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6f808-8cc5-46e6-8f37-56d20bf53914 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:33.365992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6f808-8cc5-46e6-8f37-56d20bf53914 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:33.377918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802df85-184f-4b31-b187-30ab927004ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:33.380965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802df85-184f-4b31-b187-30ab927004ff admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:33.381363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802df85-184f-4b31-b187-30ab927004ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:33.381791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802df85-184f-4b31-b187-30ab927004ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:33.400289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802df85-184f-4b31-b187-30ab927004ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:33.401323 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802df85-184f-4b31-b187-30ab927004ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:33.408622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802df85-184f-4b31-b187-30ab927004ff admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:33.446168 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1036/2055] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:04:33.447469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b9951-361f-4773-bda3-12fa0d67dac6 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:33.468591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b9951-361f-4773-bda3-12fa0d67dac6 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:33.499895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a6b09-046d-48c8-90e2-c3b13f050f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:33.500999 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a6b09-046d-48c8-90e2-c3b13f050f38 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:33.503052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a6b09-046d-48c8-90e2-c3b13f050f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:33.516212 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a6b09-046d-48c8-90e2-c3b13f050f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:33.517455 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a6b09-046d-48c8-90e2-c3b13f050f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:33.521289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a6b09-046d-48c8-90e2-c3b13f050f38 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:33.583764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1020/2056] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:33 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:33.587006 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802df85-184f-4b31-b187-30ab927004ff admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:33.599141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802df85-184f-4b31-b187-30ab927004ff admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:33.686626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfe603-7fea-4454-8fe6-336c11fdca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:33.688783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe603-7fea-4454-8fe6-336c11fdca2a admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:33.689135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe603-7fea-4454-8fe6-336c11fdca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:33.689688 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe603-7fea-4454-8fe6-336c11fdca2a admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:33.690455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfe603-7fea-4454-8fe6-336c11fdca2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:33.693199 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfe603-7fea-4454-8fe6-336c11fdca2a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:33.720627 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1037/2057] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:33 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:33.725199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a6b09-046d-48c8-90e2-c3b13f050f38 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:33.736968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a6b09-046d-48c8-90e2-c3b13f050f38 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:33.745897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972a094-c6ae-4ece-8e29-087b638b45a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:33.746922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972a094-c6ae-4ece-8e29-087b638b45a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:33.747327 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972a094-c6ae-4ece-8e29-087b638b45a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:33.747758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972a094-c6ae-4ece-8e29-087b638b45a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:33.748572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972a094-c6ae-4ece-8e29-087b638b45a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:33.751209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972a094-c6ae-4ece-8e29-087b638b45a0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:33.763768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1021/2058] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:33.767631 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfe603-7fea-4454-8fe6-336c11fdca2a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:33.778513 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfe603-7fea-4454-8fe6-336c11fdca2a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:33.784687 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bb48b-1320-4e39-8a2b-4c277461f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:33.785395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb48b-1320-4e39-8a2b-4c277461f67f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:33.785755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb48b-1320-4e39-8a2b-4c277461f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:33.786103 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb48b-1320-4e39-8a2b-4c277461f67f admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:33.786852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bb48b-1320-4e39-8a2b-4c277461f67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:33.788713 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bb48b-1320-4e39-8a2b-4c277461f67f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:33.802665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1038/2059] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:33.806961 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972a094-c6ae-4ece-8e29-087b638b45a0 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:33.817231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972a094-c6ae-4ece-8e29-087b638b45a0 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:33.822469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f687194-4b1b-43a0-a5f0-fc6a6b0018b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:33.823142 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f687194-4b1b-43a0-a5f0-fc6a6b0018b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:33.823430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f687194-4b1b-43a0-a5f0-fc6a6b0018b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:33.823707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f687194-4b1b-43a0-a5f0-fc6a6b0018b3 admin admin] PATH_INFO: `/v3/projects/fc4cf004367f4bbe828fb955bc8ff684/users/0e479a36cb96444db753fe3a96f6fe78/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:33.844173 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f687194-4b1b-43a0-a5f0-fc6a6b0018b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4cf004367f4bbe828fb955bc8ff684, user_id=0e479a36cb96444db753fe3a96f6fe78, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:33.848521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f687194-4b1b-43a0-a5f0-fc6a6b0018b3 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:33.865779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1022/2060] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:33 2022] PUT /identity/v3/projects/fc4cf004367f4bbe828fb955bc8ff684/users/0e479a36cb96444db753fe3a96f6fe78/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:33.871105 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0294038-6052-4965-a7bc-4d0a3095c0b1 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:33.871406 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0294038-6052-4965-a7bc-4d0a3095c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:33.871706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0294038-6052-4965-a7bc-4d0a3095c0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:33.881720 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:33.896084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e0294038-6052-4965-a7bc-4d0a3095c0b1 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:33.897227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e0294038-6052-4965-a7bc-4d0a3095c0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:33.980858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1039/2061] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:33.994171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f687194-4b1b-43a0-a5f0-fc6a6b0018b3 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:33.996238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1f687194-4b1b-43a0-a5f0-fc6a6b0018b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:34.045876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:34.090612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f687194-4b1b-43a0-a5f0-fc6a6b0018b3 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:34.095807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66576fb-306d-4a69-9a4f-2d22d36579d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:34.096446 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66576fb-306d-4a69-9a4f-2d22d36579d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:34.096740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66576fb-306d-4a69-9a4f-2d22d36579d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:34.097144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66576fb-306d-4a69-9a4f-2d22d36579d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:34.116405 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66576fb-306d-4a69-9a4f-2d22d36579d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:34.118217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66576fb-306d-4a69-9a4f-2d22d36579d6 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:34.142077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1023/2062] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:35.565499 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668168ba-a359-43d6-9eea-5ec2e1f5c559 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:35.566025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668168ba-a359-43d6-9eea-5ec2e1f5c559 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:35.566025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668168ba-a359-43d6-9eea-5ec2e1f5c559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:35.595274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-668168ba-a359-43d6-9eea-5ec2e1f5c559 None None] MFA Rules not processed for user `0e479a36cb96444db753fe3a96f6fe78`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:35.596546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-668168ba-a359-43d6-9eea-5ec2e1f5c559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:35.663867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1040/2063] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:35.668323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66576fb-306d-4a69-9a4f-2d22d36579d6 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:35.679627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66576fb-306d-4a69-9a4f-2d22d36579d6 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:35.684307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666b38c-b28b-4475-a52e-1758283ff7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:35.685097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666b38c-b28b-4475-a52e-1758283ff7fc admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:35.685380 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666b38c-b28b-4475-a52e-1758283ff7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:35.685650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666b38c-b28b-4475-a52e-1758283ff7fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:35.686286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666b38c-b28b-4475-a52e-1758283ff7fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:35.688186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666b38c-b28b-4475-a52e-1758283ff7fc admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:35.743778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1024/2064] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:35 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:35.749990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668168ba-a359-43d6-9eea-5ec2e1f5c559 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:35.766575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668168ba-a359-43d6-9eea-5ec2e1f5c559 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:35.851842 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c7d9b-4da1-470c-be36-7a9c608bcbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:35.852592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c7d9b-4da1-470c-be36-7a9c608bcbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:35.852875 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c7d9b-4da1-470c-be36-7a9c608bcbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:35.853147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c7d9b-4da1-470c-be36-7a9c608bcbd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:35.853778 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c7d9b-4da1-470c-be36-7a9c608bcbd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:35.855700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c7d9b-4da1-470c-be36-7a9c608bcbd3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:35.878672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1041/2065] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:35 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:35.882627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666b38c-b28b-4475-a52e-1758283ff7fc admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:35.895006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666b38c-b28b-4475-a52e-1758283ff7fc admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:35.899827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679dfb4-d41c-4bf4-a972-2d52623c910d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:35.900439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679dfb4-d41c-4bf4-a972-2d52623c910d admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:35.900753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679dfb4-d41c-4bf4-a972-2d52623c910d admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:35.901033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679dfb4-d41c-4bf4-a972-2d52623c910d admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:35.901689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679dfb4-d41c-4bf4-a972-2d52623c910d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:35.903316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679dfb4-d41c-4bf4-a972-2d52623c910d admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:35.915931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1025/2066] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:35.920197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c7d9b-4da1-470c-be36-7a9c608bcbd3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:35.934544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c7d9b-4da1-470c-be36-7a9c608bcbd3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:35.939853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b084fbe-19ed-4bf1-bd9f-53d455618ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:35.940519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b084fbe-19ed-4bf1-bd9f-53d455618ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:35.940803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b084fbe-19ed-4bf1-bd9f-53d455618ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:35.941082 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b084fbe-19ed-4bf1-bd9f-53d455618ba3 admin admin] PATH_INFO: `/v3/projects/44834ffa029943c3a4516c97881d9f4e/users/64ba68b9e9714f6aa954dd597c6447ad/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:35.956977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b084fbe-19ed-4bf1-bd9f-53d455618ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44834ffa029943c3a4516c97881d9f4e, user_id=64ba68b9e9714f6aa954dd597c6447ad, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:35.959917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b084fbe-19ed-4bf1-bd9f-53d455618ba3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:35.970796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:35.976771 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1042/2067] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:35 2022] PUT /identity/v3/projects/44834ffa029943c3a4516c97881d9f4e/users/64ba68b9e9714f6aa954dd597c6447ad/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:35.981376 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679dfb4-d41c-4bf4-a972-2d52623c910d admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:35.990643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679dfb4-d41c-4bf4-a972-2d52623c910d admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:36.057486 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542acd0-9c42-44d8-a9c2-e832f3231475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:36.058207 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542acd0-9c42-44d8-a9c2-e832f3231475 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:36.058495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542acd0-9c42-44d8-a9c2-e832f3231475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:36.058768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542acd0-9c42-44d8-a9c2-e832f3231475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:36.059414 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542acd0-9c42-44d8-a9c2-e832f3231475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:36.061118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542acd0-9c42-44d8-a9c2-e832f3231475 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:36.073393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1026/2068] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:36.078530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b084fbe-19ed-4bf1-bd9f-53d455618ba3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:36.091812 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b084fbe-19ed-4bf1-bd9f-53d455618ba3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:36.099144 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690673a-538a-4c58-abb9-c9736cc179b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:36.099570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690673a-538a-4c58-abb9-c9736cc179b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:36.099977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690673a-538a-4c58-abb9-c9736cc179b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:36.100344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690673a-538a-4c58-abb9-c9736cc179b3 admin admin] PATH_INFO: `/v3/projects/44834ffa029943c3a4516c97881d9f4e/users/64ba68b9e9714f6aa954dd597c6447ad/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:36.102777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690673a-538a-4c58-abb9-c9736cc179b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44834ffa029943c3a4516c97881d9f4e, user_id=64ba68b9e9714f6aa954dd597c6447ad, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:36.105825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690673a-538a-4c58-abb9-c9736cc179b3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:36.128042 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1043/2069] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:36 2022] PUT /identity/v3/projects/44834ffa029943c3a4516c97881d9f4e/users/64ba68b9e9714f6aa954dd597c6447ad/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:37.186998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7ac17-5747-418e-92a1-a9920a7eca58 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:37.187492 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7ac17-5747-418e-92a1-a9920a7eca58 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:37.187713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7ac17-5747-418e-92a1-a9920a7eca58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:37.216616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-dfb7ac17-5747-418e-92a1-a9920a7eca58 None None] MFA Rules not processed for user `64ba68b9e9714f6aa954dd597c6447ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:37.217844 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-dfb7ac17-5747-418e-92a1-a9920a7eca58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:37.302340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1027/2070] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:37.313530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3729617-2f21-4262-93c0-2e41add7579a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:37.314024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3729617-2f21-4262-93c0-2e41add7579a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:37.314130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3729617-2f21-4262-93c0-2e41add7579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:37.333627 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b3729617-2f21-4262-93c0-2e41add7579a None None] MFA Rules not processed for user `0e479a36cb96444db753fe3a96f6fe78`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:37.334865 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b3729617-2f21-4262-93c0-2e41add7579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:37.404453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1044/2071] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:37.415195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7ac17-5747-418e-92a1-a9920a7eca58 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:37.416620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-dfb7ac17-5747-418e-92a1-a9920a7eca58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:37.440691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:37.503191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7ac17-5747-418e-92a1-a9920a7eca58 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:37.509032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793a5a9-b9c2-4acb-b683-1bfd6284a21b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:37.509667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a5a9-b9c2-4acb-b683-1bfd6284a21b service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:37.509952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a5a9-b9c2-4acb-b683-1bfd6284a21b service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:37.510236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a5a9-b9c2-4acb-b683-1bfd6284a21b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:37.519133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793a5a9-b9c2-4acb-b683-1bfd6284a21b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:37.520778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793a5a9-b9c2-4acb-b683-1bfd6284a21b service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:37.530681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1028/2072] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:37.814535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3729617-2f21-4262-93c0-2e41add7579a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:37.816917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b3729617-2f21-4262-93c0-2e41add7579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:37.909061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3729617-2f21-4262-93c0-2e41add7579a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:37.913252 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a223a3-1f60-4239-a315-24a0ac63b5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:37.914040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a223a3-1f60-4239-a315-24a0ac63b5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:37.914420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a223a3-1f60-4239-a315-24a0ac63b5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:37.914815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a223a3-1f60-4239-a315-24a0ac63b5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:37.916970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c6a223a3-1f60-4239-a315-24a0ac63b5e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:37.993816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a223a3-1f60-4239-a315-24a0ac63b5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:37.995297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a223a3-1f60-4239-a315-24a0ac63b5e6 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:38.008078 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1045/2073] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:43.161997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793a5a9-b9c2-4acb-b683-1bfd6284a21b service nova] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:43.163580 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1793a5a9-b9c2-4acb-b683-1bfd6284a21b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:43.221644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a223a3-1f60-4239-a315-24a0ac63b5e6 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:43.223194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c6a223a3-1f60-4239-a315-24a0ac63b5e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:43.288768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:43.317318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a223a3-1f60-4239-a315-24a0ac63b5e6 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:43.320490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793a5a9-b9c2-4acb-b683-1bfd6284a21b service nova] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:43.323580 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874838bc-2a61-4ee6-9b0e-85acec900236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:43.324260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874838bc-2a61-4ee6-9b0e-85acec900236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:43.324545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874838bc-2a61-4ee6-9b0e-85acec900236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:43.324833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874838bc-2a61-4ee6-9b0e-85acec900236 admin admin] PATH_INFO: `/v3/users/2682e6e4a9974989873b6310c60f7f36` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:43.326161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fdeed-2c9c-4882-9388-9068ddb5b1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:43.326525 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874838bc-2a61-4ee6-9b0e-85acec900236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2682e6e4a9974989873b6310c60f7f36)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:43.326982 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fdeed-2c9c-4882-9388-9068ddb5b1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:43.327281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fdeed-2c9c-4882-9388-9068ddb5b1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:43.327546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fdeed-2c9c-4882-9388-9068ddb5b1b0 admin admin] PATH_INFO: `/v3/users/2ae6313cbfba45278b16b3187527d6fa` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:43.328883 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fdeed-2c9c-4882-9388-9068ddb5b1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae6313cbfba45278b16b3187527d6fa)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:43.329088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874838bc-2a61-4ee6-9b0e-85acec900236 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:43.330972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fdeed-2c9c-4882-9388-9068ddb5b1b0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:43.402077 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-874838bc-2a61-4ee6-9b0e-85acec900236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2682e6e4a9974989873b6310c60f7f36'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:43.408705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2c0fdeed-2c9c-4882-9388-9068ddb5b1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae6313cbfba45278b16b3187527d6fa'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:43.412021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-874838bc-2a61-4ee6-9b0e-85acec900236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2682e6e4a9974989873b6310c60f7f36'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:43.418076 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2c0fdeed-2c9c-4882-9388-9068ddb5b1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae6313cbfba45278b16b3187527d6fa'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:43.418877 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2c0fdeed-2c9c-4882-9388-9068ddb5b1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae6313cbfba45278b16b3187527d6fa'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:43.420010 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2c0fdeed-2c9c-4882-9388-9068ddb5b1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae6313cbfba45278b16b3187527d6fa'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:43.437883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-874838bc-2a61-4ee6-9b0e-85acec900236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2682e6e4a9974989873b6310c60f7f36'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:43.438779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2c0fdeed-2c9c-4882-9388-9068ddb5b1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae6313cbfba45278b16b3187527d6fa'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:43.439399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-874838bc-2a61-4ee6-9b0e-85acec900236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2682e6e4a9974989873b6310c60f7f36'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:43.455205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1029/2074] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:43 2022] DELETE /identity/v3/users/2ae6313cbfba45278b16b3187527d6fa => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:04:43.456099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-874838bc-2a61-4ee6-9b0e-85acec900236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2682e6e4a9974989873b6310c60f7f36'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:43.459311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94220aed-3e49-471d-b422-4f115a90724b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:43.459606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94220aed-3e49-471d-b422-4f115a90724b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:43.459920 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94220aed-3e49-471d-b422-4f115a90724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:43.463416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1046/2075] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:43 2022] DELETE /identity/v3/users/2682e6e4a9974989873b6310c60f7f36 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:43.467760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5e91e-2b15-404f-b7fe-9d00f5217f9e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:43.468057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5e91e-2b15-404f-b7fe-9d00f5217f9e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:43.468341 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5e91e-2b15-404f-b7fe-9d00f5217f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:43.482450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-94220aed-3e49-471d-b422-4f115a90724b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:43.483940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-94220aed-3e49-471d-b422-4f115a90724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:43.501390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-cfc5e91e-2b15-404f-b7fe-9d00f5217f9e None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:43.503119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cfc5e91e-2b15-404f-b7fe-9d00f5217f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:43.507289 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:43.562657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1030/2076] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:43.574156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94220aed-3e49-471d-b422-4f115a90724b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:43.575926 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-94220aed-3e49-471d-b422-4f115a90724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:43.588699 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1047/2077] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:43.601000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5e91e-2b15-404f-b7fe-9d00f5217f9e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:43.602617 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cfc5e91e-2b15-404f-b7fe-9d00f5217f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:43.637394 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94220aed-3e49-471d-b422-4f115a90724b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:43.641363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b3a56-b106-4fdb-b11c-bec508e7e704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:43.642056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3a56-b106-4fdb-b11c-bec508e7e704 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:43.642410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3a56-b106-4fdb-b11c-bec508e7e704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:43.642752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3a56-b106-4fdb-b11c-bec508e7e704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:43.657323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b3a56-b106-4fdb-b11c-bec508e7e704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:43.658910 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b3a56-b106-4fdb-b11c-bec508e7e704 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:43.668956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1031/2078] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:04:43.674680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5e91e-2b15-404f-b7fe-9d00f5217f9e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:43.678843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfa325-a044-4aa4-a146-bdeefb919e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:43.679625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfa325-a044-4aa4-a146-bdeefb919e33 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:43.680136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfa325-a044-4aa4-a146-bdeefb919e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:43.680422 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfa325-a044-4aa4-a146-bdeefb919e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:43.691761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfa325-a044-4aa4-a146-bdeefb919e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:43.693306 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfa325-a044-4aa4-a146-bdeefb919e33 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:43.703601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1048/2079] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:43.855865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b1b2-1474-43e4-9d4a-a0972f0f4a20 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:43.856209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b1b2-1474-43e4-9d4a-a0972f0f4a20 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:43.857296 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b1b2-1474-43e4-9d4a-a0972f0f4a20 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:43.859122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1032/2080] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 08:04:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:43.877650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd88897-c52e-4475-a889-ff344d4d4dc4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:43.878310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd88897-c52e-4475-a889-ff344d4d4dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:43.878699 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd88897-c52e-4475-a889-ff344d4d4dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:43.888041 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:43.907801 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-cfd88897-c52e-4475-a889-ff344d4d4dc4 None None] MFA Rules not processed for user `ccab7239a2474aa093e685d5da97f1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:43.908674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cfd88897-c52e-4475-a889-ff344d4d4dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:44.003918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1049/2081] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 08:04:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:44.018434 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8b1b2-1474-43e4-9d4a-a0972f0f4a20 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:44.021320 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-daa8b1b2-1474-43e4-9d4a-a0972f0f4a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:44.024672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd88897-c52e-4475-a889-ff344d4d4dc4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:44.026661 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cfd88897-c52e-4475-a889-ff344d4d4dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:44.043031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd88897-c52e-4475-a889-ff344d4d4dc4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:44.051214 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c56d6-1bb9-4cb3-b494-2a91ba39b15b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccab7239a2474aa093e685d5da97f1a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:44.053162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c56d6-1bb9-4cb3-b494-2a91ba39b15b service placement] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:44.053691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c56d6-1bb9-4cb3-b494-2a91ba39b15b service placement] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:44.054189 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c56d6-1bb9-4cb3-b494-2a91ba39b15b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:44.064891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c56d6-1bb9-4cb3-b494-2a91ba39b15b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:44.066971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c56d6-1bb9-4cb3-b494-2a91ba39b15b service placement] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:44.070703 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8b1b2-1474-43e4-9d4a-a0972f0f4a20 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:44.087083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:44.087663 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:44.092069 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:44.092251 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1050/2082] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:04:44.092350 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] PATH_INFO: `/v3/users/d22ea25e8e5843b1be42ed4c58ab142b` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:44.097621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22ea25e8e5843b1be42ed4c58ab142b)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:44.101514 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:44.174904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22ea25e8e5843b1be42ed4c58ab142b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.197067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22ea25e8e5843b1be42ed4c58ab142b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.198141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22ea25e8e5843b1be42ed4c58ab142b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.198952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22ea25e8e5843b1be42ed4c58ab142b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.233862 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22ea25e8e5843b1be42ed4c58ab142b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.277479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1033/2083] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:44 2022] DELETE /identity/v3/users/d22ea25e8e5843b1be42ed4c58ab142b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:44.507147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c56d6-1bb9-4cb3-b494-2a91ba39b15b service placement] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:44.510221 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7c0c56d6-1bb9-4cb3-b494-2a91ba39b15b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:44.561795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c56d6-1bb9-4cb3-b494-2a91ba39b15b service placement] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:44.588076 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:44.597481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:44.679351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:44.679351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:44.679351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:44.679351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] PATH_INFO: `/v3/projects/ca015190ccb0476ba05b5c6a91917abc` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:44.679997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca015190ccb0476ba05b5c6a91917abc)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:44.681126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:44.702705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:44.731348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65819a25-42d4-4181-af92-76e08d22eff8 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:44.734913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca015190ccb0476ba05b5c6a91917abc', 'request_id': 'req-c4b1998a-ddaa-44ef-9044-24586d05eae6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.740567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca015190ccb0476ba05b5c6a91917abc', 'request_id': 'req-c4b1998a-ddaa-44ef-9044-24586d05eae6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.747114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca015190ccb0476ba05b5c6a91917abc', 'request_id': 'req-c4b1998a-ddaa-44ef-9044-24586d05eae6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.760202 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] The token cache is being invalidate because project ca015190ccb0476ba05b5c6a91917abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:44.760489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.761102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.762958 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1051/2084] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:44 2022] DELETE /identity/v3/projects/ca015190ccb0476ba05b5c6a91917abc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:44.763868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:44.765141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:44.786053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:44.793841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e316f5-5f15-4dbe-b403-a8a516745649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:44.795066 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e316f5-5f15-4dbe-b403-a8a516745649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:44.795356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e316f5-5f15-4dbe-b403-a8a516745649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:44.795634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e316f5-5f15-4dbe-b403-a8a516745649 admin admin] PATH_INFO: `/v3/projects/fd040d5bb09349cfbcda335fb8f5c066` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:44.796856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e316f5-5f15-4dbe-b403-a8a516745649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd040d5bb09349cfbcda335fb8f5c066)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:44.798774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e316f5-5f15-4dbe-b403-a8a516745649 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:44.843602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1998a-ddaa-44ef-9044-24586d05eae6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:44.848469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-75e316f5-5f15-4dbe-b403-a8a516745649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd040d5bb09349cfbcda335fb8f5c066', 'request_id': 'req-75e316f5-5f15-4dbe-b403-a8a516745649'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.854045 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-75e316f5-5f15-4dbe-b403-a8a516745649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd040d5bb09349cfbcda335fb8f5c066', 'request_id': 'req-75e316f5-5f15-4dbe-b403-a8a516745649'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.860415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-75e316f5-5f15-4dbe-b403-a8a516745649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd040d5bb09349cfbcda335fb8f5c066', 'request_id': 'req-75e316f5-5f15-4dbe-b403-a8a516745649'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.874050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-75e316f5-5f15-4dbe-b403-a8a516745649 admin admin] The token cache is being invalidate because project fd040d5bb09349cfbcda335fb8f5c066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:44.874429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-75e316f5-5f15-4dbe-b403-a8a516745649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.875447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-75e316f5-5f15-4dbe-b403-a8a516745649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.877157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1034/2085] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:44 2022] DELETE /identity/v3/projects/fd040d5bb09349cfbcda335fb8f5c066 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:44.878309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019b188-ca1e-4c2f-b70c-7f735bdaa680 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:44.878596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019b188-ca1e-4c2f-b70c-7f735bdaa680 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:44.878875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019b188-ca1e-4c2f-b70c-7f735bdaa680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:44.899714 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-a019b188-ca1e-4c2f-b70c-7f735bdaa680 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:44.901016 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a019b188-ca1e-4c2f-b70c-7f735bdaa680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:44.906828 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3d36a-36ec-4f61-9d48-1404b3445356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:44.907616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3d36a-36ec-4f61-9d48-1404b3445356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:44.908035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3d36a-36ec-4f61-9d48-1404b3445356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:44.908314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3d36a-36ec-4f61-9d48-1404b3445356 admin admin] PATH_INFO: `/v3/projects/fa47e83732f64a789587efd59c0da54a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:44.909486 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3d36a-36ec-4f61-9d48-1404b3445356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa47e83732f64a789587efd59c0da54a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:44.910069 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1035/2086] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:44.916055 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3d36a-36ec-4f61-9d48-1404b3445356 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:44.916232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f69873-799c-480f-a2cf-ca8668faa96a None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:44.916232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f69873-799c-480f-a2cf-ca8668faa96a None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:44.916232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f69873-799c-480f-a2cf-ca8668faa96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:44.933016 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-a6f69873-799c-480f-a2cf-ca8668faa96a None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:44.934218 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a6f69873-799c-480f-a2cf-ca8668faa96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:44.942649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1036/2087] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:44.943856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd9fc7-636d-47ae-8dd1-316856b67b30 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:44.944144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd9fc7-636d-47ae-8dd1-316856b67b30 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:44.944414 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd9fc7-636d-47ae-8dd1-316856b67b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:44.965009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7ea3d36a-36ec-4f61-9d48-1404b3445356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa47e83732f64a789587efd59c0da54a', 'request_id': 'req-7ea3d36a-36ec-4f61-9d48-1404b3445356'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.968760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-34dd9fc7-636d-47ae-8dd1-316856b67b30 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:44.970483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-34dd9fc7-636d-47ae-8dd1-316856b67b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:44.971096 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7ea3d36a-36ec-4f61-9d48-1404b3445356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa47e83732f64a789587efd59c0da54a', 'request_id': 'req-7ea3d36a-36ec-4f61-9d48-1404b3445356'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.977207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7ea3d36a-36ec-4f61-9d48-1404b3445356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa47e83732f64a789587efd59c0da54a', 'request_id': 'req-7ea3d36a-36ec-4f61-9d48-1404b3445356'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.992549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7ea3d36a-36ec-4f61-9d48-1404b3445356 admin admin] The token cache is being invalidate because project fa47e83732f64a789587efd59c0da54a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:44.992849 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7ea3d36a-36ec-4f61-9d48-1404b3445356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.993546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7ea3d36a-36ec-4f61-9d48-1404b3445356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:44.995798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1052/2088] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:44 2022] DELETE /identity/v3/projects/fa47e83732f64a789587efd59c0da54a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:45.000177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae954a-40a6-4a23-a34e-b12961260a1f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.000464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae954a-40a6-4a23-a34e-b12961260a1f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.000739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae954a-40a6-4a23-a34e-b12961260a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.020436 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2dae954a-40a6-4a23-a34e-b12961260a1f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:45.021654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2dae954a-40a6-4a23-a34e-b12961260a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:45.050029 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1037/2089] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:45.051452 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd9fc7-636d-47ae-8dd1-316856b67b30 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.053293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-34dd9fc7-636d-47ae-8dd1-316856b67b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:45.064819 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:45.070262 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd9fc7-636d-47ae-8dd1-316856b67b30 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.075805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:45.076880 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.079074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.079354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.079630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] PATH_INFO: `/v3/users/c523b05add3e4b43b22fbe4e70e7a311` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.080847 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c523b05add3e4b43b22fbe4e70e7a311)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.082744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.089638 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1053/2090] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:45.090602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae954a-40a6-4a23-a34e-b12961260a1f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.100777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae954a-40a6-4a23-a34e-b12961260a1f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.108283 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97777918-3e14-4545-9df2-534be4fccd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.109141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97777918-3e14-4545-9df2-534be4fccd02 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.109423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97777918-3e14-4545-9df2-534be4fccd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.109834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97777918-3e14-4545-9df2-534be4fccd02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.110749 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97777918-3e14-4545-9df2-534be4fccd02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:45.111040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97777918-3e14-4545-9df2-534be4fccd02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.112680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97777918-3e14-4545-9df2-534be4fccd02 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.125439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1054/2091] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:04:45.126353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97777918-3e14-4545-9df2-534be4fccd02 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.135348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c523b05add3e4b43b22fbe4e70e7a311'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:45.136671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97777918-3e14-4545-9df2-534be4fccd02 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.142695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaebd92-e507-45af-8045-629a269dccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.143283 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaebd92-e507-45af-8045-629a269dccf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.143555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaebd92-e507-45af-8045-629a269dccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.143869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaebd92-e507-45af-8045-629a269dccf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.144155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c523b05add3e4b43b22fbe4e70e7a311'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:45.144673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaebd92-e507-45af-8045-629a269dccf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:45.144802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c523b05add3e4b43b22fbe4e70e7a311'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:45.144984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaebd92-e507-45af-8045-629a269dccf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.145463 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c523b05add3e4b43b22fbe4e70e7a311'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:45.146569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaebd92-e507-45af-8045-629a269dccf7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.158946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c523b05add3e4b43b22fbe4e70e7a311'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:45.160112 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1055/2092] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:04:45.161032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaebd92-e507-45af-8045-629a269dccf7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.162680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3aaebd92-e507-45af-8045-629a269dccf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:45.174854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaebd92-e507-45af-8045-629a269dccf7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.176195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1038/2093] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:04:45 2022] DELETE /identity/v3/users/c523b05add3e4b43b22fbe4e70e7a311 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:45.178048 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.179766 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:45.268244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a4da4-be43-4a04-9751-b2b82a1689a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.269267 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a4da4-be43-4a04-9751-b2b82a1689a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.269795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a4da4-be43-4a04-9751-b2b82a1689a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.270271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a4da4-be43-4a04-9751-b2b82a1689a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.271153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a4da4-be43-4a04-9751-b2b82a1689a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.273665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a4da4-be43-4a04-9751-b2b82a1689a4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.281780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3d9b0-e453-4529-8d1e-cfa85d74c14d admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.294783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c4a78-6795-40fc-b21c-4a52819fba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.295884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c4a78-6795-40fc-b21c-4a52819fba9d admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.296275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c4a78-6795-40fc-b21c-4a52819fba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.296692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c4a78-6795-40fc-b21c-4a52819fba9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.297407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c4a78-6795-40fc-b21c-4a52819fba9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.300382 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c4a78-6795-40fc-b21c-4a52819fba9d admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.321381 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1056/2094] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:45 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:45.327304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a4da4-be43-4a04-9751-b2b82a1689a4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.339141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1039/2095] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:45 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:45.352385 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c4a78-6795-40fc-b21c-4a52819fba9d admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.424895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a4da4-be43-4a04-9751-b2b82a1689a4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.430395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb1bc-a24b-46ae-bb55-9b84da8f114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.431025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb1bc-a24b-46ae-bb55-9b84da8f114e admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.431311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb1bc-a24b-46ae-bb55-9b84da8f114e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.431587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb1bc-a24b-46ae-bb55-9b84da8f114e admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.432258 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fb1bc-a24b-46ae-bb55-9b84da8f114e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.432378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c4a78-6795-40fc-b21c-4a52819fba9d admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.434311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fb1bc-a24b-46ae-bb55-9b84da8f114e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.437276 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a27069-0425-4e04-a2ec-96708a813513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.437885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a27069-0425-4e04-a2ec-96708a813513 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.438171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a27069-0425-4e04-a2ec-96708a813513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.438446 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a27069-0425-4e04-a2ec-96708a813513 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.439077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a27069-0425-4e04-a2ec-96708a813513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.441166 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a27069-0425-4e04-a2ec-96708a813513 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.451494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:45.469463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1057/2096] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:45 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:04:45.471813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1040/2097] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:45 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:04:45.473441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb1bc-a24b-46ae-bb55-9b84da8f114e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.473821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a27069-0425-4e04-a2ec-96708a813513 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.487126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb1bc-a24b-46ae-bb55-9b84da8f114e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.487357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a27069-0425-4e04-a2ec-96708a813513 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.494766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afef49-4994-4852-8c50-ee79175ec37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.495001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e3a4c-62e8-4653-94e2-1f6e88f44131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.495695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e3a4c-62e8-4653-94e2-1f6e88f44131 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.496013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e3a4c-62e8-4653-94e2-1f6e88f44131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.496495 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afef49-4994-4852-8c50-ee79175ec37d admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.497132 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afef49-4994-4852-8c50-ee79175ec37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.497424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e3a4c-62e8-4653-94e2-1f6e88f44131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.498284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e3a4c-62e8-4653-94e2-1f6e88f44131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.498462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afef49-4994-4852-8c50-ee79175ec37d admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.499316 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afef49-4994-4852-8c50-ee79175ec37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.500999 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e3a4c-62e8-4653-94e2-1f6e88f44131 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.501769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afef49-4994-4852-8c50-ee79175ec37d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.519325 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1058/2098] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:45.521844 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1041/2099] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:04:45.525688 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e3a4c-62e8-4653-94e2-1f6e88f44131 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.529217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afef49-4994-4852-8c50-ee79175ec37d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.537125 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e3a4c-62e8-4653-94e2-1f6e88f44131 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.541807 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afef49-4994-4852-8c50-ee79175ec37d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.543534 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bd5db-3255-48ad-82bc-48cb3c69df83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.544550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bd5db-3255-48ad-82bc-48cb3c69df83 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.544984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bd5db-3255-48ad-82bc-48cb3c69df83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.545405 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bd5db-3255-48ad-82bc-48cb3c69df83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.546334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bd5db-3255-48ad-82bc-48cb3c69df83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.547680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42214d-fad6-4887-ba01-544d4ac53d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.548396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42214d-fad6-4887-ba01-544d4ac53d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.548783 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42214d-fad6-4887-ba01-544d4ac53d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.549033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bd5db-3255-48ad-82bc-48cb3c69df83 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.549146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42214d-fad6-4887-ba01-544d4ac53d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.549896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42214d-fad6-4887-ba01-544d4ac53d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.552066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42214d-fad6-4887-ba01-544d4ac53d81 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.564866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1042/2100] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:45.568404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1059/2101] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:04:45.569131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bd5db-3255-48ad-82bc-48cb3c69df83 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.572510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42214d-fad6-4887-ba01-544d4ac53d81 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.583558 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bd5db-3255-48ad-82bc-48cb3c69df83 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.585086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42214d-fad6-4887-ba01-544d4ac53d81 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.590346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943100-ccba-431c-a3ad-86005a369ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.591189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943100-ccba-431c-a3ad-86005a369ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.591546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943100-ccba-431c-a3ad-86005a369ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.591913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555de3a-c958-4001-b572-567550c64fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.592035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943100-ccba-431c-a3ad-86005a369ae8 admin admin] PATH_INFO: `/v3/projects/5150d2ba68ac4df9926fa2c88882eb9a/users/a17e6e20d5d84cf29803263ab19fcfa9/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.592862 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555de3a-c958-4001-b572-567550c64fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.593348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555de3a-c958-4001-b572-567550c64fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.593799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555de3a-c958-4001-b572-567550c64fb9 admin admin] PATH_INFO: `/v3/projects/e009692db83a43f8bf82b88482fa54b2/users/f2dc394f3da54e118a4c963f13945b3d/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.612619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555de3a-c958-4001-b572-567550c64fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e009692db83a43f8bf82b88482fa54b2, user_id=f2dc394f3da54e118a4c963f13945b3d, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.612944 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943100-ccba-431c-a3ad-86005a369ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5150d2ba68ac4df9926fa2c88882eb9a, user_id=a17e6e20d5d84cf29803263ab19fcfa9, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.615314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555de3a-c958-4001-b572-567550c64fb9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.616299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943100-ccba-431c-a3ad-86005a369ae8 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.625291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:45.634160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1043/2102] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:45 2022] PUT /identity/v3/projects/5150d2ba68ac4df9926fa2c88882eb9a/users/a17e6e20d5d84cf29803263ab19fcfa9/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:45.636966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1060/2103] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:45 2022] PUT /identity/v3/projects/e009692db83a43f8bf82b88482fa54b2/users/f2dc394f3da54e118a4c963f13945b3d/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:45.639210 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c96db-307f-455c-953c-fa1d4dfcf6ea None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.639582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c96db-307f-455c-953c-fa1d4dfcf6ea None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.639944 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c96db-307f-455c-953c-fa1d4dfcf6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.641882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af34c3c-249a-45d0-b010-390bdd8264c0 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.642172 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af34c3c-249a-45d0-b010-390bdd8264c0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.642458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af34c3c-249a-45d0-b010-390bdd8264c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.663981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-f52c96db-307f-455c-953c-fa1d4dfcf6ea None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:45.664117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8af34c3c-249a-45d0-b010-390bdd8264c0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:45.664225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f52c96db-307f-455c-953c-fa1d4dfcf6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:45.664924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8af34c3c-249a-45d0-b010-390bdd8264c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:45.735598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1044/2104] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:04:45.738827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c96db-307f-455c-953c-fa1d4dfcf6ea None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.738827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f52c96db-307f-455c-953c-fa1d4dfcf6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:45.750229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1061/2105] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:45.751489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af34c3c-249a-45d0-b010-390bdd8264c0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.751783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c96db-307f-455c-953c-fa1d4dfcf6ea None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.753176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8af34c3c-249a-45d0-b010-390bdd8264c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:45.757538 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.758255 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.758610 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.758979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] PATH_INFO: `/v3/projects/76b7b84f7b3e42ecb44b55741bf83b2d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.760241 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b7b84f7b3e42ecb44b55741bf83b2d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.762389 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.822373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b7b84f7b3e42ecb44b55741bf83b2d', 'request_id': 'req-aee8aab2-10ea-449a-8483-7abc10a2ff09'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:45.826363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af34c3c-249a-45d0-b010-390bdd8264c0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.831327 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b7b84f7b3e42ecb44b55741bf83b2d', 'request_id': 'req-aee8aab2-10ea-449a-8483-7abc10a2ff09'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:45.838369 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b7b84f7b3e42ecb44b55741bf83b2d', 'request_id': 'req-aee8aab2-10ea-449a-8483-7abc10a2ff09'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:45.856076 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] The token cache is being invalidate because project 76b7b84f7b3e42ecb44b55741bf83b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:04:45.856365 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:45.857758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:04:45.863573 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1045/2106] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:04:45 2022] DELETE /identity/v3/projects/76b7b84f7b3e42ecb44b55741bf83b2d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:45.863573 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:45.863573 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:45.892036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7580b-d002-4daf-badd-9d21f0c4a0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.894005 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7580b-d002-4daf-badd-9d21f0c4a0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.894005 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7580b-d002-4daf-badd-9d21f0c4a0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.894005 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7580b-d002-4daf-badd-9d21f0c4a0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.895703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-71f7580b-d002-4daf-badd-9d21f0c4a0e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:45.902492 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:45.936643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8aab2-10ea-449a-8483-7abc10a2ff09 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:45.941309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3266a1b-d3eb-47c4-ae1f-d201f851b2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:45.941919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3266a1b-d3eb-47c4-ae1f-d201f851b2bb service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.942204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3266a1b-d3eb-47c4-ae1f-d201f851b2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.942480 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3266a1b-d3eb-47c4-ae1f-d201f851b2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.945134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b3266a1b-d3eb-47c4-ae1f-d201f851b2bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:45.978028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7580b-d002-4daf-badd-9d21f0c4a0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.979502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7580b-d002-4daf-badd-9d21f0c4a0e0 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.991009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1062/2107] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:45.993235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a763e1-c18a-4285-b807-95d3e10ef688 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.993596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a763e1-c18a-4285-b807-95d3e10ef688 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.993943 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a763e1-c18a-4285-b807-95d3e10ef688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:46.005928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:46.029493 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e1a763e1-c18a-4285-b807-95d3e10ef688 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:46.032157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e1a763e1-c18a-4285-b807-95d3e10ef688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:46.042848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3266a1b-d3eb-47c4-ae1f-d201f851b2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:46.045179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3266a1b-d3eb-47c4-ae1f-d201f851b2bb service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:46.051255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1063/2108] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:46.058735 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1046/2109] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:46.061867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184de642-f28e-45d9-a56d-fa0c890ad3ca None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:46.062212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184de642-f28e-45d9-a56d-fa0c890ad3ca None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:46.062498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184de642-f28e-45d9-a56d-fa0c890ad3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:46.100363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-184de642-f28e-45d9-a56d-fa0c890ad3ca None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:46.101786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-184de642-f28e-45d9-a56d-fa0c890ad3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:46.113820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1064/2110] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:46.117444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3266a1b-d3eb-47c4-ae1f-d201f851b2bb service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:46.130473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3266a1b-d3eb-47c4-ae1f-d201f851b2bb service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:46.137182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b025664-bdf4-4b2f-b8c0-29242411cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:46.138280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025664-bdf4-4b2f-b8c0-29242411cc6f admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:46.138617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025664-bdf4-4b2f-b8c0-29242411cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:46.139341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025664-bdf4-4b2f-b8c0-29242411cc6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:46.139975 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b025664-bdf4-4b2f-b8c0-29242411cc6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:04:46.141043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b025664-bdf4-4b2f-b8c0-29242411cc6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:46.143202 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b025664-bdf4-4b2f-b8c0-29242411cc6f admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:46.170072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1047/2111] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:04:46.176010 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184de642-f28e-45d9-a56d-fa0c890ad3ca None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:46.188397 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184de642-f28e-45d9-a56d-fa0c890ad3ca None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:46.194665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d7af5-f796-43f8-b53d-ed6af9defcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:46.196073 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7af5-f796-43f8-b53d-ed6af9defcd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:46.196073 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7af5-f796-43f8-b53d-ed6af9defcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:46.196073 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7af5-f796-43f8-b53d-ed6af9defcd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:46.196663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d7af5-f796-43f8-b53d-ed6af9defcd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:46.198597 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d7af5-f796-43f8-b53d-ed6af9defcd5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:46.241316 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1065/2112] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:04:46 2022] POST /identity/v3/projects => generated 361 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:04:46.241458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b025664-bdf4-4b2f-b8c0-29242411cc6f admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:46.253003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b025664-bdf4-4b2f-b8c0-29242411cc6f admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:46.352639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acbda1-e45a-45b3-923d-9dedd8712432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:46.352639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acbda1-e45a-45b3-923d-9dedd8712432 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:46.353083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acbda1-e45a-45b3-923d-9dedd8712432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:46.353384 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acbda1-e45a-45b3-923d-9dedd8712432 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:46.354160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acbda1-e45a-45b3-923d-9dedd8712432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:46.356430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acbda1-e45a-45b3-923d-9dedd8712432 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:46.396810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1048/2113] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:04:46 2022] POST /identity/v3/users => generated 281 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:04:46.402088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d7af5-f796-43f8-b53d-ed6af9defcd5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:46.430757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d7af5-f796-43f8-b53d-ed6af9defcd5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:46.436038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625e4a7-0c31-47ad-9680-7a5cd93dd31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:46.437035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625e4a7-0c31-47ad-9680-7a5cd93dd31d admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:46.437610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625e4a7-0c31-47ad-9680-7a5cd93dd31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:46.438012 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625e4a7-0c31-47ad-9680-7a5cd93dd31d admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:46.438752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625e4a7-0c31-47ad-9680-7a5cd93dd31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:46.440503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625e4a7-0c31-47ad-9680-7a5cd93dd31d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:46.454371 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1066/2114] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:46.458689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acbda1-e45a-45b3-923d-9dedd8712432 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:46.470157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acbda1-e45a-45b3-923d-9dedd8712432 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:46.476441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420eda20-bd97-48f4-82b5-12b30fd99b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:46.477190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eda20-bd97-48f4-82b5-12b30fd99b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:46.477576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eda20-bd97-48f4-82b5-12b30fd99b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:46.478109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eda20-bd97-48f4-82b5-12b30fd99b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:46.478969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420eda20-bd97-48f4-82b5-12b30fd99b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:46.480794 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420eda20-bd97-48f4-82b5-12b30fd99b69 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:46.498925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625e4a7-0c31-47ad-9680-7a5cd93dd31d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:46.505385 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1049/2115] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:04:46.514373 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625e4a7-0c31-47ad-9680-7a5cd93dd31d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:46.521757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe8bc7-7431-4e75-bc3f-14ea48871fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:46.522594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe8bc7-7431-4e75-bc3f-14ea48871fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:46.522986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe8bc7-7431-4e75-bc3f-14ea48871fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:46.523364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe8bc7-7431-4e75-bc3f-14ea48871fd9 admin admin] PATH_INFO: `/v3/projects/3ecffed874a7456e83776700ef22cfea/users/d1c1272e56ef4e49a2dd86199c20a607/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:46.547681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe8bc7-7431-4e75-bc3f-14ea48871fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ecffed874a7456e83776700ef22cfea, user_id=d1c1272e56ef4e49a2dd86199c20a607, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:46.552846 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe8bc7-7431-4e75-bc3f-14ea48871fd9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:46.573051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1067/2116] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:04:46 2022] PUT /identity/v3/projects/3ecffed874a7456e83776700ef22cfea/users/d1c1272e56ef4e49a2dd86199c20a607/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:04:46.585908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d291d3a-ec24-4555-92b4-d1a6c18511dd None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:46.585908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d291d3a-ec24-4555-92b4-d1a6c18511dd None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:46.586223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d291d3a-ec24-4555-92b4-d1a6c18511dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:46.621495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-0d291d3a-ec24-4555-92b4-d1a6c18511dd None None] MFA Rules not processed for user `d1c1272e56ef4e49a2dd86199c20a607`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:46.622874 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0d291d3a-ec24-4555-92b4-d1a6c18511dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:46.672062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:46.727795 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1050/2117] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:46.744086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe8bc7-7431-4e75-bc3f-14ea48871fd9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:46.749154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-75fe8bc7-7431-4e75-bc3f-14ea48871fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:46.849215 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe8bc7-7431-4e75-bc3f-14ea48871fd9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:46.855066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c1607-0f55-41f5-bbc6-d5b6bb87d96d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:46.855961 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c1607-0f55-41f5-bbc6-d5b6bb87d96d service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:46.857849 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c1607-0f55-41f5-bbc6-d5b6bb87d96d service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:46.859037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c1607-0f55-41f5-bbc6-d5b6bb87d96d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:46.873502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c1607-0f55-41f5-bbc6-d5b6bb87d96d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:46.875433 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c1607-0f55-41f5-bbc6-d5b6bb87d96d service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:46.896715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1068/2118] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:04:46.979486 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583aee2-80b0-465d-9f90-1076ac4de8f4 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:46.980087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583aee2-80b0-465d-9f90-1076ac4de8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:46.980479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583aee2-80b0-465d-9f90-1076ac4de8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:47.027032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-1583aee2-80b0-465d-9f90-1076ac4de8f4 None None] MFA Rules not processed for user `f2dc394f3da54e118a4c963f13945b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:47.030006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1583aee2-80b0-465d-9f90-1076ac4de8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:47.166333 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1051/2119] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:47.187718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c1607-0f55-41f5-bbc6-d5b6bb87d96d service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:47.189607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-341c1607-0f55-41f5-bbc6-d5b6bb87d96d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:47.208368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c1607-0f55-41f5-bbc6-d5b6bb87d96d service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:47.215642 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bece8-644a-49fc-bfa5-141672a5a61d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:47.219128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bece8-644a-49fc-bfa5-141672a5a61d service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:47.219575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bece8-644a-49fc-bfa5-141672a5a61d service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:47.220051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bece8-644a-49fc-bfa5-141672a5a61d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:47.234798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bece8-644a-49fc-bfa5-141672a5a61d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:47.236648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bece8-644a-49fc-bfa5-141672a5a61d service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:47.264013 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1069/2120] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:48.848061 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839294f-bdc5-43b8-aa00-20d4cfa40e94 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:48.848670 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839294f-bdc5-43b8-aa00-20d4cfa40e94 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:48.848670 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839294f-bdc5-43b8-aa00-20d4cfa40e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:48.886327 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-f839294f-bdc5-43b8-aa00-20d4cfa40e94 None None] MFA Rules not processed for user `f2dc394f3da54e118a4c963f13945b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:48.901294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f839294f-bdc5-43b8-aa00-20d4cfa40e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:48.927524 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1052/2121] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:04:51.878361 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901a68-5854-44fd-8b2a-d8ab3ce6640d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:51.879055 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901a68-5854-44fd-8b2a-d8ab3ce6640d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:51.879055 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901a68-5854-44fd-8b2a-d8ab3ce6640d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:51.937805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d0901a68-5854-44fd-8b2a-d8ab3ce6640d None None] MFA Rules not processed for user `a17e6e20d5d84cf29803263ab19fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:51.939192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d0901a68-5854-44fd-8b2a-d8ab3ce6640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:52.050118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1070/2122] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:52.061277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa8fdf-5168-4574-aba7-2ce00e46101b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:52.062308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa8fdf-5168-4574-aba7-2ce00e46101b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:52.062590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa8fdf-5168-4574-aba7-2ce00e46101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:52.090964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-a5aa8fdf-5168-4574-aba7-2ce00e46101b None None] MFA Rules not processed for user `a17e6e20d5d84cf29803263ab19fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:52.092728 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a5aa8fdf-5168-4574-aba7-2ce00e46101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:52.109444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1053/2123] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:52.116594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0901a68-5854-44fd-8b2a-d8ab3ce6640d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:52.118404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d0901a68-5854-44fd-8b2a-d8ab3ce6640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:52.140836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:52.255226 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0901a68-5854-44fd-8b2a-d8ab3ce6640d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:52.263429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7c44b-253d-4afc-be52-9813bb573c88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:52.264605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7c44b-253d-4afc-be52-9813bb573c88 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:52.265131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7c44b-253d-4afc-be52-9813bb573c88 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:52.267170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7c44b-253d-4afc-be52-9813bb573c88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:52.278741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7c44b-253d-4afc-be52-9813bb573c88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:52.280545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7c44b-253d-4afc-be52-9813bb573c88 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:52.291174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1071/2124] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:53.168115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193fac7-a1ab-4a71-ab1c-27d6639ab37d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:53.168611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193fac7-a1ab-4a71-ab1c-27d6639ab37d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:53.168842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193fac7-a1ab-4a71-ab1c-27d6639ab37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:53.201803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-1193fac7-a1ab-4a71-ab1c-27d6639ab37d None None] MFA Rules not processed for user `b0b425309ac24db282c065d78750bd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:53.203306 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1193fac7-a1ab-4a71-ab1c-27d6639ab37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:53.310900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1054/2125] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:53.493285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d85068-1e5f-4ea6-b133-4606dd08cbc6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:53.493725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d85068-1e5f-4ea6-b133-4606dd08cbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:53.493834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d85068-1e5f-4ea6-b133-4606dd08cbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:53.529857 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a1d85068-1e5f-4ea6-b133-4606dd08cbc6 None None] MFA Rules not processed for user `a17e6e20d5d84cf29803263ab19fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:53.533167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a1d85068-1e5f-4ea6-b133-4606dd08cbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:53.584285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1072/2126] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:04:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:55.277821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193fac7-a1ab-4a71-ab1c-27d6639ab37d None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:55.297000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193fac7-a1ab-4a71-ab1c-27d6639ab37d None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:55.301511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe1362-7ccf-4b53-8623-58ec464410a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:55.302560 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe1362-7ccf-4b53-8623-58ec464410a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:55.303000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe1362-7ccf-4b53-8623-58ec464410a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:55.303452 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe1362-7ccf-4b53-8623-58ec464410a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:55.307808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-55fe1362-7ccf-4b53-8623-58ec464410a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:55.517975 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:55.551497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe1362-7ccf-4b53-8623-58ec464410a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:55.555609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe1362-7ccf-4b53-8623-58ec464410a7 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:55.569269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1055/2127] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:05:03.518862 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=31 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:05.563595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=5 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:18.071666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3fca9-0a7c-43e4-83a4-6aae40f130d7 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:18.072176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3fca9-0a7c-43e4-83a4-6aae40f130d7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:18.072176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3fca9-0a7c-43e4-83a4-6aae40f130d7 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:18.073486 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1073/2128] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 08:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:05:18.085416 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aa250-c8f0-4cde-bddd-21d43023c3ef None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:18.086346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aa250-c8f0-4cde-bddd-21d43023c3ef None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:18.086626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aa250-c8f0-4cde-bddd-21d43023c3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:18.112890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-526aa250-c8f0-4cde-bddd-21d43023c3ef None None] MFA Rules not processed for user `ccab7239a2474aa093e685d5da97f1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:18.114348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-526aa250-c8f0-4cde-bddd-21d43023c3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:18.193537 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3fca9-0a7c-43e4-83a4-6aae40f130d7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:18.195869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ceb3fca9-0a7c-43e4-83a4-6aae40f130d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:18.248154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1056/2129] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 08:05:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:18.259419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526aa250-c8f0-4cde-bddd-21d43023c3ef None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:18.260851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-526aa250-c8f0-4cde-bddd-21d43023c3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:18.273628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3fca9-0a7c-43e4-83a4-6aae40f130d7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:18.274381 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526aa250-c8f0-4cde-bddd-21d43023c3ef None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:18.279368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:18.280050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:18.280312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee6e3f-eb79-471d-9861-6fa50804fd6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccab7239a2474aa093e685d5da97f1a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:18.280418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:18.280592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] PATH_INFO: `/v3/users/0e479a36cb96444db753fe3a96f6fe78` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:18.281105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee6e3f-eb79-471d-9861-6fa50804fd6b service placement] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:18.281478 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee6e3f-eb79-471d-9861-6fa50804fd6b service placement] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:18.281739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e479a36cb96444db753fe3a96f6fe78)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:18.281828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee6e3f-eb79-471d-9861-6fa50804fd6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:18.285320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:18.291850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee6e3f-eb79-471d-9861-6fa50804fd6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:18.298934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee6e3f-eb79-471d-9861-6fa50804fd6b service placement] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:18.313382 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1057/2130] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:05:18.357218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e479a36cb96444db753fe3a96f6fe78'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:18.366182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e479a36cb96444db753fe3a96f6fe78'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:18.381216 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e479a36cb96444db753fe3a96f6fe78'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:18.383613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e479a36cb96444db753fe3a96f6fe78'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:18.397021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e479a36cb96444db753fe3a96f6fe78'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:18.404396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1074/2131] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:05:18 2022] DELETE /identity/v3/users/0e479a36cb96444db753fe3a96f6fe78 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:18.608686 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee6e3f-eb79-471d-9861-6fa50804fd6b service placement] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:18.622779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee6e3f-eb79-471d-9861-6fa50804fd6b service placement] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:18.724553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:18.725224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:18.725512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:18.725851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] PATH_INFO: `/v3/projects/fc4cf004367f4bbe828fb955bc8ff684` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:18.728842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4cf004367f4bbe828fb955bc8ff684)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:18.731631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:18.831947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4cf004367f4bbe828fb955bc8ff684', 'request_id': 'req-05ac59ab-994a-4984-a552-3001623b7c58'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:18.849269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4cf004367f4bbe828fb955bc8ff684', 'request_id': 'req-05ac59ab-994a-4984-a552-3001623b7c58'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:18.858411 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4cf004367f4bbe828fb955bc8ff684', 'request_id': 'req-05ac59ab-994a-4984-a552-3001623b7c58'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:18.873974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] The token cache is being invalidate because project fc4cf004367f4bbe828fb955bc8ff684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:05:18.874406 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:18.875431 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:18.877939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1058/2132] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:05:18 2022] DELETE /identity/v3/projects/fc4cf004367f4bbe828fb955bc8ff684 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:18.881996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:18.884208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:18.909785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97692cdc-20ec-420a-8039-d563e7b15a73 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:18.997211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af18c6b-305a-4630-8a6f-077ad647cf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:18.998620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af18c6b-305a-4630-8a6f-077ad647cf87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:18.998964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af18c6b-305a-4630-8a6f-077ad647cf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:18.999837 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af18c6b-305a-4630-8a6f-077ad647cf87 admin admin] PATH_INFO: `/v3/users/64ba68b9e9714f6aa954dd597c6447ad` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:19.000978 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af18c6b-305a-4630-8a6f-077ad647cf87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ba68b9e9714f6aa954dd597c6447ad)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:19.003102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af18c6b-305a-4630-8a6f-077ad647cf87 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:19.031222 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:19.071307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0af18c6b-305a-4630-8a6f-077ad647cf87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ba68b9e9714f6aa954dd597c6447ad'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:19.095985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0af18c6b-305a-4630-8a6f-077ad647cf87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ba68b9e9714f6aa954dd597c6447ad'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:19.099661 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0af18c6b-305a-4630-8a6f-077ad647cf87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ba68b9e9714f6aa954dd597c6447ad'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:19.101100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0af18c6b-305a-4630-8a6f-077ad647cf87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ba68b9e9714f6aa954dd597c6447ad'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:19.121071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0af18c6b-305a-4630-8a6f-077ad647cf87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ba68b9e9714f6aa954dd597c6447ad'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:19.129099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1075/2133] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:05:18 2022] DELETE /identity/v3/users/64ba68b9e9714f6aa954dd597c6447ad => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:19.408986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:19.410570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:19.439025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac59ab-994a-4984-a552-3001623b7c58 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:19.454939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:19.533763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4853a-9d12-4de8-b017-fd7a993dd17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:19.534507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4853a-9d12-4de8-b017-fd7a993dd17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:19.534883 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4853a-9d12-4de8-b017-fd7a993dd17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:19.535234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4853a-9d12-4de8-b017-fd7a993dd17e admin admin] PATH_INFO: `/v3/projects/44834ffa029943c3a4516c97881d9f4e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:19.536495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4853a-9d12-4de8-b017-fd7a993dd17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=44834ffa029943c3a4516c97881d9f4e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:19.538480 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4853a-9d12-4de8-b017-fd7a993dd17e admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:19.592424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-89a4853a-9d12-4de8-b017-fd7a993dd17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44834ffa029943c3a4516c97881d9f4e', 'request_id': 'req-89a4853a-9d12-4de8-b017-fd7a993dd17e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:19.598916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-89a4853a-9d12-4de8-b017-fd7a993dd17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44834ffa029943c3a4516c97881d9f4e', 'request_id': 'req-89a4853a-9d12-4de8-b017-fd7a993dd17e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:19.606052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-89a4853a-9d12-4de8-b017-fd7a993dd17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44834ffa029943c3a4516c97881d9f4e', 'request_id': 'req-89a4853a-9d12-4de8-b017-fd7a993dd17e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:19.619961 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-89a4853a-9d12-4de8-b017-fd7a993dd17e admin admin] The token cache is being invalidate because project 44834ffa029943c3a4516c97881d9f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:05:19.620263 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-89a4853a-9d12-4de8-b017-fd7a993dd17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:19.621024 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-89a4853a-9d12-4de8-b017-fd7a993dd17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:19.622995 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1059/2134] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:05:19 2022] DELETE /identity/v3/projects/44834ffa029943c3a4516c97881d9f4e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:19.629841 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c101681-701c-42df-a536-aecb03bdc0b6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:19.630215 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c101681-701c-42df-a536-aecb03bdc0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:19.630493 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c101681-701c-42df-a536-aecb03bdc0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:19.652089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6c101681-701c-42df-a536-aecb03bdc0b6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:19.653663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6c101681-701c-42df-a536-aecb03bdc0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:19.737672 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1076/2135] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:19.765176 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65c92a-ecb6-4e01-b5db-022259ddbc79 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:19.765176 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65c92a-ecb6-4e01-b5db-022259ddbc79 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:19.765176 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65c92a-ecb6-4e01-b5db-022259ddbc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:19.785504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-cb65c92a-ecb6-4e01-b5db-022259ddbc79 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:19.786777 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-cb65c92a-ecb6-4e01-b5db-022259ddbc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:19.795426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1060/2136] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:19.799930 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c101681-701c-42df-a536-aecb03bdc0b6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:19.817707 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c101681-701c-42df-a536-aecb03bdc0b6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:19.821720 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f7275-d911-43cf-b167-810c573ffb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:19.822347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f7275-d911-43cf-b167-810c573ffb67 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:19.822630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f7275-d911-43cf-b167-810c573ffb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:19.823353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f7275-d911-43cf-b167-810c573ffb67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:19.823619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f7275-d911-43cf-b167-810c573ffb67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:05:19.825492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f7275-d911-43cf-b167-810c573ffb67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:19.827492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f7275-d911-43cf-b167-810c573ffb67 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:19.848134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1077/2137] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:05:19.852440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65c92a-ecb6-4e01-b5db-022259ddbc79 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:19.864338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65c92a-ecb6-4e01-b5db-022259ddbc79 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:19.877449 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520779c-9ebb-4652-b01c-7c84cbdb9c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:19.878073 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520779c-9ebb-4652-b01c-7c84cbdb9c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:19.878356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520779c-9ebb-4652-b01c-7c84cbdb9c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:19.878763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520779c-9ebb-4652-b01c-7c84cbdb9c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:19.879416 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520779c-9ebb-4652-b01c-7c84cbdb9c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:19.881706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520779c-9ebb-4652-b01c-7c84cbdb9c1b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:19.917322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1061/2138] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:05:19 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:05:19.920248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f7275-d911-43cf-b167-810c573ffb67 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:19.931439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f7275-d911-43cf-b167-810c573ffb67 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:19.998178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf1a0b-db4c-4b58-89e6-db3223baf2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:19.998782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf1a0b-db4c-4b58-89e6-db3223baf2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:19.999189 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf1a0b-db4c-4b58-89e6-db3223baf2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:19.999469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf1a0b-db4c-4b58-89e6-db3223baf2cb admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:20.003156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf1a0b-db4c-4b58-89e6-db3223baf2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:20.003156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf1a0b-db4c-4b58-89e6-db3223baf2cb admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:20.036380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1078/2139] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:05:19 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:05:20.037659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520779c-9ebb-4652-b01c-7c84cbdb9c1b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:20.050368 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520779c-9ebb-4652-b01c-7c84cbdb9c1b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:20.064038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590e2ac-9b8c-4ed5-b88d-9479f602a823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:20.064673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590e2ac-9b8c-4ed5-b88d-9479f602a823 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:20.064956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590e2ac-9b8c-4ed5-b88d-9479f602a823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:20.065224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590e2ac-9b8c-4ed5-b88d-9479f602a823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:20.065897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590e2ac-9b8c-4ed5-b88d-9479f602a823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:20.067466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590e2ac-9b8c-4ed5-b88d-9479f602a823 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:20.081704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1062/2140] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:05:20.083066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf1a0b-db4c-4b58-89e6-db3223baf2cb admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:20.094024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf1a0b-db4c-4b58-89e6-db3223baf2cb admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:20.099345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe811f-5a43-4339-a82d-b7882a921d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:20.100074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe811f-5a43-4339-a82d-b7882a921d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:20.100349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe811f-5a43-4339-a82d-b7882a921d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:20.100623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe811f-5a43-4339-a82d-b7882a921d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:20.101281 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe811f-5a43-4339-a82d-b7882a921d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:20.102896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe811f-5a43-4339-a82d-b7882a921d2a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:20.120205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1079/2141] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:05:20.123424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590e2ac-9b8c-4ed5-b88d-9479f602a823 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:20.143611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590e2ac-9b8c-4ed5-b88d-9479f602a823 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:20.149277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207bbca-8b76-4d6e-9699-919feeb15bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:20.149892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207bbca-8b76-4d6e-9699-919feeb15bab admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:20.150173 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207bbca-8b76-4d6e-9699-919feeb15bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:20.150447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207bbca-8b76-4d6e-9699-919feeb15bab admin admin] PATH_INFO: `/v3/projects/665abb8283b9474d99ca481c3743f3a5/users/fc7ee55f2c7f456696b9d64eebf02ccd/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:20.177293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207bbca-8b76-4d6e-9699-919feeb15bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=665abb8283b9474d99ca481c3743f3a5, user_id=fc7ee55f2c7f456696b9d64eebf02ccd, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:20.182918 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207bbca-8b76-4d6e-9699-919feeb15bab admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:20.200843 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1063/2142] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:05:20 2022] PUT /identity/v3/projects/665abb8283b9474d99ca481c3743f3a5/users/fc7ee55f2c7f456696b9d64eebf02ccd/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:20.212053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb17e18-7790-4984-b870-bcce8c82d04a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:20.213023 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb17e18-7790-4984-b870-bcce8c82d04a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:20.213540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb17e18-7790-4984-b870-bcce8c82d04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:20.223517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:20.246787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2fb17e18-7790-4984-b870-bcce8c82d04a None None] MFA Rules not processed for user `fc7ee55f2c7f456696b9d64eebf02ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:20.248181 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2fb17e18-7790-4984-b870-bcce8c82d04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:20.304047 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb783cc-e093-4021-b138-d657e7d1a42b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:20.304405 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb783cc-e093-4021-b138-d657e7d1a42b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:20.304689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb783cc-e093-4021-b138-d657e7d1a42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:20.323244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1080/2143] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:20.331034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-1eb783cc-e093-4021-b138-d657e7d1a42b None None] MFA Rules not processed for user `27fb790313bb48538af59998e949e2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:20.332509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1eb783cc-e093-4021-b138-d657e7d1a42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:20.334947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb17e18-7790-4984-b870-bcce8c82d04a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:20.336398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2fb17e18-7790-4984-b870-bcce8c82d04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:20.377130 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:20.402348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1064/2144] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:05:20.407532 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb17e18-7790-4984-b870-bcce8c82d04a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:20.415261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d8c98-af32-4ab1-b110-e443bec1d91f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:20.415904 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d8c98-af32-4ab1-b110-e443bec1d91f service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:20.416187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d8c98-af32-4ab1-b110-e443bec1d91f service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:20.416516 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d8c98-af32-4ab1-b110-e443bec1d91f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:20.427028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d8c98-af32-4ab1-b110-e443bec1d91f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:20.428504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d8c98-af32-4ab1-b110-e443bec1d91f service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:20.438774 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1081/2145] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:05:21.869580 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b3523-b384-4e93-a2f5-a31b1d1b2091 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:21.870121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b3523-b384-4e93-a2f5-a31b1d1b2091 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:21.870121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b3523-b384-4e93-a2f5-a31b1d1b2091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:21.902641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-5c8b3523-b384-4e93-a2f5-a31b1d1b2091 None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:21.902641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5c8b3523-b384-4e93-a2f5-a31b1d1b2091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:22.012655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1065/2146] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:05:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:22.058826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d8c98-af32-4ab1-b110-e443bec1d91f service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:22.060890 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a84d8c98-af32-4ab1-b110-e443bec1d91f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:22.165334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d8c98-af32-4ab1-b110-e443bec1d91f service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:22.171414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a83597-6d9a-46ed-891d-99624aef2475 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:22.172219 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a83597-6d9a-46ed-891d-99624aef2475 service swift] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:22.172616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a83597-6d9a-46ed-891d-99624aef2475 service swift] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:22.173101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a83597-6d9a-46ed-891d-99624aef2475 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:22.186405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a83597-6d9a-46ed-891d-99624aef2475 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:22.188230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a83597-6d9a-46ed-891d-99624aef2475 service swift] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:22.198157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1082/2147] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:05:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:05:23.212684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b3523-b384-4e93-a2f5-a31b1d1b2091 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:23.334635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b3523-b384-4e93-a2f5-a31b1d1b2091 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:23.340691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:23.341661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:23.342208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:23.342808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] PATH_INFO: `/v3/users/fc7ee55f2c7f456696b9d64eebf02ccd` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:23.344700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7ee55f2c7f456696b9d64eebf02ccd)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:23.346793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:23.455012 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7ee55f2c7f456696b9d64eebf02ccd'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:23.468268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7ee55f2c7f456696b9d64eebf02ccd'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:23.470067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7ee55f2c7f456696b9d64eebf02ccd'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:23.471158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7ee55f2c7f456696b9d64eebf02ccd'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:23.499948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7ee55f2c7f456696b9d64eebf02ccd'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:23.540751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1066/2148] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:05:23 2022] DELETE /identity/v3/users/fc7ee55f2c7f456696b9d64eebf02ccd => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:23.546060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c77ea8-7f64-4a34-816f-d6555925ba27 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:23.547012 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c77ea8-7f64-4a34-816f-d6555925ba27 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:23.547449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c77ea8-7f64-4a34-816f-d6555925ba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:23.587914 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-49c77ea8-7f64-4a34-816f-d6555925ba27 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:23.590054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-49c77ea8-7f64-4a34-816f-d6555925ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:23.636632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:23.743319 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1083/2149] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:23.754235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:23.755821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:23.769376 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:23.854667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32f59c-dc07-4d09-aecc-3e7e0aec4585 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:23.859236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca1f41-f8ba-474c-bbdf-f67c0e362d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:23.860121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca1f41-f8ba-474c-bbdf-f67c0e362d10 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:23.860580 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca1f41-f8ba-474c-bbdf-f67c0e362d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:23.861886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca1f41-f8ba-474c-bbdf-f67c0e362d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:23.873951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca1f41-f8ba-474c-bbdf-f67c0e362d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:23.876076 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca1f41-f8ba-474c-bbdf-f67c0e362d10 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:23.902224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1067/2150] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:24.687059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c77ea8-7f64-4a34-816f-d6555925ba27 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:24.688528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-49c77ea8-7f64-4a34-816f-d6555925ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:24.712208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c77ea8-7f64-4a34-816f-d6555925ba27 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:24.721881 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c172c-8109-4ac9-a983-e549c37de682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:24.723585 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c172c-8109-4ac9-a983-e549c37de682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:24.724393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c172c-8109-4ac9-a983-e549c37de682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:24.726087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c172c-8109-4ac9-a983-e549c37de682 admin admin] PATH_INFO: `/v3/projects/665abb8283b9474d99ca481c3743f3a5` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:24.728361 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c172c-8109-4ac9-a983-e549c37de682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=665abb8283b9474d99ca481c3743f3a5)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:24.730780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c172c-8109-4ac9-a983-e549c37de682 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:24.798214 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d47c172c-8109-4ac9-a983-e549c37de682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665abb8283b9474d99ca481c3743f3a5', 'request_id': 'req-d47c172c-8109-4ac9-a983-e549c37de682'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:24.808489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d47c172c-8109-4ac9-a983-e549c37de682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665abb8283b9474d99ca481c3743f3a5', 'request_id': 'req-d47c172c-8109-4ac9-a983-e549c37de682'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:24.816676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d47c172c-8109-4ac9-a983-e549c37de682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665abb8283b9474d99ca481c3743f3a5', 'request_id': 'req-d47c172c-8109-4ac9-a983-e549c37de682'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:24.845430 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d47c172c-8109-4ac9-a983-e549c37de682 admin admin] The token cache is being invalidate because project 665abb8283b9474d99ca481c3743f3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:05:24.849453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d47c172c-8109-4ac9-a983-e549c37de682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:24.850703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d47c172c-8109-4ac9-a983-e549c37de682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:24.865026 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1084/2151] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:05:24 2022] DELETE /identity/v3/projects/665abb8283b9474d99ca481c3743f3a5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:24.868357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df3c43-8dda-4fdb-b736-a8bb1742d8e7 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:24.869345 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df3c43-8dda-4fdb-b736-a8bb1742d8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:24.869682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df3c43-8dda-4fdb-b736-a8bb1742d8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:24.920870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b0df3c43-8dda-4fdb-b736-a8bb1742d8e7 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:24.925392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b0df3c43-8dda-4fdb-b736-a8bb1742d8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:25.023497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1068/2152] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:25.033818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa126-ce05-4612-ae3b-15c4feeafbf1 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:25.034270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa126-ce05-4612-ae3b-15c4feeafbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:25.034695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa126-ce05-4612-ae3b-15c4feeafbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:25.072275 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-54daa126-ce05-4612-ae3b-15c4feeafbf1 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:25.073650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-54daa126-ce05-4612-ae3b-15c4feeafbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:25.102437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1085/2153] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:25.104319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df3c43-8dda-4fdb-b736-a8bb1742d8e7 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:25.117731 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df3c43-8dda-4fdb-b736-a8bb1742d8e7 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:25.133549 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bc809-58cd-4bfa-b38b-d4052e2a7ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:25.135284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bc809-58cd-4bfa-b38b-d4052e2a7ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:25.142476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bc809-58cd-4bfa-b38b-d4052e2a7ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:25.143167 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bc809-58cd-4bfa-b38b-d4052e2a7ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:25.145159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bc809-58cd-4bfa-b38b-d4052e2a7ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:05:25.146936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bc809-58cd-4bfa-b38b-d4052e2a7ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:25.153317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bc809-58cd-4bfa-b38b-d4052e2a7ea3 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:25.212575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daa126-ce05-4612-ae3b-15c4feeafbf1 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:25.213884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1069/2154] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:05:25.226693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daa126-ce05-4612-ae3b-15c4feeafbf1 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:25.253346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421b195-01a5-4929-a87a-f3a06dfa98da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:25.253980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421b195-01a5-4929-a87a-f3a06dfa98da admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:25.274112 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421b195-01a5-4929-a87a-f3a06dfa98da admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:25.274511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421b195-01a5-4929-a87a-f3a06dfa98da admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:25.275211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421b195-01a5-4929-a87a-f3a06dfa98da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:25.310999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421b195-01a5-4929-a87a-f3a06dfa98da admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:25.397438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1086/2155] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:05:25 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:05:25.398839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bc809-58cd-4bfa-b38b-d4052e2a7ea3 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:25.414458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bc809-58cd-4bfa-b38b-d4052e2a7ea3 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:25.546570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db8f8b-7e89-47f9-a19a-c8d14952d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:25.551108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db8f8b-7e89-47f9-a19a-c8d14952d4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:25.552089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db8f8b-7e89-47f9-a19a-c8d14952d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:25.552600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db8f8b-7e89-47f9-a19a-c8d14952d4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:25.553323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db8f8b-7e89-47f9-a19a-c8d14952d4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:25.557756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db8f8b-7e89-47f9-a19a-c8d14952d4c6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:25.601966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1070/2156] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:05:25 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:05:25.611403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421b195-01a5-4929-a87a-f3a06dfa98da admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:25.630597 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421b195-01a5-4929-a87a-f3a06dfa98da admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:25.640023 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d08f5-c520-4c40-a140-d6e0294e85ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:25.640734 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d08f5-c520-4c40-a140-d6e0294e85ab admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:25.641104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d08f5-c520-4c40-a140-d6e0294e85ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:25.641722 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d08f5-c520-4c40-a140-d6e0294e85ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:25.642200 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d08f5-c520-4c40-a140-d6e0294e85ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:25.644380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d08f5-c520-4c40-a140-d6e0294e85ab admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:25.659998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1087/2157] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:05:25.664219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db8f8b-7e89-47f9-a19a-c8d14952d4c6 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:25.676057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db8f8b-7e89-47f9-a19a-c8d14952d4c6 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:25.681235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d608b0-320b-4545-ac34-5be5e3185d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:25.682080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d608b0-320b-4545-ac34-5be5e3185d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:25.682436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d608b0-320b-4545-ac34-5be5e3185d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:25.682803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d608b0-320b-4545-ac34-5be5e3185d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:25.683595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d608b0-320b-4545-ac34-5be5e3185d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:25.685298 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d608b0-320b-4545-ac34-5be5e3185d6c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:25.699824 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1071/2158] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:05:25.705084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d08f5-c520-4c40-a140-d6e0294e85ab admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:25.716379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d08f5-c520-4c40-a140-d6e0294e85ab admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:25.721057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db93e17-4c88-4efc-9c76-d02a3536d6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:25.722019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db93e17-4c88-4efc-9c76-d02a3536d6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:25.722526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db93e17-4c88-4efc-9c76-d02a3536d6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:25.723024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db93e17-4c88-4efc-9c76-d02a3536d6f2 admin admin] PATH_INFO: `/v3/projects/fe7198b2e7c246279f44bea1c05d7787/users/095f16d8b81f4acebc1f5cd664434e03/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:25.740131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db93e17-4c88-4efc-9c76-d02a3536d6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7198b2e7c246279f44bea1c05d7787, user_id=095f16d8b81f4acebc1f5cd664434e03, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:25.743399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db93e17-4c88-4efc-9c76-d02a3536d6f2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:25.763779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1088/2159] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:05:25 2022] PUT /identity/v3/projects/fe7198b2e7c246279f44bea1c05d7787/users/095f16d8b81f4acebc1f5cd664434e03/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:25.773750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26e2d1-d5c0-4c3c-891c-4fa0ebc028d9 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:25.774878 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26e2d1-d5c0-4c3c-891c-4fa0ebc028d9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:25.774878 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26e2d1-d5c0-4c3c-891c-4fa0ebc028d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:25.807692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-bb26e2d1-d5c0-4c3c-891c-4fa0ebc028d9 None None] MFA Rules not processed for user `095f16d8b81f4acebc1f5cd664434e03`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:25.809308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-bb26e2d1-d5c0-4c3c-891c-4fa0ebc028d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:25.815215 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:25.908889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1072/2160] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:25.924945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db93e17-4c88-4efc-9c76-d02a3536d6f2 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:25.927860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6db93e17-4c88-4efc-9c76-d02a3536d6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:26.017332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:26.039567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db93e17-4c88-4efc-9c76-d02a3536d6f2 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:26.055469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea39a8-cf51-49ee-8559-6272c352d585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:26.056047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea39a8-cf51-49ee-8559-6272c352d585 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:26.056330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea39a8-cf51-49ee-8559-6272c352d585 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:26.056602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea39a8-cf51-49ee-8559-6272c352d585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:26.079021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea39a8-cf51-49ee-8559-6272c352d585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:26.080526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea39a8-cf51-49ee-8559-6272c352d585 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:26.109002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1089/2161] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:26.130889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26e2d1-d5c0-4c3c-891c-4fa0ebc028d9 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:26.240719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26e2d1-d5c0-4c3c-891c-4fa0ebc028d9 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:26.257925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:26.259422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:26.259811 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:26.261738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] PATH_INFO: `/v3/users/095f16d8b81f4acebc1f5cd664434e03` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:26.262832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095f16d8b81f4acebc1f5cd664434e03)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:26.265454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:26.381451 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095f16d8b81f4acebc1f5cd664434e03'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:26.399347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095f16d8b81f4acebc1f5cd664434e03'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:26.400620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095f16d8b81f4acebc1f5cd664434e03'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:26.402609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095f16d8b81f4acebc1f5cd664434e03'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:26.450773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095f16d8b81f4acebc1f5cd664434e03'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:26.482092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1073/2162] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:05:26 2022] DELETE /identity/v3/users/095f16d8b81f4acebc1f5cd664434e03 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:26.486908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebefa5-cf81-4d63-86ff-de56e4bf924a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:26.486908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebefa5-cf81-4d63-86ff-de56e4bf924a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:26.487372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebefa5-cf81-4d63-86ff-de56e4bf924a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:26.520480 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-04ebefa5-cf81-4d63-86ff-de56e4bf924a None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:26.523030 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-04ebefa5-cf81-4d63-86ff-de56e4bf924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:26.666565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1090/2163] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:26.689888 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:26.691891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:26.766916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:26.817174 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b5e72-285a-4c98-b9d4-427a4cf2dc57 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:26.822109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be2e73-edc9-42f9-abd0-42ca0a41e119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:26.823033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be2e73-edc9-42f9-abd0-42ca0a41e119 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:26.823447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be2e73-edc9-42f9-abd0-42ca0a41e119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:26.825311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be2e73-edc9-42f9-abd0-42ca0a41e119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:26.859954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be2e73-edc9-42f9-abd0-42ca0a41e119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:26.862081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be2e73-edc9-42f9-abd0-42ca0a41e119 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:26.878391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1074/2164] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:05:27.576075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebefa5-cf81-4d63-86ff-de56e4bf924a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:27.583550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-04ebefa5-cf81-4d63-86ff-de56e4bf924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:27.606323 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebefa5-cf81-4d63-86ff-de56e4bf924a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:27.612928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:27.613821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:27.614000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:27.614531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] PATH_INFO: `/v3/projects/fe7198b2e7c246279f44bea1c05d7787` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:27.615710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7198b2e7c246279f44bea1c05d7787)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:27.617888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:27.677770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7198b2e7c246279f44bea1c05d7787', 'request_id': 'req-6759eebd-9748-45ea-8bee-8358782d3f0e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:27.683847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7198b2e7c246279f44bea1c05d7787', 'request_id': 'req-6759eebd-9748-45ea-8bee-8358782d3f0e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:27.690573 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7198b2e7c246279f44bea1c05d7787', 'request_id': 'req-6759eebd-9748-45ea-8bee-8358782d3f0e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:27.718602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] The token cache is being invalidate because project fe7198b2e7c246279f44bea1c05d7787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:05:27.718920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:27.719985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:27.731789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1091/2165] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:05:27 2022] DELETE /identity/v3/projects/fe7198b2e7c246279f44bea1c05d7787 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:36.871229 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=14 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:37.714645 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=59,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:38.824222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e1a2-2cfe-43d2-bd5d-f1c9355e66a9 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:38.824784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e1a2-2cfe-43d2-bd5d-f1c9355e66a9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:38.824918 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e1a2-2cfe-43d2-bd5d-f1c9355e66a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:38.858360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-2ea1e1a2-2cfe-43d2-bd5d-f1c9355e66a9 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:38.861220 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2ea1e1a2-2cfe-43d2-bd5d-f1c9355e66a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:39.009869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1075/2166] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 10 08:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:39.077508 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:39.080759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:39.299468 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759eebd-9748-45ea-8bee-8358782d3f0e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:39.310496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09786d-9d6d-42d1-8342-8fc6ac203751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:39.311279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09786d-9d6d-42d1-8342-8fc6ac203751 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:39.311663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09786d-9d6d-42d1-8342-8fc6ac203751 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:39.312045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09786d-9d6d-42d1-8342-8fc6ac203751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:39.324432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09786d-9d6d-42d1-8342-8fc6ac203751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:39.329034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09786d-9d6d-42d1-8342-8fc6ac203751 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:39.354636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1092/2167] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:39.568559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1e1a2-2cfe-43d2-bd5d-f1c9355e66a9 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:39.570466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2ea1e1a2-2cfe-43d2-bd5d-f1c9355e66a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:39.600662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1e1a2-2cfe-43d2-bd5d-f1c9355e66a9 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:39.606745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:39.607618 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:39.608086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:39.608529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] PATH_INFO: `/v3/users/d1c1272e56ef4e49a2dd86199c20a607` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:39.610448 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c1272e56ef4e49a2dd86199c20a607)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:39.612896 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:39.719442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c1272e56ef4e49a2dd86199c20a607'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:39.733498 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c1272e56ef4e49a2dd86199c20a607'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:39.734709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c1272e56ef4e49a2dd86199c20a607'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:39.735867 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c1272e56ef4e49a2dd86199c20a607'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:39.756674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c1272e56ef4e49a2dd86199c20a607'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:39.774014 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1076/2168] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:05:39 2022] DELETE /identity/v3/users/d1c1272e56ef4e49a2dd86199c20a607 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:05:39.778301 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03481e31-b200-42b0-94c3-929d684d4044 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:39.778667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03481e31-b200-42b0-94c3-929d684d4044 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:39.779057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03481e31-b200-42b0-94c3-929d684d4044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:39.805411 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-03481e31-b200-42b0-94c3-929d684d4044 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:39.806724 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-03481e31-b200-42b0-94c3-929d684d4044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:39.965826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:39.968192 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:39.969452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1093/2169] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:40.086464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361ab62-06f7-4567-acdf-7d91638cd919 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:40.093942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7e454-0655-4654-86df-744a73614cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:40.095277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7e454-0655-4654-86df-744a73614cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:40.095547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7e454-0655-4654-86df-744a73614cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:40.097253 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7e454-0655-4654-86df-744a73614cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:40.150770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7e454-0655-4654-86df-744a73614cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:40.153198 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7e454-0655-4654-86df-744a73614cb9 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:40.190005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1077/2170] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:40.854099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03481e31-b200-42b0-94c3-929d684d4044 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:40.868710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-03481e31-b200-42b0-94c3-929d684d4044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:40.904894 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03481e31-b200-42b0-94c3-929d684d4044 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:40.924988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be208ae1-b3e1-43a1-81dd-3fe72266316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:40.924988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be208ae1-b3e1-43a1-81dd-3fe72266316a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:40.924988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be208ae1-b3e1-43a1-81dd-3fe72266316a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:40.924988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be208ae1-b3e1-43a1-81dd-3fe72266316a admin admin] PATH_INFO: `/v3/projects/3ecffed874a7456e83776700ef22cfea` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:40.930174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be208ae1-b3e1-43a1-81dd-3fe72266316a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ecffed874a7456e83776700ef22cfea)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:40.933135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be208ae1-b3e1-43a1-81dd-3fe72266316a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:41.040602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-be208ae1-b3e1-43a1-81dd-3fe72266316a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ecffed874a7456e83776700ef22cfea', 'request_id': 'req-be208ae1-b3e1-43a1-81dd-3fe72266316a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:41.040602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-be208ae1-b3e1-43a1-81dd-3fe72266316a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ecffed874a7456e83776700ef22cfea', 'request_id': 'req-be208ae1-b3e1-43a1-81dd-3fe72266316a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:41.049413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-be208ae1-b3e1-43a1-81dd-3fe72266316a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ecffed874a7456e83776700ef22cfea', 'request_id': 'req-be208ae1-b3e1-43a1-81dd-3fe72266316a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:41.108206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-be208ae1-b3e1-43a1-81dd-3fe72266316a admin admin] The token cache is being invalidate because project 3ecffed874a7456e83776700ef22cfea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:05:41.108419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-be208ae1-b3e1-43a1-81dd-3fe72266316a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:41.112460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-be208ae1-b3e1-43a1-81dd-3fe72266316a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:41.114553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1094/2171] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:05:40 2022] DELETE /identity/v3/projects/3ecffed874a7456e83776700ef22cfea => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:41.119141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2416d-f063-4e88-ad8b-7690c6603e47 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:41.119692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2416d-f063-4e88-ad8b-7690c6603e47 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:41.119692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2416d-f063-4e88-ad8b-7690c6603e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:41.145778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d5d2416d-f063-4e88-ad8b-7690c6603e47 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:41.162129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d5d2416d-f063-4e88-ad8b-7690c6603e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:41.180784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:41.280992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1078/2172] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:41.290469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a8aa0-38e3-483b-8d83-e62b0abeb137 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:41.290790 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a8aa0-38e3-483b-8d83-e62b0abeb137 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:41.291035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a8aa0-38e3-483b-8d83-e62b0abeb137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:41.315351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e30a8aa0-38e3-483b-8d83-e62b0abeb137 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:41.317289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e30a8aa0-38e3-483b-8d83-e62b0abeb137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:41.329299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1095/2173] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:41.334382 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2416d-f063-4e88-ad8b-7690c6603e47 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:41.352482 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2416d-f063-4e88-ad8b-7690c6603e47 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:41.361418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d7617-ace8-4dec-8186-b34f0c92bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:41.362279 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d7617-ace8-4dec-8186-b34f0c92bf96 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:41.362840 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d7617-ace8-4dec-8186-b34f0c92bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:41.363297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d7617-ace8-4dec-8186-b34f0c92bf96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:41.365315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d7617-ace8-4dec-8186-b34f0c92bf96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:05:41.365834 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d7617-ace8-4dec-8186-b34f0c92bf96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:41.369500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d7617-ace8-4dec-8186-b34f0c92bf96 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:41.399494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1079/2174] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:05:41.400997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a8aa0-38e3-483b-8d83-e62b0abeb137 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:41.409464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:41.420012 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a8aa0-38e3-483b-8d83-e62b0abeb137 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:41.426953 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa7abf-82c6-4328-bd2d-505830a724bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:41.427965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa7abf-82c6-4328-bd2d-505830a724bb admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:41.428453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa7abf-82c6-4328-bd2d-505830a724bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:41.429671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa7abf-82c6-4328-bd2d-505830a724bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:41.430799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa7abf-82c6-4328-bd2d-505830a724bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:41.433608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa7abf-82c6-4328-bd2d-505830a724bb admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:41.482923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1096/2175] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:05:41 2022] POST /identity/v3/projects => generated 397 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:05:41.492652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d7617-ace8-4dec-8186-b34f0c92bf96 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:41.514428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d7617-ace8-4dec-8186-b34f0c92bf96 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:41.636510 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86280351-c3e4-4b15-ab4c-729eddc7a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:41.637732 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86280351-c3e4-4b15-ab4c-729eddc7a957 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:41.638175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86280351-c3e4-4b15-ab4c-729eddc7a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:41.638756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86280351-c3e4-4b15-ab4c-729eddc7a957 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:41.639549 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86280351-c3e4-4b15-ab4c-729eddc7a957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:41.641675 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86280351-c3e4-4b15-ab4c-729eddc7a957 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:41.690813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1080/2176] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:05:41 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:05:41.694397 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa7abf-82c6-4328-bd2d-505830a724bb admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:41.714206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa7abf-82c6-4328-bd2d-505830a724bb admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:41.720322 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c718-b449-4ce1-bf74-399459dcb295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:41.720787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c718-b449-4ce1-bf74-399459dcb295 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:41.721071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c718-b449-4ce1-bf74-399459dcb295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:41.721346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c718-b449-4ce1-bf74-399459dcb295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:41.722161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367c718-b449-4ce1-bf74-399459dcb295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:41.723975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367c718-b449-4ce1-bf74-399459dcb295 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:41.795069 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1097/2177] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:05:41.799123 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86280351-c3e4-4b15-ab4c-729eddc7a957 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:41.820972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86280351-c3e4-4b15-ab4c-729eddc7a957 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:41.840441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e41194-e2b2-4672-a1a0-4fa194410c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:41.841072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e41194-e2b2-4672-a1a0-4fa194410c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:41.841369 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e41194-e2b2-4672-a1a0-4fa194410c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:41.841643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e41194-e2b2-4672-a1a0-4fa194410c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:41.842307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e41194-e2b2-4672-a1a0-4fa194410c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:41.844403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e41194-e2b2-4672-a1a0-4fa194410c4c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:41.860791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1081/2178] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:05:41.865409 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c718-b449-4ce1-bf74-399459dcb295 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:41.886731 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c718-b449-4ce1-bf74-399459dcb295 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:41.908002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d51bc-1b2b-4ed7-88db-07f7c4ad0bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:41.909221 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d51bc-1b2b-4ed7-88db-07f7c4ad0bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:41.909709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d51bc-1b2b-4ed7-88db-07f7c4ad0bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:41.910557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d51bc-1b2b-4ed7-88db-07f7c4ad0bb0 admin admin] PATH_INFO: `/v3/projects/3a4a1e09e7ae440ca5eadf16525cf359/users/fe110e99447e4484b9d5c8eb1a79aec5/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:41.938253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d51bc-1b2b-4ed7-88db-07f7c4ad0bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4a1e09e7ae440ca5eadf16525cf359, user_id=fe110e99447e4484b9d5c8eb1a79aec5, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:41.941490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d51bc-1b2b-4ed7-88db-07f7c4ad0bb0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:41.967079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1098/2179] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:05:41 2022] PUT /identity/v3/projects/3a4a1e09e7ae440ca5eadf16525cf359/users/fe110e99447e4484b9d5c8eb1a79aec5/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:41.978127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97bc49-cee8-443c-8eb8-9f2280187c4f None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:41.978595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97bc49-cee8-443c-8eb8-9f2280187c4f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:41.978595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97bc49-cee8-443c-8eb8-9f2280187c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:42.017784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-7f97bc49-cee8-443c-8eb8-9f2280187c4f None None] MFA Rules not processed for user `fe110e99447e4484b9d5c8eb1a79aec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:42.019527 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7f97bc49-cee8-443c-8eb8-9f2280187c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:42.140631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1082/2180] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:42.147884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d51bc-1b2b-4ed7-88db-07f7c4ad0bb0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:42.150073 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7a1d51bc-1b2b-4ed7-88db-07f7c4ad0bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:42.234039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d51bc-1b2b-4ed7-88db-07f7c4ad0bb0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:42.238776 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca344da-0a73-4aa9-9607-8b94395c14b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:42.239937 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca344da-0a73-4aa9-9607-8b94395c14b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:42.240125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca344da-0a73-4aa9-9607-8b94395c14b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:42.240521 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca344da-0a73-4aa9-9607-8b94395c14b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:42.267162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca344da-0a73-4aa9-9607-8b94395c14b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:42.270745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca344da-0a73-4aa9-9607-8b94395c14b3 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:42.286546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1099/2181] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:42 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:44.101702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc8f1-4916-478c-a62b-897f163f3d3f None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:44.102760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc8f1-4916-478c-a62b-897f163f3d3f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:44.103054 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc8f1-4916-478c-a62b-897f163f3d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:44.137865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-ae8fc8f1-4916-478c-a62b-897f163f3d3f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:44.139152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ae8fc8f1-4916-478c-a62b-897f163f3d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:44.145893 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:44.274655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1083/2182] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 10 08:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:44.291894 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca344da-0a73-4aa9-9607-8b94395c14b3 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:44.294928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fca344da-0a73-4aa9-9607-8b94395c14b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:44.500943 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca344da-0a73-4aa9-9607-8b94395c14b3 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:44.527991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700a938-5f1d-4978-a5da-8358110878d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:44.533039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700a938-5f1d-4978-a5da-8358110878d7 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:44.533709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700a938-5f1d-4978-a5da-8358110878d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:44.534128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700a938-5f1d-4978-a5da-8358110878d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:44.556430 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700a938-5f1d-4978-a5da-8358110878d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:44.559022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700a938-5f1d-4978-a5da-8358110878d7 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:44.612188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1100/2183] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:47.396307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb9187-95c6-4223-b0f7-9e9c21b36359 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:47.396763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb9187-95c6-4223-b0f7-9e9c21b36359 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:47.396890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb9187-95c6-4223-b0f7-9e9c21b36359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:47.416330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-dbcb9187-95c6-4223-b0f7-9e9c21b36359 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:47.417965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-dbcb9187-95c6-4223-b0f7-9e9c21b36359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:47.425876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1084/2184] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 10 08:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:47.441753 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700a938-5f1d-4978-a5da-8358110878d7 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:47.443238 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b700a938-5f1d-4978-a5da-8358110878d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:47.457668 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700a938-5f1d-4978-a5da-8358110878d7 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:47.463284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2da5-ce6d-419a-bfaa-9817e7ea84ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:47.464487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2da5-ce6d-419a-bfaa-9817e7ea84ab service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:47.464762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2da5-ce6d-419a-bfaa-9817e7ea84ab service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:47.465032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2da5-ce6d-419a-bfaa-9817e7ea84ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:47.473533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b2da5-ce6d-419a-bfaa-9817e7ea84ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:47.475128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b2da5-ce6d-419a-bfaa-9817e7ea84ab service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:47.485418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1101/2185] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:47.535146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191fb45-9da4-497c-9d37-a88c6400ff0c None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:47.535440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191fb45-9da4-497c-9d37-a88c6400ff0c None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:47.535717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191fb45-9da4-497c-9d37-a88c6400ff0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:47.555665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-7191fb45-9da4-497c-9d37-a88c6400ff0c None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:47.556904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7191fb45-9da4-497c-9d37-a88c6400ff0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:47.611239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1085/2186] 10.222.0.30 () {58 vars in 967 bytes} [Wed Aug 10 08:05:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:47.623739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2da5-ce6d-419a-bfaa-9817e7ea84ab service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:47.625116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-371b2da5-ce6d-419a-bfaa-9817e7ea84ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:47.646500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:47.697248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2da5-ce6d-419a-bfaa-9817e7ea84ab service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:47.702293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678c013-eea1-4403-a5bc-e94ebd0e5bee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:47.702905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678c013-eea1-4403-a5bc-e94ebd0e5bee service swift] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:47.703185 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678c013-eea1-4403-a5bc-e94ebd0e5bee service swift] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:47.703457 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678c013-eea1-4403-a5bc-e94ebd0e5bee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:47.711854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678c013-eea1-4403-a5bc-e94ebd0e5bee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:47.713436 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678c013-eea1-4403-a5bc-e94ebd0e5bee service swift] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:47.722019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1102/2187] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:05:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:05:48.111810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191fb45-9da4-497c-9d37-a88c6400ff0c None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:48.124725 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191fb45-9da4-497c-9d37-a88c6400ff0c None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:48.130630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:48.131377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:48.132005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:48.132262 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] PATH_INFO: `/v3/users/fe110e99447e4484b9d5c8eb1a79aec5` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:48.134017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe110e99447e4484b9d5c8eb1a79aec5)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:48.136505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:48.227941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe110e99447e4484b9d5c8eb1a79aec5'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:48.237973 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe110e99447e4484b9d5c8eb1a79aec5'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:48.238865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe110e99447e4484b9d5c8eb1a79aec5'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:48.239746 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe110e99447e4484b9d5c8eb1a79aec5'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:48.259127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe110e99447e4484b9d5c8eb1a79aec5'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:48.274391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1086/2188] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:05:48 2022] DELETE /identity/v3/users/fe110e99447e4484b9d5c8eb1a79aec5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:48.279025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d9f5b-a034-4185-a335-88eab78d3f3f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:48.279315 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d9f5b-a034-4185-a335-88eab78d3f3f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:48.279590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d9f5b-a034-4185-a335-88eab78d3f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:48.304018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e53d9f5b-a034-4185-a335-88eab78d3f3f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:48.305296 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e53d9f5b-a034-4185-a335-88eab78d3f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:48.379085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1103/2189] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:48.393144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:48.394665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:48.446575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:48.525962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff14c4f-0aca-466c-a7c8-2e2cff61fbc6 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:48.531991 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5949b7-084e-46f4-8da9-fb67bf4f7b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:48.533374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5949b7-084e-46f4-8da9-fb67bf4f7b35 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:48.533892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5949b7-084e-46f4-8da9-fb67bf4f7b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:48.534382 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5949b7-084e-46f4-8da9-fb67bf4f7b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:48.546098 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5949b7-084e-46f4-8da9-fb67bf4f7b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:48.548045 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5949b7-084e-46f4-8da9-fb67bf4f7b35 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:48.562288 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1087/2190] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:48.616009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5fe8f-2841-41b5-9596-da3ffeb79029 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:48.616558 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5fe8f-2841-41b5-9596-da3ffeb79029 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:48.616679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5fe8f-2841-41b5-9596-da3ffeb79029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:48.654063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fed5fe8f-2841-41b5-9596-da3ffeb79029 None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:48.655552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fed5fe8f-2841-41b5-9596-da3ffeb79029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:48.721424 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1104/2191] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:05:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:48.735291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5949b7-084e-46f4-8da9-fb67bf4f7b35 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:48.737528 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ee5949b7-084e-46f4-8da9-fb67bf4f7b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:48.816846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5949b7-084e-46f4-8da9-fb67bf4f7b35 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:48.824805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e859505-3bc0-4a09-a492-6ae75ccbf2e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:48.825435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859505-3bc0-4a09-a492-6ae75ccbf2e5 service swift] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:48.825718 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859505-3bc0-4a09-a492-6ae75ccbf2e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:48.825988 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859505-3bc0-4a09-a492-6ae75ccbf2e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:48.840965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e859505-3bc0-4a09-a492-6ae75ccbf2e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:48.843292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e859505-3bc0-4a09-a492-6ae75ccbf2e5 service swift] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:48.854886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1088/2192] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:05:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 08:05:49.006268 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5fe8f-2841-41b5-9596-da3ffeb79029 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:49.007715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fed5fe8f-2841-41b5-9596-da3ffeb79029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:49.033302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5fe8f-2841-41b5-9596-da3ffeb79029 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:49.047547 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af37eee-6723-4bc7-9cdb-cccc9ed30753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:49.048417 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37eee-6723-4bc7-9cdb-cccc9ed30753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:49.048801 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37eee-6723-4bc7-9cdb-cccc9ed30753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:49.049260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37eee-6723-4bc7-9cdb-cccc9ed30753 admin admin] PATH_INFO: `/v3/projects/3a4a1e09e7ae440ca5eadf16525cf359` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:49.054877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af37eee-6723-4bc7-9cdb-cccc9ed30753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4a1e09e7ae440ca5eadf16525cf359)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:49.058834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af37eee-6723-4bc7-9cdb-cccc9ed30753 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:49.123900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1af37eee-6723-4bc7-9cdb-cccc9ed30753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4a1e09e7ae440ca5eadf16525cf359', 'request_id': 'req-1af37eee-6723-4bc7-9cdb-cccc9ed30753'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:49.125375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:49.131909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1af37eee-6723-4bc7-9cdb-cccc9ed30753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4a1e09e7ae440ca5eadf16525cf359', 'request_id': 'req-1af37eee-6723-4bc7-9cdb-cccc9ed30753'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:49.140718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1af37eee-6723-4bc7-9cdb-cccc9ed30753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4a1e09e7ae440ca5eadf16525cf359', 'request_id': 'req-1af37eee-6723-4bc7-9cdb-cccc9ed30753'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:49.158635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1af37eee-6723-4bc7-9cdb-cccc9ed30753 admin admin] The token cache is being invalidate because project 3a4a1e09e7ae440ca5eadf16525cf359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:05:49.159019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1af37eee-6723-4bc7-9cdb-cccc9ed30753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:49.159666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1af37eee-6723-4bc7-9cdb-cccc9ed30753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:49.161503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1105/2193] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:05:49 2022] DELETE /identity/v3/projects/3a4a1e09e7ae440ca5eadf16525cf359 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:49.169939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cb252-c358-4643-951d-3c1036c40e55 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:49.170225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cb252-c358-4643-951d-3c1036c40e55 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:49.170732 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cb252-c358-4643-951d-3c1036c40e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:49.206074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-df1cb252-c358-4643-951d-3c1036c40e55 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:49.207985 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-df1cb252-c358-4643-951d-3c1036c40e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:49.379327 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1089/2194] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:49.387551 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bf869-59a9-4592-9c60-9d2599b51a38 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:49.387931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bf869-59a9-4592-9c60-9d2599b51a38 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:49.388208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bf869-59a9-4592-9c60-9d2599b51a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:49.428649 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0c7bf869-59a9-4592-9c60-9d2599b51a38 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:49.429904 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0c7bf869-59a9-4592-9c60-9d2599b51a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:49.441472 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1106/2195] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:49.445924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cb252-c358-4643-951d-3c1036c40e55 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:49.458128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cb252-c358-4643-951d-3c1036c40e55 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:49.476889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ee136-89d5-490e-887b-44bdf24b28d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:49.478052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ee136-89d5-490e-887b-44bdf24b28d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:49.478623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ee136-89d5-490e-887b-44bdf24b28d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:49.480164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ee136-89d5-490e-887b-44bdf24b28d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:49.482678 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ee136-89d5-490e-887b-44bdf24b28d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:05:49.483495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ee136-89d5-490e-887b-44bdf24b28d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:49.486529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ee136-89d5-490e-887b-44bdf24b28d9 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:49.515452 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1090/2196] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:05:49.522627 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bf869-59a9-4592-9c60-9d2599b51a38 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:49.550202 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bf869-59a9-4592-9c60-9d2599b51a38 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:49.562036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df2ae5-aae4-4f7a-af10-ac61049089ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:49.563355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df2ae5-aae4-4f7a-af10-ac61049089ba admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:49.563843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df2ae5-aae4-4f7a-af10-ac61049089ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:49.564266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df2ae5-aae4-4f7a-af10-ac61049089ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:49.565071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df2ae5-aae4-4f7a-af10-ac61049089ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:49.568011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df2ae5-aae4-4f7a-af10-ac61049089ba admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:49.639106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1107/2197] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:05:49 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:05:49.640700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ee136-89d5-490e-887b-44bdf24b28d9 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:49.679861 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ee136-89d5-490e-887b-44bdf24b28d9 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:49.764248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:49.802650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236adac4-8a5f-4d4d-a6d4-65afe02c9866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:49.804321 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236adac4-8a5f-4d4d-a6d4-65afe02c9866 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:49.804716 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236adac4-8a5f-4d4d-a6d4-65afe02c9866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:49.805094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236adac4-8a5f-4d4d-a6d4-65afe02c9866 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:49.806338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236adac4-8a5f-4d4d-a6d4-65afe02c9866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:49.809656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236adac4-8a5f-4d4d-a6d4-65afe02c9866 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:49.856588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1091/2198] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:05:49 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:05:49.856800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df2ae5-aae4-4f7a-af10-ac61049089ba admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:49.873403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df2ae5-aae4-4f7a-af10-ac61049089ba admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:49.884049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b77400-d9d0-4009-bdb5-8a8221a932cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:49.885024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b77400-d9d0-4009-bdb5-8a8221a932cf admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:49.886127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b77400-d9d0-4009-bdb5-8a8221a932cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:49.886600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b77400-d9d0-4009-bdb5-8a8221a932cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:49.887632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b77400-d9d0-4009-bdb5-8a8221a932cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:49.892975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b77400-d9d0-4009-bdb5-8a8221a932cf admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:49.907102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1108/2199] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:05:49.911929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236adac4-8a5f-4d4d-a6d4-65afe02c9866 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:49.957180 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236adac4-8a5f-4d4d-a6d4-65afe02c9866 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:49.981363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6e63a-e244-4446-92ab-940ceb162d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:49.983909 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6e63a-e244-4446-92ab-940ceb162d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:49.987257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6e63a-e244-4446-92ab-940ceb162d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:49.988133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6e63a-e244-4446-92ab-940ceb162d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:49.989384 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6e63a-e244-4446-92ab-940ceb162d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:49.993353 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6e63a-e244-4446-92ab-940ceb162d3c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:50.008262 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1092/2200] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:05:50.014601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b77400-d9d0-4009-bdb5-8a8221a932cf admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:50.026687 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b77400-d9d0-4009-bdb5-8a8221a932cf admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:50.031977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a41a1-a3be-4137-b40a-ae87ea9a24a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:50.032853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a41a1-a3be-4137-b40a-ae87ea9a24a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:50.033323 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a41a1-a3be-4137-b40a-ae87ea9a24a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:50.033754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a41a1-a3be-4137-b40a-ae87ea9a24a3 admin admin] PATH_INFO: `/v3/projects/0e7c9c2c17964a7e8657074110c052b6/users/bc7057fda920471f8912ed4dbba2698f/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:50.054654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a41a1-a3be-4137-b40a-ae87ea9a24a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7c9c2c17964a7e8657074110c052b6, user_id=bc7057fda920471f8912ed4dbba2698f, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:50.057580 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a41a1-a3be-4137-b40a-ae87ea9a24a3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:50.076261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1109/2201] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:05:50 2022] PUT /identity/v3/projects/0e7c9c2c17964a7e8657074110c052b6/users/bc7057fda920471f8912ed4dbba2698f/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:50.081571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc077c51-9c19-4330-a589-7e7da01c930e None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:50.081884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc077c51-9c19-4330-a589-7e7da01c930e None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:50.082186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc077c51-9c19-4330-a589-7e7da01c930e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:50.108618 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-bc077c51-9c19-4330-a589-7e7da01c930e None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:50.109932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-bc077c51-9c19-4330-a589-7e7da01c930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:50.261997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1093/2202] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:50.282157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a41a1-a3be-4137-b40a-ae87ea9a24a3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:50.284128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3f9a41a1-a3be-4137-b40a-ae87ea9a24a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:50.422565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a41a1-a3be-4137-b40a-ae87ea9a24a3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:50.428450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4097b-54e1-4edd-abbb-473fa1dd1fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:50.429349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4097b-54e1-4edd-abbb-473fa1dd1fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:50.429784 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4097b-54e1-4edd-abbb-473fa1dd1fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:50.430437 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4097b-54e1-4edd-abbb-473fa1dd1fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:50.444997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4097b-54e1-4edd-abbb-473fa1dd1fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:50.446597 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4097b-54e1-4edd-abbb-473fa1dd1fb8 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:50.469337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1110/2203] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:50.618190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc077c51-9c19-4330-a589-7e7da01c930e None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:50.626461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-bc077c51-9c19-4330-a589-7e7da01c930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:50.653675 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc077c51-9c19-4330-a589-7e7da01c930e None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:50.661127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6414d25-c96e-438f-be99-99bfcbb81976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:50.663021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6414d25-c96e-438f-be99-99bfcbb81976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:50.663462 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6414d25-c96e-438f-be99-99bfcbb81976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:50.664337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6414d25-c96e-438f-be99-99bfcbb81976 admin admin] PATH_INFO: `/v3/users/b0b425309ac24db282c065d78750bd4f` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:50.666024 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6414d25-c96e-438f-be99-99bfcbb81976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b425309ac24db282c065d78750bd4f)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:50.669775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6414d25-c96e-438f-be99-99bfcbb81976 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:50.750205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d6414d25-c96e-438f-be99-99bfcbb81976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b425309ac24db282c065d78750bd4f'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:50.762754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d6414d25-c96e-438f-be99-99bfcbb81976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b425309ac24db282c065d78750bd4f'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:50.764748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d6414d25-c96e-438f-be99-99bfcbb81976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b425309ac24db282c065d78750bd4f'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:50.768080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d6414d25-c96e-438f-be99-99bfcbb81976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b425309ac24db282c065d78750bd4f'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:50.791101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d6414d25-c96e-438f-be99-99bfcbb81976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b425309ac24db282c065d78750bd4f'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:50.829240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1094/2204] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:05:50 2022] DELETE /identity/v3/users/b0b425309ac24db282c065d78750bd4f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:51.462792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4097b-54e1-4edd-abbb-473fa1dd1fb8 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:51.515294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4097b-54e1-4edd-abbb-473fa1dd1fb8 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:51.652830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa069d-4fe9-429a-9b2e-fb0b808ac76b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:51.653410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa069d-4fe9-429a-9b2e-fb0b808ac76b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:51.654116 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa069d-4fe9-429a-9b2e-fb0b808ac76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:51.689056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-84fa069d-4fe9-429a-9b2e-fb0b808ac76b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:51.690789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-84fa069d-4fe9-429a-9b2e-fb0b808ac76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:51.692116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a4adf-c7c3-487b-a534-b9821fc531b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:51.692761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4adf-c7c3-487b-a534-b9821fc531b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:51.693091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4adf-c7c3-487b-a534-b9821fc531b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:51.693487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4adf-c7c3-487b-a534-b9821fc531b8 admin admin] PATH_INFO: `/v3/projects/4d6d413bac1c4b9e98197c0c74edd821` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:51.694820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a4adf-c7c3-487b-a534-b9821fc531b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6d413bac1c4b9e98197c0c74edd821)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:51.696835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a4adf-c7c3-487b-a534-b9821fc531b8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:51.705086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1095/2205] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 10 08:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:51.722753 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:51.728686 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa069d-4fe9-429a-9b2e-fb0b808ac76b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:51.734015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-84fa069d-4fe9-429a-9b2e-fb0b808ac76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:51.782291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-016a4adf-c7c3-487b-a534-b9821fc531b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6d413bac1c4b9e98197c0c74edd821', 'request_id': 'req-016a4adf-c7c3-487b-a534-b9821fc531b8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:51.785964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:51.796969 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-016a4adf-c7c3-487b-a534-b9821fc531b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6d413bac1c4b9e98197c0c74edd821', 'request_id': 'req-016a4adf-c7c3-487b-a534-b9821fc531b8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:51.804463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-016a4adf-c7c3-487b-a534-b9821fc531b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6d413bac1c4b9e98197c0c74edd821', 'request_id': 'req-016a4adf-c7c3-487b-a534-b9821fc531b8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:51.830910 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-016a4adf-c7c3-487b-a534-b9821fc531b8 admin admin] The token cache is being invalidate because project 4d6d413bac1c4b9e98197c0c74edd821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:05:51.831227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-016a4adf-c7c3-487b-a534-b9821fc531b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:51.832031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-016a4adf-c7c3-487b-a534-b9821fc531b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:05:51.834699 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1111/2206] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:05:51 2022] DELETE /identity/v3/projects/4d6d413bac1c4b9e98197c0c74edd821 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:51.840335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc8728-d317-464d-93ce-5d0eadc85e94 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:51.840701 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc8728-d317-464d-93ce-5d0eadc85e94 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:51.841064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc8728-d317-464d-93ce-5d0eadc85e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:51.865084 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa069d-4fe9-429a-9b2e-fb0b808ac76b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:51.883136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a6fc8728-d317-464d-93ce-5d0eadc85e94 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:51.884419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a6fc8728-d317-464d-93ce-5d0eadc85e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:51.971702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb2ab5-db1c-480b-b3a5-b51805bc4b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:51.972452 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb2ab5-db1c-480b-b3a5-b51805bc4b34 service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:51.973187 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb2ab5-db1c-480b-b3a5-b51805bc4b34 service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:51.973572 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb2ab5-db1c-480b-b3a5-b51805bc4b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:51.975682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-32cb2ab5-db1c-480b-b3a5-b51805bc4b34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:51.988432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1112/2207] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:51.993513 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d15e94-657a-4ba9-913b-37267e7e98c4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:51.994479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d15e94-657a-4ba9-913b-37267e7e98c4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:51.995203 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d15e94-657a-4ba9-913b-37267e7e98c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:51.999703 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb2ab5-db1c-480b-b3a5-b51805bc4b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:52.002096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb2ab5-db1c-480b-b3a5-b51805bc4b34 service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:52.043214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1096/2208] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:52.098773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c1d15e94-657a-4ba9-913b-37267e7e98c4 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:52.103909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c1d15e94-657a-4ba9-913b-37267e7e98c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:52.132614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1113/2209] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:52.133996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb2ab5-db1c-480b-b3a5-b51805bc4b34 service nova] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:52.146568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb2ab5-db1c-480b-b3a5-b51805bc4b34 service nova] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:52.155516 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af47b0-b738-4c16-9ded-02e1840a8398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:52.155516 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af47b0-b738-4c16-9ded-02e1840a8398 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:52.155516 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af47b0-b738-4c16-9ded-02e1840a8398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:52.184375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af47b0-b738-4c16-9ded-02e1840a8398 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:52.192742 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af47b0-b738-4c16-9ded-02e1840a8398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:05:52.193141 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af47b0-b738-4c16-9ded-02e1840a8398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:52.195010 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af47b0-b738-4c16-9ded-02e1840a8398 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:52.224030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1097/2210] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:05:52.228770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d15e94-657a-4ba9-913b-37267e7e98c4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:52.243960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d15e94-657a-4ba9-913b-37267e7e98c4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:52.265964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e766ca6-44fc-4a89-80df-5a6cb44e625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:52.266610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e766ca6-44fc-4a89-80df-5a6cb44e625e admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:52.266900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e766ca6-44fc-4a89-80df-5a6cb44e625e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:52.267168 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e766ca6-44fc-4a89-80df-5a6cb44e625e admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:52.267852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e766ca6-44fc-4a89-80df-5a6cb44e625e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:52.282124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e766ca6-44fc-4a89-80df-5a6cb44e625e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:52.349593 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1114/2211] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:05:52 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:05:52.350848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af47b0-b738-4c16-9ded-02e1840a8398 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:52.364290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af47b0-b738-4c16-9ded-02e1840a8398 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:52.467915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ee74e-4558-4bf7-80d5-594e1ecbcb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:52.470152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ee74e-4558-4bf7-80d5-594e1ecbcb15 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:52.470152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ee74e-4558-4bf7-80d5-594e1ecbcb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:52.470363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ee74e-4558-4bf7-80d5-594e1ecbcb15 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:52.471219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ee74e-4558-4bf7-80d5-594e1ecbcb15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:52.475122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ee74e-4558-4bf7-80d5-594e1ecbcb15 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:52.528538 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1098/2212] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:05:52 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:05:52.532602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e766ca6-44fc-4a89-80df-5a6cb44e625e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:52.550118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e766ca6-44fc-4a89-80df-5a6cb44e625e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:52.557059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459962e-c3b3-46c8-82e7-60b3e26616c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:52.558132 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459962e-c3b3-46c8-82e7-60b3e26616c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:52.558718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459962e-c3b3-46c8-82e7-60b3e26616c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:52.559231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459962e-c3b3-46c8-82e7-60b3e26616c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:52.560190 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459962e-c3b3-46c8-82e7-60b3e26616c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:52.563273 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459962e-c3b3-46c8-82e7-60b3e26616c2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:52.585142 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1115/2213] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:05:52.585598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ee74e-4558-4bf7-80d5-594e1ecbcb15 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:52.602008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ee74e-4558-4bf7-80d5-594e1ecbcb15 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:52.616647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faed5ef-f73e-429a-940e-98a814f8ac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:52.617283 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faed5ef-f73e-429a-940e-98a814f8ac8e admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:52.617638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faed5ef-f73e-429a-940e-98a814f8ac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:52.618076 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faed5ef-f73e-429a-940e-98a814f8ac8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:52.618746 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faed5ef-f73e-429a-940e-98a814f8ac8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:52.624398 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faed5ef-f73e-429a-940e-98a814f8ac8e admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:52.654400 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1099/2214] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:05:52.662385 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459962e-c3b3-46c8-82e7-60b3e26616c2 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:52.709068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459962e-c3b3-46c8-82e7-60b3e26616c2 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:52.746999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6b8a8-a7f0-489a-833b-b45ed1866244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:52.747698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6b8a8-a7f0-489a-833b-b45ed1866244 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:52.748125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6b8a8-a7f0-489a-833b-b45ed1866244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:52.748405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6b8a8-a7f0-489a-833b-b45ed1866244 admin admin] PATH_INFO: `/v3/projects/d9ce73a2fb274334be773dd7d0888e22/users/15fae7f515c04cda9797b1c782c3df8d/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:52.780901 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6b8a8-a7f0-489a-833b-b45ed1866244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ce73a2fb274334be773dd7d0888e22, user_id=15fae7f515c04cda9797b1c782c3df8d, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:52.786034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6b8a8-a7f0-489a-833b-b45ed1866244 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:52.843160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1116/2215] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:05:52 2022] PUT /identity/v3/projects/d9ce73a2fb274334be773dd7d0888e22/users/15fae7f515c04cda9797b1c782c3df8d/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:05:52.845345 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33360a-a705-404b-adf8-d915dfdac52a None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:52.845657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33360a-a705-404b-adf8-d915dfdac52a None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:52.845915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33360a-a705-404b-adf8-d915dfdac52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:52.944935 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-fb33360a-a705-404b-adf8-d915dfdac52a None None] MFA Rules not processed for user `15fae7f515c04cda9797b1c782c3df8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:52.950310 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-fb33360a-a705-404b-adf8-d915dfdac52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:52.973316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:53.133425 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1100/2216] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:05:53.148880 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6b8a8-a7f0-489a-833b-b45ed1866244 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:53.152062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2bb6b8a8-a7f0-489a-833b-b45ed1866244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:53.311549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:53.365459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6b8a8-a7f0-489a-833b-b45ed1866244 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:53.372604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756897d-b360-4ab7-87fa-64b48e4f73a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553916344aaf40ae8abb050540f10559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:53.374376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756897d-b360-4ab7-87fa-64b48e4f73a3 service glance] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:53.375110 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756897d-b360-4ab7-87fa-64b48e4f73a3 service glance] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:53.375622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756897d-b360-4ab7-87fa-64b48e4f73a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:53.395502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756897d-b360-4ab7-87fa-64b48e4f73a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:53.397631 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756897d-b360-4ab7-87fa-64b48e4f73a3 service glance] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:53.415024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1117/2217] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:56.594956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a090e69-127e-4d97-8d85-0174be19a6a1 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:56.596214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a090e69-127e-4d97-8d85-0174be19a6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:56.596712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a090e69-127e-4d97-8d85-0174be19a6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:56.660803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-6a090e69-127e-4d97-8d85-0174be19a6a1 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:56.665261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6a090e69-127e-4d97-8d85-0174be19a6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:56.780436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1101/2218] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 10 08:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:56.799429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756897d-b360-4ab7-87fa-64b48e4f73a3 service glance] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:56.800678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a756897d-b360-4ab7-87fa-64b48e4f73a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:56.936118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756897d-b360-4ab7-87fa-64b48e4f73a3 service glance] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:56.954717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afe6ac-3115-4a5d-9839-4247481fee50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:56.955431 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afe6ac-3115-4a5d-9839-4247481fee50 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:56.957259 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afe6ac-3115-4a5d-9839-4247481fee50 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:56.957601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afe6ac-3115-4a5d-9839-4247481fee50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:56.971233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afe6ac-3115-4a5d-9839-4247481fee50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:56.974544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afe6ac-3115-4a5d-9839-4247481fee50 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:56.987992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1118/2219] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:59.615441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4885ec-18d5-4b92-978d-f30e6c5803bc None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:59.615983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4885ec-18d5-4b92-978d-f30e6c5803bc None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:59.616068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4885ec-18d5-4b92-978d-f30e6c5803bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:59.673330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-8b4885ec-18d5-4b92-978d-f30e6c5803bc None None] MFA Rules not processed for user `bc7057fda920471f8912ed4dbba2698f`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:59.674569 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8b4885ec-18d5-4b92-978d-f30e6c5803bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:59.771607 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1102/2220] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:05:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:59.772320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afe6ac-3115-4a5d-9839-4247481fee50 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:59.776416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c4afe6ac-3115-4a5d-9839-4247481fee50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:59.790180 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afe6ac-3115-4a5d-9839-4247481fee50 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:59.796490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6dcb05-f847-4d6e-8c4f-3fb373fcb80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:59.797304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dcb05-f847-4d6e-8c4f-3fb373fcb80b admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:59.797859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dcb05-f847-4d6e-8c4f-3fb373fcb80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:59.798290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dcb05-f847-4d6e-8c4f-3fb373fcb80b admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:59.799293 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6dcb05-f847-4d6e-8c4f-3fb373fcb80b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:59.801944 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6dcb05-f847-4d6e-8c4f-3fb373fcb80b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:59.848326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1119/2221] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:05:59 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:05:59.856786 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4885ec-18d5-4b92-978d-f30e6c5803bc None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:59.876899 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4885ec-18d5-4b92-978d-f30e6c5803bc None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:59.937752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:59.967609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715963-d4b3-4e26-89c5-b964ca266f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:59.968409 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715963-d4b3-4e26-89c5-b964ca266f5b admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:59.968771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715963-d4b3-4e26-89c5-b964ca266f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:59.969121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715963-d4b3-4e26-89c5-b964ca266f5b admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:59.970277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b715963-d4b3-4e26-89c5-b964ca266f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:59.972022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b715963-d4b3-4e26-89c5-b964ca266f5b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:00.014348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1103/2222] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:05:59 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:06:00.016190 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6dcb05-f847-4d6e-8c4f-3fb373fcb80b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:00.054927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6dcb05-f847-4d6e-8c4f-3fb373fcb80b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:00.073995 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98ac80-b59e-4ec8-9757-2d5a8be7a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:00.076295 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98ac80-b59e-4ec8-9757-2d5a8be7a2de admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:00.076580 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98ac80-b59e-4ec8-9757-2d5a8be7a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:00.078659 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98ac80-b59e-4ec8-9757-2d5a8be7a2de admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:00.079368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98ac80-b59e-4ec8-9757-2d5a8be7a2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:00.080975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98ac80-b59e-4ec8-9757-2d5a8be7a2de admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:00.137328 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1120/2223] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:06:00.141661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715963-d4b3-4e26-89c5-b964ca266f5b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:00.157968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715963-d4b3-4e26-89c5-b964ca266f5b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:00.169783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831ce5b-01d6-4029-919b-98cc6a82a1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:00.170570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831ce5b-01d6-4029-919b-98cc6a82a1b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:00.171158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831ce5b-01d6-4029-919b-98cc6a82a1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:00.171530 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831ce5b-01d6-4029-919b-98cc6a82a1b7 admin admin] PATH_INFO: `/v3/projects/fb9459719d784573bcd806fd5143e2e2/users/5bfd405168ca47acb5ebc0a3ede60ec8/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:00.198814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831ce5b-01d6-4029-919b-98cc6a82a1b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9459719d784573bcd806fd5143e2e2, user_id=5bfd405168ca47acb5ebc0a3ede60ec8, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:00.202088 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831ce5b-01d6-4029-919b-98cc6a82a1b7 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:00.223890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1104/2224] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:06:00 2022] PUT /identity/v3/projects/fb9459719d784573bcd806fd5143e2e2/users/5bfd405168ca47acb5ebc0a3ede60ec8/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:06:00.230405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98ac80-b59e-4ec8-9757-2d5a8be7a2de admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:00.255923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98ac80-b59e-4ec8-9757-2d5a8be7a2de admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:00.412027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad2198-123f-450f-b162-5cd0b14c35be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:00.412802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad2198-123f-450f-b162-5cd0b14c35be admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:00.413188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad2198-123f-450f-b162-5cd0b14c35be admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:00.413564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad2198-123f-450f-b162-5cd0b14c35be admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:00.414323 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad2198-123f-450f-b162-5cd0b14c35be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:00.416780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad2198-123f-450f-b162-5cd0b14c35be admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:00.431341 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1121/2225] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:06:00.436863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831ce5b-01d6-4029-919b-98cc6a82a1b7 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:00.456758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831ce5b-01d6-4029-919b-98cc6a82a1b7 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:00.485135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21d178-71a3-44dc-8a50-b03c705d6b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:00.486648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21d178-71a3-44dc-8a50-b03c705d6b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:00.486938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21d178-71a3-44dc-8a50-b03c705d6b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:00.487219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21d178-71a3-44dc-8a50-b03c705d6b08 admin admin] PATH_INFO: `/v3/projects/fb9459719d784573bcd806fd5143e2e2/users/5bfd405168ca47acb5ebc0a3ede60ec8/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:00.496760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21d178-71a3-44dc-8a50-b03c705d6b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9459719d784573bcd806fd5143e2e2, user_id=5bfd405168ca47acb5ebc0a3ede60ec8, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:00.506713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21d178-71a3-44dc-8a50-b03c705d6b08 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:00.532735 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1105/2226] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:06:00 2022] PUT /identity/v3/projects/fb9459719d784573bcd806fd5143e2e2/users/5bfd405168ca47acb5ebc0a3ede60ec8/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:06:00.977592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568187d9-0ca6-4c99-bd11-2f464c2d9ecd None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:00.978131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568187d9-0ca6-4c99-bd11-2f464c2d9ecd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:00.979004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568187d9-0ca6-4c99-bd11-2f464c2d9ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:01.037413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-568187d9-0ca6-4c99-bd11-2f464c2d9ecd None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:01.039933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-568187d9-0ca6-4c99-bd11-2f464c2d9ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:01.111806 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:06:01.168706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1122/2227] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 10 08:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:06:01.188278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21d178-71a3-44dc-8a50-b03c705d6b08 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:01.191834 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ad21d178-71a3-44dc-8a50-b03c705d6b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:01.349750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21d178-71a3-44dc-8a50-b03c705d6b08 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:01.358739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5ae5f-6164-49a8-9900-714107ef6c73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:01.359947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5ae5f-6164-49a8-9900-714107ef6c73 service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:01.359947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5ae5f-6164-49a8-9900-714107ef6c73 service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:01.360349 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5ae5f-6164-49a8-9900-714107ef6c73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:01.375260 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5ae5f-6164-49a8-9900-714107ef6c73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:01.378751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5ae5f-6164-49a8-9900-714107ef6c73 service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:01.395772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1106/2228] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:06:08.046901 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07edf94-61e6-4456-9ab2-93806e47d22a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:08.047357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07edf94-61e6-4456-9ab2-93806e47d22a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:08.047450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07edf94-61e6-4456-9ab2-93806e47d22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:08.078932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d07edf94-61e6-4456-9ab2-93806e47d22a None None] MFA Rules not processed for user `5bfd405168ca47acb5ebc0a3ede60ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:08.080543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d07edf94-61e6-4456-9ab2-93806e47d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:08.166769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1123/2229] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:06:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:06:08.180520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5ae5f-6164-49a8-9900-714107ef6c73 service nova] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:08.241692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5ae5f-6164-49a8-9900-714107ef6c73 service nova] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:08.246311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18397114-ee3b-4197-99fa-4cc4c6eafca0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553916344aaf40ae8abb050540f10559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:08.246930 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397114-ee3b-4197-99fa-4cc4c6eafca0 service glance] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:08.247231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397114-ee3b-4197-99fa-4cc4c6eafca0 service glance] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:08.247511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397114-ee3b-4197-99fa-4cc4c6eafca0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:08.274458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:06:08.306190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18397114-ee3b-4197-99fa-4cc4c6eafca0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:08.308332 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18397114-ee3b-4197-99fa-4cc4c6eafca0 service glance] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:08.317549 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1107/2230] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:06:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:06:08.449649 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c9e90-f4b9-4932-a991-200e81cc4881 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:08.449940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c9e90-f4b9-4932-a991-200e81cc4881 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:08.450218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c9e90-f4b9-4932-a991-200e81cc4881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:08.480317 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-290c9e90-f4b9-4932-a991-200e81cc4881 None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:08.481549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-290c9e90-f4b9-4932-a991-200e81cc4881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:08.553692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1124/2231] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:06:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:06:08.566794 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18397114-ee3b-4197-99fa-4cc4c6eafca0 service glance] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:08.568253 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-18397114-ee3b-4197-99fa-4cc4c6eafca0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:08.639501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18397114-ee3b-4197-99fa-4cc4c6eafca0 service glance] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:08.644803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f854b9-0695-40f2-bd56-477c03f231f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:08.645422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f854b9-0695-40f2-bd56-477c03f231f0 service swift] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:08.645709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f854b9-0695-40f2-bd56-477c03f231f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:08.645983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f854b9-0695-40f2-bd56-477c03f231f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:08.654547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f854b9-0695-40f2-bd56-477c03f231f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:08.656187 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f854b9-0695-40f2-bd56-477c03f231f0 service swift] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:08.664223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1108/2232] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:06:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:06:17.933086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ce72e-212e-4091-9187-a30b15796c55 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:17.933696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ce72e-212e-4091-9187-a30b15796c55 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:17.933696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ce72e-212e-4091-9187-a30b15796c55 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:17.934986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1125/2233] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 08:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:06:17.943009 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0abd44-4f4a-4755-8d97-a031a8939ccc None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:17.943563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0abd44-4f4a-4755-8d97-a031a8939ccc None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:17.944360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0abd44-4f4a-4755-8d97-a031a8939ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:17.972804 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-8f0abd44-4f4a-4755-8d97-a031a8939ccc None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:17.974062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8f0abd44-4f4a-4755-8d97-a031a8939ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:17.985334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1109/2234] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 08:06:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:06:18.001429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ce72e-212e-4091-9187-a30b15796c55 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:18.018952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ce72e-212e-4091-9187-a30b15796c55 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:18.024256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5f590-f903-45c0-b9dc-12a001004b8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553916344aaf40ae8abb050540f10559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:18.025395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5f590-f903-45c0-b9dc-12a001004b8e service glance] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:18.025829 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5f590-f903-45c0-b9dc-12a001004b8e service glance] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:18.026320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5f590-f903-45c0-b9dc-12a001004b8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:18.041042 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5f590-f903-45c0-b9dc-12a001004b8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:18.042633 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5f590-f903-45c0-b9dc-12a001004b8e service glance] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:18.063075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1126/2235] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:06:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:06:18.195235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347afd9-af62-466e-b9c0-262feffd6ca9 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:18.195531 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347afd9-af62-466e-b9c0-262feffd6ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:18.196744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347afd9-af62-466e-b9c0-262feffd6ca9 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:18.198855 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1110/2236] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 08:06:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:06:18.208599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d597ecb-d430-4b06-a7b6-a0f53714a827 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:18.208599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d597ecb-d430-4b06-a7b6-a0f53714a827 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:18.208599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d597ecb-d430-4b06-a7b6-a0f53714a827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:18.235663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0d597ecb-d430-4b06-a7b6-a0f53714a827 None None] MFA Rules not processed for user `bb3537ce04d24347b155855d2e29cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:18.238062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0d597ecb-d430-4b06-a7b6-a0f53714a827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:18.339510 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347afd9-af62-466e-b9c0-262feffd6ca9 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:18.341874 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6347afd9-af62-466e-b9c0-262feffd6ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:18.345741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1127/2237] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 08:06:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:06:18.372452 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347afd9-af62-466e-b9c0-262feffd6ca9 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:18.433883 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a49aa-2b25-4092-9934-08600cdbecfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:18.434937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a49aa-2b25-4092-9934-08600cdbecfa service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:18.434937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a49aa-2b25-4092-9934-08600cdbecfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:18.435238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a49aa-2b25-4092-9934-08600cdbecfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:18.465482 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a49aa-2b25-4092-9934-08600cdbecfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:18.468375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a49aa-2b25-4092-9934-08600cdbecfa service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:18.498264 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1111/2238] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:06:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:06:18.653551 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de41ff-9723-47d8-9660-addf67d4065c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:18.653828 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de41ff-9723-47d8-9660-addf67d4065c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:18.654229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de41ff-9723-47d8-9660-addf67d4065c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:18.655592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1128/2239] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 08:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:06:18.671529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393ba9b-4a6a-4aee-9af9-9a7ab3bc77b0 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:18.671645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393ba9b-4a6a-4aee-9af9-9a7ab3bc77b0 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:18.671967 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393ba9b-4a6a-4aee-9af9-9a7ab3bc77b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:18.699463 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-8393ba9b-4a6a-4aee-9af9-9a7ab3bc77b0 None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:18.701003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8393ba9b-4a6a-4aee-9af9-9a7ab3bc77b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:18.712050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1112/2240] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 08:06:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:06:18.726458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de41ff-9723-47d8-9660-addf67d4065c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:18.734429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:06:18.741288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de41ff-9723-47d8-9660-addf67d4065c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:18.747631 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d12077-1922-48c3-a1c3-6d9cdd10e904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:18.751262 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d12077-1922-48c3-a1c3-6d9cdd10e904 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:18.752048 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d12077-1922-48c3-a1c3-6d9cdd10e904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:18.752495 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d12077-1922-48c3-a1c3-6d9cdd10e904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:18.769035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d12077-1922-48c3-a1c3-6d9cdd10e904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:18.770739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d12077-1922-48c3-a1c3-6d9cdd10e904 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:18.786605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1129/2241] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:06:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:06:19.546537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac97bfb-4d48-44ce-8229-395f325cd480 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:19.547253 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac97bfb-4d48-44ce-8229-395f325cd480 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:19.547402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac97bfb-4d48-44ce-8229-395f325cd480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:19.575673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-eac97bfb-4d48-44ce-8229-395f325cd480 None None] MFA Rules not processed for user `bc7057fda920471f8912ed4dbba2698f`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:19.577299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-eac97bfb-4d48-44ce-8229-395f325cd480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:19.592350 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1113/2242] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:06:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:06:21.249228 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395806d0-55b7-4e46-94fc-ad85354bc9bd None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:21.249792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395806d0-55b7-4e46-94fc-ad85354bc9bd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:21.249792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395806d0-55b7-4e46-94fc-ad85354bc9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:21.275660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-395806d0-55b7-4e46-94fc-ad85354bc9bd None None] MFA Rules not processed for user `f2dc394f3da54e118a4c963f13945b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:21.276969 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-395806d0-55b7-4e46-94fc-ad85354bc9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:21.332370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1130/2243] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:06:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:06:21.740548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac97bfb-4d48-44ce-8229-395f325cd480 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:21.760816 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac97bfb-4d48-44ce-8229-395f325cd480 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:21.766551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:21.768159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:21.768512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:21.768859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] PATH_INFO: `/v3/users/15fae7f515c04cda9797b1c782c3df8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:21.770194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15fae7f515c04cda9797b1c782c3df8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:21.772603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:22.041080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15fae7f515c04cda9797b1c782c3df8d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:22.058850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15fae7f515c04cda9797b1c782c3df8d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:22.060478 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15fae7f515c04cda9797b1c782c3df8d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:22.061314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15fae7f515c04cda9797b1c782c3df8d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:22.082274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15fae7f515c04cda9797b1c782c3df8d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:22.088143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:06:22.098104 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1114/2244] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:06:21 2022] DELETE /identity/v3/users/15fae7f515c04cda9797b1c782c3df8d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:06:22.102935 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4fe14-1499-49fc-9612-ed3f65958876 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:22.103217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4fe14-1499-49fc-9612-ed3f65958876 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:22.103490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4fe14-1499-49fc-9612-ed3f65958876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:22.131601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-afd4fe14-1499-49fc-9612-ed3f65958876 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:22.133007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-afd4fe14-1499-49fc-9612-ed3f65958876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:22.262017 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1131/2245] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:06:22.278483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:22.279939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:22.408080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a081817-c6ac-48c2-bf3b-df308adcef51 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:22.413335 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc6ba0-d62f-4bed-9a77-52cc2f2ac283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:22.414491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6ba0-d62f-4bed-9a77-52cc2f2ac283 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:22.414491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6ba0-d62f-4bed-9a77-52cc2f2ac283 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:22.414491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6ba0-d62f-4bed-9a77-52cc2f2ac283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:22.428170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc6ba0-d62f-4bed-9a77-52cc2f2ac283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:22.429816 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc6ba0-d62f-4bed-9a77-52cc2f2ac283 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:22.443960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1115/2246] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:06:22.862505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4fe14-1499-49fc-9612-ed3f65958876 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:22.864024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-afd4fe14-1499-49fc-9612-ed3f65958876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:22.882775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4fe14-1499-49fc-9612-ed3f65958876 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:22.902570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074f896-b5fd-4a8d-95c7-b434121f42e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:22.903709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074f896-b5fd-4a8d-95c7-b434121f42e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:22.904369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074f896-b5fd-4a8d-95c7-b434121f42e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:22.904832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074f896-b5fd-4a8d-95c7-b434121f42e1 admin admin] PATH_INFO: `/v3/projects/d9ce73a2fb274334be773dd7d0888e22` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:22.907198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074f896-b5fd-4a8d-95c7-b434121f42e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ce73a2fb274334be773dd7d0888e22)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:22.910928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074f896-b5fd-4a8d-95c7-b434121f42e1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:22.972061 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4997c-8041-4803-b63e-6fceb98d4f6e None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:22.972546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4997c-8041-4803-b63e-6fceb98d4f6e None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:22.972774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4997c-8041-4803-b63e-6fceb98d4f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:23.002677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-eac4997c-8041-4803-b63e-6fceb98d4f6e None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:23.004192 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-eac4997c-8041-4803-b63e-6fceb98d4f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:23.038551 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b074f896-b5fd-4a8d-95c7-b434121f42e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ce73a2fb274334be773dd7d0888e22', 'request_id': 'req-b074f896-b5fd-4a8d-95c7-b434121f42e1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:23.050421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b074f896-b5fd-4a8d-95c7-b434121f42e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ce73a2fb274334be773dd7d0888e22', 'request_id': 'req-b074f896-b5fd-4a8d-95c7-b434121f42e1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:23.065161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b074f896-b5fd-4a8d-95c7-b434121f42e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ce73a2fb274334be773dd7d0888e22', 'request_id': 'req-b074f896-b5fd-4a8d-95c7-b434121f42e1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:23.094373 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b074f896-b5fd-4a8d-95c7-b434121f42e1 admin admin] The token cache is being invalidate because project d9ce73a2fb274334be773dd7d0888e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:06:23.094741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b074f896-b5fd-4a8d-95c7-b434121f42e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:23.095471 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b074f896-b5fd-4a8d-95c7-b434121f42e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:23.102230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1132/2247] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:06:22 2022] DELETE /identity/v3/projects/d9ce73a2fb274334be773dd7d0888e22 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:06:23.102230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee59586-a60b-412a-8e04-1aae8210a373 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:23.102230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee59586-a60b-412a-8e04-1aae8210a373 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:23.102230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee59586-a60b-412a-8e04-1aae8210a373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:23.120012 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1116/2248] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:06:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:06:23.121348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda01f-9f0c-40ef-9a54-94039808c917 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:23.121664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda01f-9f0c-40ef-9a54-94039808c917 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:23.121945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda01f-9f0c-40ef-9a54-94039808c917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:23.144713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d1eda01f-9f0c-40ef-9a54-94039808c917 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:23.146101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d1eda01f-9f0c-40ef-9a54-94039808c917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:23.159159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1ee59586-a60b-412a-8e04-1aae8210a373 None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:23.160446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1ee59586-a60b-412a-8e04-1aae8210a373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:23.170963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1133/2249] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:06:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:06:23.172154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee59586-a60b-412a-8e04-1aae8210a373 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:23.174002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1ee59586-a60b-412a-8e04-1aae8210a373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:23.191934 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:06:23.259014 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1117/2250] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:06:23.260354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda01f-9f0c-40ef-9a54-94039808c917 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:23.262422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d1eda01f-9f0c-40ef-9a54-94039808c917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:23.296079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee59586-a60b-412a-8e04-1aae8210a373 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:23.305045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1ab9d-4b46-4dcd-b0b4-d2c8ee159307 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:23.306648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1ab9d-4b46-4dcd-b0b4-d2c8ee159307 service swift] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:23.307251 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1ab9d-4b46-4dcd-b0b4-d2c8ee159307 service swift] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:23.307597 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1ab9d-4b46-4dcd-b0b4-d2c8ee159307 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:23.317455 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1ab9d-4b46-4dcd-b0b4-d2c8ee159307 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:23.319847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1ab9d-4b46-4dcd-b0b4-d2c8ee159307 service swift] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:23.325249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:06:23.333909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1134/2251] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:06:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:06:23.336652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c775c-7bfd-4dc3-9ff2-84aaedfb2b82 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:23.337178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c775c-7bfd-4dc3-9ff2-84aaedfb2b82 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:23.337673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c775c-7bfd-4dc3-9ff2-84aaedfb2b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:23.355356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda01f-9f0c-40ef-9a54-94039808c917 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:23.360969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008bedf-dbaa-45ac-9e0a-b166f2f34437 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:23.361301 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008bedf-dbaa-45ac-9e0a-b166f2f34437 service swift] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:23.361588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008bedf-dbaa-45ac-9e0a-b166f2f34437 service swift] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:23.361864 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008bedf-dbaa-45ac-9e0a-b166f2f34437 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:23.372931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-419c775c-7bfd-4dc3-9ff2-84aaedfb2b82 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:23.373038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008bedf-dbaa-45ac-9e0a-b166f2f34437 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:23.374568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-419c775c-7bfd-4dc3-9ff2-84aaedfb2b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:23.374690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008bedf-dbaa-45ac-9e0a-b166f2f34437 service swift] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:23.385244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1118/2252] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:06:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:06:23.388623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1135/2253] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:06:23.393253 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008bedf-dbaa-45ac-9e0a-b166f2f34437 service swift] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:23.414976 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008bedf-dbaa-45ac-9e0a-b166f2f34437 service swift] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:23.421232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9387-123d-4208-ac9d-721fe7c761c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:23.421999 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9387-123d-4208-ac9d-721fe7c761c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:23.422206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9387-123d-4208-ac9d-721fe7c761c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:23.422450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9387-123d-4208-ac9d-721fe7c761c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:23.423115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9387-123d-4208-ac9d-721fe7c761c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:06:23.423422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9387-123d-4208-ac9d-721fe7c761c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:23.425105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9387-123d-4208-ac9d-721fe7c761c2 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:23.445662 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c775c-7bfd-4dc3-9ff2-84aaedfb2b82 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:23.451944 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1119/2254] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:06:23.455909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c775c-7bfd-4dc3-9ff2-84aaedfb2b82 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:23.469860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ceae4-c45e-426f-b3d1-ce5706b59fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:23.470821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ceae4-c45e-426f-b3d1-ce5706b59fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:23.471357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ceae4-c45e-426f-b3d1-ce5706b59fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:23.471811 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ceae4-c45e-426f-b3d1-ce5706b59fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:23.472726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ceae4-c45e-426f-b3d1-ce5706b59fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:23.475978 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ceae4-c45e-426f-b3d1-ce5706b59fb2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:23.520165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1136/2255] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:06:23 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:06:23.527636 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9387-123d-4208-ac9d-721fe7c761c2 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:23.542307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9387-123d-4208-ac9d-721fe7c761c2 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:23.702212 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea35b9-1643-45e6-9c90-d98b699f4864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:23.703131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea35b9-1643-45e6-9c90-d98b699f4864 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:23.703566 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea35b9-1643-45e6-9c90-d98b699f4864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:23.704008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea35b9-1643-45e6-9c90-d98b699f4864 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:23.708910 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea35b9-1643-45e6-9c90-d98b699f4864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:23.720902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea35b9-1643-45e6-9c90-d98b699f4864 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:23.768922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1120/2256] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:06:23 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:06:23.773435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ceae4-c45e-426f-b3d1-ce5706b59fb2 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:23.800651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ceae4-c45e-426f-b3d1-ce5706b59fb2 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:23.811427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0e331-b7ef-4724-a03c-3e4304e34e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:23.813810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0e331-b7ef-4724-a03c-3e4304e34e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:23.814472 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0e331-b7ef-4724-a03c-3e4304e34e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:23.815128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0e331-b7ef-4724-a03c-3e4304e34e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:23.818807 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0e331-b7ef-4724-a03c-3e4304e34e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:23.823265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0e331-b7ef-4724-a03c-3e4304e34e52 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:23.859537 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1137/2257] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:06:23.864967 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea35b9-1643-45e6-9c90-d98b699f4864 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:23.878795 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea35b9-1643-45e6-9c90-d98b699f4864 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:23.894990 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60129f5b-48e6-4942-ad09-9d058641a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:23.895891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60129f5b-48e6-4942-ad09-9d058641a176 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:23.896260 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60129f5b-48e6-4942-ad09-9d058641a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:23.896776 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60129f5b-48e6-4942-ad09-9d058641a176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:23.897388 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60129f5b-48e6-4942-ad09-9d058641a176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:23.899148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60129f5b-48e6-4942-ad09-9d058641a176 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:23.933459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1121/2258] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:06:23.937255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0e331-b7ef-4724-a03c-3e4304e34e52 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:23.963925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0e331-b7ef-4724-a03c-3e4304e34e52 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:23.980450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3736f2-556e-4833-8871-d48da6f7620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:23.982843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3736f2-556e-4833-8871-d48da6f7620b admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:23.984105 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3736f2-556e-4833-8871-d48da6f7620b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:23.985036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3736f2-556e-4833-8871-d48da6f7620b admin admin] PATH_INFO: `/v3/projects/dd1d892d1cfa4e199b4b706d58610dc8/users/c653cea1d2904ac3b1605c454f8df736/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:24.026204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3736f2-556e-4833-8871-d48da6f7620b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1d892d1cfa4e199b4b706d58610dc8, user_id=c653cea1d2904ac3b1605c454f8df736, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:24.036921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3736f2-556e-4833-8871-d48da6f7620b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:24.073611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1138/2259] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:06:23 2022] PUT /identity/v3/projects/dd1d892d1cfa4e199b4b706d58610dc8/users/c653cea1d2904ac3b1605c454f8df736/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:06:24.091752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c51291-6255-40b3-b437-f7c1caf5ff68 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:24.092535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c51291-6255-40b3-b437-f7c1caf5ff68 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:24.092535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c51291-6255-40b3-b437-f7c1caf5ff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:24.133252 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-19c51291-6255-40b3-b437-f7c1caf5ff68 None None] MFA Rules not processed for user `c653cea1d2904ac3b1605c454f8df736`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:24.137050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-19c51291-6255-40b3-b437-f7c1caf5ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:24.286553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1122/2260] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:06:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:06:24.306203 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3736f2-556e-4833-8871-d48da6f7620b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:24.308078 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ec3736f2-556e-4833-8871-d48da6f7620b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:24.410761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3736f2-556e-4833-8871-d48da6f7620b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:24.415290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbb820-d361-4929-a8dc-92d59a7e81d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:24.416292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbb820-d361-4929-a8dc-92d59a7e81d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:24.416829 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbb820-d361-4929-a8dc-92d59a7e81d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:24.417396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbb820-d361-4929-a8dc-92d59a7e81d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:24.441610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbb820-d361-4929-a8dc-92d59a7e81d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:24.443639 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbb820-d361-4929-a8dc-92d59a7e81d2 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:24.455580 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1139/2261] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:06:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:06:34.281334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:06:34.450331 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=80,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:06:35.464136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c51291-6255-40b3-b437-f7c1caf5ff68 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:35.563175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c51291-6255-40b3-b437-f7c1caf5ff68 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:35.569810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:35.570738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:35.571716 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:35.572170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] PATH_INFO: `/v3/users/c653cea1d2904ac3b1605c454f8df736` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:35.573839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c653cea1d2904ac3b1605c454f8df736)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:35.576895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:35.664189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c653cea1d2904ac3b1605c454f8df736'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:35.679490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c653cea1d2904ac3b1605c454f8df736'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:35.681007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c653cea1d2904ac3b1605c454f8df736'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:35.682032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c653cea1d2904ac3b1605c454f8df736'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:35.700064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c653cea1d2904ac3b1605c454f8df736'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:35.714008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1123/2262] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:06:35 2022] DELETE /identity/v3/users/c653cea1d2904ac3b1605c454f8df736 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:06:35.719758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7341-660f-4815-b667-850a2b365df0 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:35.720342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7341-660f-4815-b667-850a2b365df0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:35.720667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7341-660f-4815-b667-850a2b365df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:35.777014 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d39f7341-660f-4815-b667-850a2b365df0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:35.779238 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d39f7341-660f-4815-b667-850a2b365df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:35.901169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1140/2263] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:06:35.912905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:35.915827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:36.031379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d81866-dc21-4640-907c-49064efa05ae admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:36.040320 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30f936-ee28-4e2e-a63b-942d074ea1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:36.046464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30f936-ee28-4e2e-a63b-942d074ea1ac service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:36.046904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30f936-ee28-4e2e-a63b-942d074ea1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:36.047449 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30f936-ee28-4e2e-a63b-942d074ea1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:36.060716 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30f936-ee28-4e2e-a63b-942d074ea1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:36.062299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30f936-ee28-4e2e-a63b-942d074ea1ac service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:36.074734 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1124/2264] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:06:36.632876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f7341-660f-4815-b667-850a2b365df0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:36.634952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d39f7341-660f-4815-b667-850a2b365df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:36.654272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f7341-660f-4815-b667-850a2b365df0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:36.659775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c3d55-6982-4b09-a9da-7559c861da7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:36.660619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3d55-6982-4b09-a9da-7559c861da7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:36.660988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3d55-6982-4b09-a9da-7559c861da7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:36.661327 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3d55-6982-4b09-a9da-7559c861da7e admin admin] PATH_INFO: `/v3/projects/dd1d892d1cfa4e199b4b706d58610dc8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:36.662996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c3d55-6982-4b09-a9da-7559c861da7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1d892d1cfa4e199b4b706d58610dc8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:36.665398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c3d55-6982-4b09-a9da-7559c861da7e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:36.722683 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba4c3d55-6982-4b09-a9da-7559c861da7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1d892d1cfa4e199b4b706d58610dc8', 'request_id': 'req-ba4c3d55-6982-4b09-a9da-7559c861da7e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:36.729610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba4c3d55-6982-4b09-a9da-7559c861da7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1d892d1cfa4e199b4b706d58610dc8', 'request_id': 'req-ba4c3d55-6982-4b09-a9da-7559c861da7e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:36.738274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba4c3d55-6982-4b09-a9da-7559c861da7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1d892d1cfa4e199b4b706d58610dc8', 'request_id': 'req-ba4c3d55-6982-4b09-a9da-7559c861da7e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:36.764540 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba4c3d55-6982-4b09-a9da-7559c861da7e admin admin] The token cache is being invalidate because project dd1d892d1cfa4e199b4b706d58610dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:06:36.764813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba4c3d55-6982-4b09-a9da-7559c861da7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:36.765704 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba4c3d55-6982-4b09-a9da-7559c861da7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:06:36.767552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1141/2265] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:06:36 2022] DELETE /identity/v3/projects/dd1d892d1cfa4e199b4b706d58610dc8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:06:45.067522 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30f936-ee28-4e2e-a63b-942d074ea1ac service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:45.069091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ef30f936-ee28-4e2e-a63b-942d074ea1ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:45.123296 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:06:45.194532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30f936-ee28-4e2e-a63b-942d074ea1ac service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:45.266781 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c6e13-a671-4c50-8d30-432012b3779e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccab7239a2474aa093e685d5da97f1a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:45.267307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c6e13-a671-4c50-8d30-432012b3779e service placement] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:45.267585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c6e13-a671-4c50-8d30-432012b3779e service placement] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:45.267887 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c6e13-a671-4c50-8d30-432012b3779e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:45.269709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2d0c6e13-a671-4c50-8d30-432012b3779e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:45.281569 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c6e13-a671-4c50-8d30-432012b3779e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:45.283172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c6e13-a671-4c50-8d30-432012b3779e service placement] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:45.294165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1125/2266] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:06:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:06:46.752757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:06:55.290029 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=48 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:06:55.681751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951b7d-d903-4332-9f8b-5890f34c99c4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:55.682341 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951b7d-d903-4332-9f8b-5890f34c99c4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:55.682341 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951b7d-d903-4332-9f8b-5890f34c99c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:55.709118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5b951b7d-d903-4332-9f8b-5890f34c99c4 None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:55.712250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5b951b7d-d903-4332-9f8b-5890f34c99c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:55.771514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1142/2267] 10.222.0.30 () {58 vars in 967 bytes} [Wed Aug 10 08:06:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:06:55.785573 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c6e13-a671-4c50-8d30-432012b3779e service placement] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:06:55.786871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-2d0c6e13-a671-4c50-8d30-432012b3779e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:55.859350 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c6e13-a671-4c50-8d30-432012b3779e service placement] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:06:55.864657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168dc8ee-85b0-4eaf-9b33-6667cdd7e3b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:06:55.865493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dc8ee-85b0-4eaf-9b33-6667cdd7e3b4 service swift] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:55.865773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dc8ee-85b0-4eaf-9b33-6667cdd7e3b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:55.866040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dc8ee-85b0-4eaf-9b33-6667cdd7e3b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:55.874971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168dc8ee-85b0-4eaf-9b33-6667cdd7e3b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:06:55.877138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168dc8ee-85b0-4eaf-9b33-6667cdd7e3b4 service swift] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:06:55.885794 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1126/2268] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:06:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:06:56.377128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf68370-c3cc-47d7-81f7-11bf41f56528 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:06:56.377423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf68370-c3cc-47d7-81f7-11bf41f56528 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:06:56.377686 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf68370-c3cc-47d7-81f7-11bf41f56528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:06:56.397488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fbf68370-c3cc-47d7-81f7-11bf41f56528 None None] MFA Rules not processed for user `a17e6e20d5d84cf29803263ab19fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:06:56.399346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fbf68370-c3cc-47d7-81f7-11bf41f56528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:06:56.461130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1143/2269] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:06:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:05.196042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168dc8ee-85b0-4eaf-9b33-6667cdd7e3b4 service swift] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:05.197625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-168dc8ee-85b0-4eaf-9b33-6667cdd7e3b4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:05.276027 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168dc8ee-85b0-4eaf-9b33-6667cdd7e3b4 service swift] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:05.282171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cf99a-00b3-421c-91b0-6f53adde48b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:05.282826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cf99a-00b3-421c-91b0-6f53adde48b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:05.283136 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cf99a-00b3-421c-91b0-6f53adde48b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:05.283408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cf99a-00b3-421c-91b0-6f53adde48b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:05.286155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-323cf99a-00b3-421c-91b0-6f53adde48b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:05.354285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cf99a-00b3-421c-91b0-6f53adde48b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:05.355710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cf99a-00b3-421c-91b0-6f53adde48b3 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:05.365608 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1127/2270] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:07:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:07:06.453601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=50 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:08.027438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c442b8c-d51d-433f-91a2-5bb9c89d806b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:08.028127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c442b8c-d51d-433f-91a2-5bb9c89d806b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:08.028127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c442b8c-d51d-433f-91a2-5bb9c89d806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:08.049644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6c442b8c-d51d-433f-91a2-5bb9c89d806b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:08.051451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6c442b8c-d51d-433f-91a2-5bb9c89d806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:08.113077 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1144/2271] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 10 08:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:07:08.128541 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cf99a-00b3-421c-91b0-6f53adde48b3 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:08.130914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-323cf99a-00b3-421c-91b0-6f53adde48b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:08.182981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:08.216273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cf99a-00b3-421c-91b0-6f53adde48b3 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:08.222120 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24630-6c48-411d-89e7-c465aee9f491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:08.222812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24630-6c48-411d-89e7-c465aee9f491 service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:08.223178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24630-6c48-411d-89e7-c465aee9f491 service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:08.223526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24630-6c48-411d-89e7-c465aee9f491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:08.240309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24630-6c48-411d-89e7-c465aee9f491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:08.242211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24630-6c48-411d-89e7-c465aee9f491 service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:08.254134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1128/2272] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:07:08.873561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5420a9-329e-4ec7-b52f-a773f248ca9c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:08.873851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5420a9-329e-4ec7-b52f-a773f248ca9c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:08.874469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5420a9-329e-4ec7-b52f-a773f248ca9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:08.903706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7d5420a9-329e-4ec7-b52f-a773f248ca9c None None] MFA Rules not processed for user `27fb790313bb48538af59998e949e2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:08.905497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7d5420a9-329e-4ec7-b52f-a773f248ca9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:08.997277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1145/2273] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:07:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:11.551654 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b9fa4-22c6-42d9-a542-317e219b0752 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:11.552471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b9fa4-22c6-42d9-a542-317e219b0752 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:11.552910 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b9fa4-22c6-42d9-a542-317e219b0752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:11.572903 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-ac9b9fa4-22c6-42d9-a542-317e219b0752 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:11.574235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ac9b9fa4-22c6-42d9-a542-317e219b0752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:11.581997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1129/2274] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 10 08:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:11.596733 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5420a9-329e-4ec7-b52f-a773f248ca9c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:11.610769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5420a9-329e-4ec7-b52f-a773f248ca9c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:11.616852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14d38b-a70a-4a02-a83f-4ed7b2f89219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:11.617564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14d38b-a70a-4a02-a83f-4ed7b2f89219 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:11.617915 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14d38b-a70a-4a02-a83f-4ed7b2f89219 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:11.618278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14d38b-a70a-4a02-a83f-4ed7b2f89219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:11.627088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14d38b-a70a-4a02-a83f-4ed7b2f89219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:11.628812 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14d38b-a70a-4a02-a83f-4ed7b2f89219 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:11.638789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1146/2275] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:07:16.659551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531584f2-bea8-4345-b6d1-60daa5635077 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:16.660145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531584f2-bea8-4345-b6d1-60daa5635077 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:16.660145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531584f2-bea8-4345-b6d1-60daa5635077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:16.683003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-531584f2-bea8-4345-b6d1-60daa5635077 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:16.684239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-531584f2-bea8-4345-b6d1-60daa5635077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:16.692333 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1130/2276] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 10 08:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:16.715962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14d38b-a70a-4a02-a83f-4ed7b2f89219 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:16.717446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6b14d38b-a70a-4a02-a83f-4ed7b2f89219 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:16.732335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14d38b-a70a-4a02-a83f-4ed7b2f89219 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:16.738020 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104644af-4054-4a6d-9af2-7a02a3e79aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:16.738650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104644af-4054-4a6d-9af2-7a02a3e79aef service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:16.738967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104644af-4054-4a6d-9af2-7a02a3e79aef service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:16.739246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104644af-4054-4a6d-9af2-7a02a3e79aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:16.748277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104644af-4054-4a6d-9af2-7a02a3e79aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:16.749900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104644af-4054-4a6d-9af2-7a02a3e79aef service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:16.760257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1147/2277] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:07:20.849190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2350ed3-24c5-4db8-bc98-348c17b8a9c6 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:20.849789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2350ed3-24c5-4db8-bc98-348c17b8a9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:20.849917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2350ed3-24c5-4db8-bc98-348c17b8a9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:20.871312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e2350ed3-24c5-4db8-bc98-348c17b8a9c6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:20.872545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e2350ed3-24c5-4db8-bc98-348c17b8a9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:20.880291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1131/2278] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 10 08:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:20.901440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104644af-4054-4a6d-9af2-7a02a3e79aef service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:20.915243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104644af-4054-4a6d-9af2-7a02a3e79aef service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:20.921110 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9939c2a-3800-4388-b7ba-ce5fa1b2b1c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:20.921718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9939c2a-3800-4388-b7ba-ce5fa1b2b1c8 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:20.922001 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9939c2a-3800-4388-b7ba-ce5fa1b2b1c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:20.922274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9939c2a-3800-4388-b7ba-ce5fa1b2b1c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:20.931696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9939c2a-3800-4388-b7ba-ce5fa1b2b1c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:20.933303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9939c2a-3800-4388-b7ba-ce5fa1b2b1c8 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:20.943119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1148/2279] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:07:25.057898 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e8d6d-ad9a-437b-ac66-99b5396278e9 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:25.057898 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e8d6d-ad9a-437b-ac66-99b5396278e9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:25.058611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e8d6d-ad9a-437b-ac66-99b5396278e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:25.079152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-7b9e8d6d-ad9a-437b-ac66-99b5396278e9 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:25.079896 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7b9e8d6d-ad9a-437b-ac66-99b5396278e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:25.089523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1132/2280] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 10 08:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:25.108380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9939c2a-3800-4388-b7ba-ce5fa1b2b1c8 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:25.119987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9939c2a-3800-4388-b7ba-ce5fa1b2b1c8 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:25.125725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d713252-68b0-43a9-b3de-830d1e934a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:25.126330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d713252-68b0-43a9-b3de-830d1e934a79 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:25.126610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d713252-68b0-43a9-b3de-830d1e934a79 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:25.126883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d713252-68b0-43a9-b3de-830d1e934a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:25.136380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d713252-68b0-43a9-b3de-830d1e934a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:25.137967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d713252-68b0-43a9-b3de-830d1e934a79 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:25.148010 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1149/2281] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:07:35.076819 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=28 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:35.143934 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=76 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:56.432339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521708ad-a8b6-4f44-b0f3-775c38177edc None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:56.432940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521708ad-a8b6-4f44-b0f3-775c38177edc None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:56.432940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521708ad-a8b6-4f44-b0f3-775c38177edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:56.458947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-521708ad-a8b6-4f44-b0f3-775c38177edc None None] MFA Rules not processed for user `b42b1af0e32a41fba8712334c2acfbc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:56.460935 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-521708ad-a8b6-4f44-b0f3-775c38177edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:56.532472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1133/2282] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:07:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:56.730131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d713252-68b0-43a9-b3de-830d1e934a79 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:56.731859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9d713252-68b0-43a9-b3de-830d1e934a79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:56.745345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d713252-68b0-43a9-b3de-830d1e934a79 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:56.751254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88c6ac-0298-440b-833e-bf455e6d4f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:56.751942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88c6ac-0298-440b-833e-bf455e6d4f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:56.752234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88c6ac-0298-440b-833e-bf455e6d4f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:56.752510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88c6ac-0298-440b-833e-bf455e6d4f46 admin admin] PATH_INFO: `/v3/users/f2dc394f3da54e118a4c963f13945b3d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:56.753729 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88c6ac-0298-440b-833e-bf455e6d4f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2dc394f3da54e118a4c963f13945b3d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:56.756392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88c6ac-0298-440b-833e-bf455e6d4f46 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:56.817385 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ad88c6ac-0298-440b-833e-bf455e6d4f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2dc394f3da54e118a4c963f13945b3d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:56.829308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ad88c6ac-0298-440b-833e-bf455e6d4f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2dc394f3da54e118a4c963f13945b3d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:56.845899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ad88c6ac-0298-440b-833e-bf455e6d4f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2dc394f3da54e118a4c963f13945b3d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:56.847079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ad88c6ac-0298-440b-833e-bf455e6d4f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2dc394f3da54e118a4c963f13945b3d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:56.867394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ad88c6ac-0298-440b-833e-bf455e6d4f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2dc394f3da54e118a4c963f13945b3d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:56.879513 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1150/2283] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:07:56 2022] DELETE /identity/v3/users/f2dc394f3da54e118a4c963f13945b3d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:07:57.074494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521708ad-a8b6-4f44-b0f3-775c38177edc None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:57.085907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521708ad-a8b6-4f44-b0f3-775c38177edc None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:57.163138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3426626-d973-4383-b662-8dbc51b8921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:57.163964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3426626-d973-4383-b662-8dbc51b8921e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:57.164253 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3426626-d973-4383-b662-8dbc51b8921e admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:57.164532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3426626-d973-4383-b662-8dbc51b8921e admin admin] PATH_INFO: `/v3/projects/e009692db83a43f8bf82b88482fa54b2` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:57.165733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3426626-d973-4383-b662-8dbc51b8921e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e009692db83a43f8bf82b88482fa54b2)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:57.167678 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3426626-d973-4383-b662-8dbc51b8921e admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:57.230812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a3426626-d973-4383-b662-8dbc51b8921e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e009692db83a43f8bf82b88482fa54b2', 'request_id': 'req-a3426626-d973-4383-b662-8dbc51b8921e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:57.236974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a3426626-d973-4383-b662-8dbc51b8921e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e009692db83a43f8bf82b88482fa54b2', 'request_id': 'req-a3426626-d973-4383-b662-8dbc51b8921e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:57.244541 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a3426626-d973-4383-b662-8dbc51b8921e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e009692db83a43f8bf82b88482fa54b2', 'request_id': 'req-a3426626-d973-4383-b662-8dbc51b8921e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:57.259490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a3426626-d973-4383-b662-8dbc51b8921e admin admin] The token cache is being invalidate because project e009692db83a43f8bf82b88482fa54b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:07:57.259817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a3426626-d973-4383-b662-8dbc51b8921e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:57.260489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a3426626-d973-4383-b662-8dbc51b8921e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:57.262033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1134/2284] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:07:57 2022] DELETE /identity/v3/projects/e009692db83a43f8bf82b88482fa54b2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:07:57.267948 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49d4c0-c808-42b9-a12e-30c3a199f2e4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:57.268606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49d4c0-c808-42b9-a12e-30c3a199f2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:57.269143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49d4c0-c808-42b9-a12e-30c3a199f2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:57.304818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6b49d4c0-c808-42b9-a12e-30c3a199f2e4 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:57.306798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6b49d4c0-c808-42b9-a12e-30c3a199f2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:57.408929 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1151/2285] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:57.422047 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce9a30-a633-4308-af14-adc871ec2075 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:57.422640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce9a30-a633-4308-af14-adc871ec2075 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:57.423000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce9a30-a633-4308-af14-adc871ec2075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:57.465015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-3fce9a30-a633-4308-af14-adc871ec2075 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:57.466822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-3fce9a30-a633-4308-af14-adc871ec2075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:57.488346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1135/2286] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:57.493875 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49d4c0-c808-42b9-a12e-30c3a199f2e4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:57.505625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49d4c0-c808-42b9-a12e-30c3a199f2e4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:57.510800 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bcc50-0155-440a-aabf-aa8acd3e63ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:57.511636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bcc50-0155-440a-aabf-aa8acd3e63ac admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:57.511886 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bcc50-0155-440a-aabf-aa8acd3e63ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:57.512161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bcc50-0155-440a-aabf-aa8acd3e63ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:57.512890 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bcc50-0155-440a-aabf-aa8acd3e63ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:07:57.513191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bcc50-0155-440a-aabf-aa8acd3e63ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:57.514997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bcc50-0155-440a-aabf-aa8acd3e63ac admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:57.528248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1152/2287] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:07:57.533075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce9a30-a633-4308-af14-adc871ec2075 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:57.545769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce9a30-a633-4308-af14-adc871ec2075 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:57.553758 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073edc5-0759-46fc-aec6-8c5ab4fab49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:57.554402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073edc5-0759-46fc-aec6-8c5ab4fab49c admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:57.554687 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073edc5-0759-46fc-aec6-8c5ab4fab49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:57.554969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073edc5-0759-46fc-aec6-8c5ab4fab49c admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:57.556052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073edc5-0759-46fc-aec6-8c5ab4fab49c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:57.557569 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073edc5-0759-46fc-aec6-8c5ab4fab49c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:57.593952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1136/2288] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:07:57 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:07:57.598221 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bcc50-0155-440a-aabf-aa8acd3e63ac admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:57.612411 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bcc50-0155-440a-aabf-aa8acd3e63ac admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:57.697191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc855f50-033d-4709-9727-037f9fb5d513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:57.698048 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc855f50-033d-4709-9727-037f9fb5d513 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:57.698637 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc855f50-033d-4709-9727-037f9fb5d513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:57.699033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc855f50-033d-4709-9727-037f9fb5d513 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:57.699963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc855f50-033d-4709-9727-037f9fb5d513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:57.716237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc855f50-033d-4709-9727-037f9fb5d513 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:57.723015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:57.741045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1153/2289] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:07:57 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:07:57.746408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073edc5-0759-46fc-aec6-8c5ab4fab49c admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:57.765001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073edc5-0759-46fc-aec6-8c5ab4fab49c admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:57.770331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab231b2-cca1-4a85-a913-fb58323d74ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:57.771512 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab231b2-cca1-4a85-a913-fb58323d74ad admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:57.771839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab231b2-cca1-4a85-a913-fb58323d74ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:57.772114 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab231b2-cca1-4a85-a913-fb58323d74ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:57.773649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab231b2-cca1-4a85-a913-fb58323d74ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:57.774681 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab231b2-cca1-4a85-a913-fb58323d74ad admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:57.776255 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:57.795963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1137/2290] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:07:57.797625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc855f50-033d-4709-9727-037f9fb5d513 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:57.808856 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc855f50-033d-4709-9727-037f9fb5d513 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:57.813866 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fc889-5e5d-41fd-ad84-1f91d4b95bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:57.814571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fc889-5e5d-41fd-ad84-1f91d4b95bec admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:57.814810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fc889-5e5d-41fd-ad84-1f91d4b95bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:57.815287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fc889-5e5d-41fd-ad84-1f91d4b95bec admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:57.816187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fc889-5e5d-41fd-ad84-1f91d4b95bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:57.818033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fc889-5e5d-41fd-ad84-1f91d4b95bec admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:57.834987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1154/2291] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:07:57.840886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab231b2-cca1-4a85-a913-fb58323d74ad admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:57.855268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab231b2-cca1-4a85-a913-fb58323d74ad admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:57.860108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef685e61-4ba6-4e46-8f54-410a58f27828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:57.860790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef685e61-4ba6-4e46-8f54-410a58f27828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:57.861068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef685e61-4ba6-4e46-8f54-410a58f27828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:57.861347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef685e61-4ba6-4e46-8f54-410a58f27828 admin admin] PATH_INFO: `/v3/projects/11c7dd211726496ab1def1f9d18103ad/users/0197f75312724968b26e64774d0717d0/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:57.878096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef685e61-4ba6-4e46-8f54-410a58f27828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c7dd211726496ab1def1f9d18103ad, user_id=0197f75312724968b26e64774d0717d0, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:57.881043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef685e61-4ba6-4e46-8f54-410a58f27828 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:57.897739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1138/2292] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:07:57 2022] PUT /identity/v3/projects/11c7dd211726496ab1def1f9d18103ad/users/0197f75312724968b26e64774d0717d0/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:07:57.902792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2dbab-eb7e-463b-8f2a-b63538648257 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:57.903228 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2dbab-eb7e-463b-8f2a-b63538648257 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:57.903488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2dbab-eb7e-463b-8f2a-b63538648257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:57.924340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-32d2dbab-eb7e-463b-8f2a-b63538648257 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:57.926099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-32d2dbab-eb7e-463b-8f2a-b63538648257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:58.002974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1155/2293] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:58.013388 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef685e61-4ba6-4e46-8f54-410a58f27828 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:58.021762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ef685e61-4ba6-4e46-8f54-410a58f27828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:58.100327 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef685e61-4ba6-4e46-8f54-410a58f27828 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:58.104520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c5f96-2efd-4238-8881-1f54506fe242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:58.105163 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c5f96-2efd-4238-8881-1f54506fe242 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:58.105448 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c5f96-2efd-4238-8881-1f54506fe242 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:58.105719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c5f96-2efd-4238-8881-1f54506fe242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:58.117082 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c5f96-2efd-4238-8881-1f54506fe242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:58.118590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c5f96-2efd-4238-8881-1f54506fe242 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:58.129552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1139/2294] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:08:03.453482 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801a534-b789-47c7-ac76-7d9f3d210711 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:03.454029 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801a534-b789-47c7-ac76-7d9f3d210711 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:03.454166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801a534-b789-47c7-ac76-7d9f3d210711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:03.500387 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1801a534-b789-47c7-ac76-7d9f3d210711 None None] MFA Rules not processed for user `0197f75312724968b26e64774d0717d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:03.501630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1801a534-b789-47c7-ac76-7d9f3d210711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:03.600767 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1156/2295] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:08:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:08:03.604945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c5f96-2efd-4238-8881-1f54506fe242 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:03.620089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c5f96-2efd-4238-8881-1f54506fe242 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:03.633105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57bf4e-7eb1-4013-9a30-fefa4b9f4aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:03.633355 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57bf4e-7eb1-4013-9a30-fefa4b9f4aed admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:03.633862 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57bf4e-7eb1-4013-9a30-fefa4b9f4aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:03.634396 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57bf4e-7eb1-4013-9a30-fefa4b9f4aed admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:03.635055 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57bf4e-7eb1-4013-9a30-fefa4b9f4aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:03.637019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57bf4e-7eb1-4013-9a30-fefa4b9f4aed admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:03.683460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1140/2296] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:08:03 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:08:03.686322 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801a534-b789-47c7-ac76-7d9f3d210711 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:03.711340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801a534-b789-47c7-ac76-7d9f3d210711 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:03.790360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8fe02-6dcc-42cb-b6dd-d6234a8f51d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:03.791002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8fe02-6dcc-42cb-b6dd-d6234a8f51d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:03.791322 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8fe02-6dcc-42cb-b6dd-d6234a8f51d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:03.791611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8fe02-6dcc-42cb-b6dd-d6234a8f51d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:03.792299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8fe02-6dcc-42cb-b6dd-d6234a8f51d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:03.794506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8fe02-6dcc-42cb-b6dd-d6234a8f51d8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:03.814923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:08:03.824153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1157/2297] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:08:03 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:08:03.828548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57bf4e-7eb1-4013-9a30-fefa4b9f4aed admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:03.841351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57bf4e-7eb1-4013-9a30-fefa4b9f4aed admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:03.847478 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b99df-a5de-4c64-9ca6-a25cb39e2ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:03.847763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b99df-a5de-4c64-9ca6-a25cb39e2ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:03.848055 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b99df-a5de-4c64-9ca6-a25cb39e2ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:03.848331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b99df-a5de-4c64-9ca6-a25cb39e2ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:03.849302 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b99df-a5de-4c64-9ca6-a25cb39e2ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:03.851169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b99df-a5de-4c64-9ca6-a25cb39e2ffb admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:03.865951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1141/2298] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:08:03.870784 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8fe02-6dcc-42cb-b6dd-d6234a8f51d8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:03.884680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8fe02-6dcc-42cb-b6dd-d6234a8f51d8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:03.893998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6542b-4084-4601-af4b-7f3f5994e165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:03.893998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6542b-4084-4601-af4b-7f3f5994e165 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:03.893998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6542b-4084-4601-af4b-7f3f5994e165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:03.893998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6542b-4084-4601-af4b-7f3f5994e165 admin admin] PATH_INFO: `/v3/projects/baa524d2afb844058ca1d2175f78bb90/users/fef07329305a4b408e91cd219806a347/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:03.922991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6542b-4084-4601-af4b-7f3f5994e165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa524d2afb844058ca1d2175f78bb90, user_id=fef07329305a4b408e91cd219806a347, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:03.926009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6542b-4084-4601-af4b-7f3f5994e165 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:03.954454 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1158/2299] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:08:03 2022] PUT /identity/v3/projects/baa524d2afb844058ca1d2175f78bb90/users/fef07329305a4b408e91cd219806a347/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:08:03.959094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b99df-a5de-4c64-9ca6-a25cb39e2ffb admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:03.971116 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b99df-a5de-4c64-9ca6-a25cb39e2ffb admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:04.059848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7561b-1183-4d90-89cd-11955caeaec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:04.060483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7561b-1183-4d90-89cd-11955caeaec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:04.060955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7561b-1183-4d90-89cd-11955caeaec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:04.061234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7561b-1183-4d90-89cd-11955caeaec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:04.061901 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7561b-1183-4d90-89cd-11955caeaec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:04.063766 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7561b-1183-4d90-89cd-11955caeaec8 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:04.075505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1142/2300] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:08:04.080579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6542b-4084-4601-af4b-7f3f5994e165 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:04.095142 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6542b-4084-4601-af4b-7f3f5994e165 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:04.100755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa847708-d591-4a7c-8671-bf0215d88966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:04.101467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa847708-d591-4a7c-8671-bf0215d88966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:04.101850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa847708-d591-4a7c-8671-bf0215d88966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:04.102221 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa847708-d591-4a7c-8671-bf0215d88966 admin admin] PATH_INFO: `/v3/projects/baa524d2afb844058ca1d2175f78bb90/users/fef07329305a4b408e91cd219806a347/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:04.108307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa847708-d591-4a7c-8671-bf0215d88966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa524d2afb844058ca1d2175f78bb90, user_id=fef07329305a4b408e91cd219806a347, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:04.111083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa847708-d591-4a7c-8671-bf0215d88966 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:04.133052 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1159/2301] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:08:04 2022] PUT /identity/v3/projects/baa524d2afb844058ca1d2175f78bb90/users/fef07329305a4b408e91cd219806a347/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:08:11.684795 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32934db6-78ba-462e-afe4-74a2ec3ee117 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:11.685587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32934db6-78ba-462e-afe4-74a2ec3ee117 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:11.686053 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32934db6-78ba-462e-afe4-74a2ec3ee117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:11.748312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-32934db6-78ba-462e-afe4-74a2ec3ee117 None None] MFA Rules not processed for user `fef07329305a4b408e91cd219806a347`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:11.750498 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-32934db6-78ba-462e-afe4-74a2ec3ee117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:11.794933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:08:11.862798 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1143/2302] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:08:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:08:11.879395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa847708-d591-4a7c-8671-bf0215d88966 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:11.881205 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-aa847708-d591-4a7c-8671-bf0215d88966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:12.000396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa847708-d591-4a7c-8671-bf0215d88966 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:12.006755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28350a2f-9061-476f-9533-48d3c17e1276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:12.007566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28350a2f-9061-476f-9533-48d3c17e1276 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:12.008052 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28350a2f-9061-476f-9533-48d3c17e1276 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:12.008428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28350a2f-9061-476f-9533-48d3c17e1276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:12.092671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28350a2f-9061-476f-9533-48d3c17e1276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:12.096446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28350a2f-9061-476f-9533-48d3c17e1276 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:12.117050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1160/2303] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:08:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:08:13.418989 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fd0f7-5c52-4a8f-ab11-837119ea7cbd None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:13.419484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fd0f7-5c52-4a8f-ab11-837119ea7cbd None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:13.419598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fd0f7-5c52-4a8f-ab11-837119ea7cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:13.449916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-093fd0f7-5c52-4a8f-ab11-837119ea7cbd None None] MFA Rules not processed for user `0197f75312724968b26e64774d0717d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:13.451188 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-093fd0f7-5c52-4a8f-ab11-837119ea7cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:13.459883 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1144/2304] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:08:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:08:19.215396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132008d-79ff-45c2-82b2-cfca85350f54 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:19.216116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132008d-79ff-45c2-82b2-cfca85350f54 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:19.216116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132008d-79ff-45c2-82b2-cfca85350f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:19.236594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5132008d-79ff-45c2-82b2-cfca85350f54 None None] MFA Rules not processed for user `ee4d6facfb4249fd9ff38b7a59837d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:19.237821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5132008d-79ff-45c2-82b2-cfca85350f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:19.304849 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1161/2305] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:08:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:08:23.453036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=20 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:08:29.297103 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:08:29.851966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fd0f7-5c52-4a8f-ab11-837119ea7cbd None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:29.854956 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-093fd0f7-5c52-4a8f-ab11-837119ea7cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:29.981744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fd0f7-5c52-4a8f-ab11-837119ea7cbd None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:29.990458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb74a6-3961-4e65-8f5e-5c4fe6a37834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:29.991485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb74a6-3961-4e65-8f5e-5c4fe6a37834 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:29.992504 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb74a6-3961-4e65-8f5e-5c4fe6a37834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:29.993245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb74a6-3961-4e65-8f5e-5c4fe6a37834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:29.998015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0dbb74a6-3961-4e65-8f5e-5c4fe6a37834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:30.051300 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb74a6-3961-4e65-8f5e-5c4fe6a37834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:30.054149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb74a6-3961-4e65-8f5e-5c4fe6a37834 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:30.086338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1145/2306] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:08:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:08:30.481759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53976e-2320-44ed-b138-8b9e83b13897 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:30.482252 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53976e-2320-44ed-b138-8b9e83b13897 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:30.482389 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53976e-2320-44ed-b138-8b9e83b13897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:30.505821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8e53976e-2320-44ed-b138-8b9e83b13897 None None] MFA Rules not processed for user `27fb790313bb48538af59998e949e2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:30.507156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8e53976e-2320-44ed-b138-8b9e83b13897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:30.566431 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1162/2307] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:08:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:08:32.427537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb74a6-3961-4e65-8f5e-5c4fe6a37834 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:32.437037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb74a6-3961-4e65-8f5e-5c4fe6a37834 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:32.440937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c61f1-de38-494e-be82-2b6c10d6dcdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:32.441580 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c61f1-de38-494e-be82-2b6c10d6dcdf service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:32.441857 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c61f1-de38-494e-be82-2b6c10d6dcdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:32.442135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c61f1-de38-494e-be82-2b6c10d6dcdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:32.444017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-054c61f1-de38-494e-be82-2b6c10d6dcdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:32.462657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c61f1-de38-494e-be82-2b6c10d6dcdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:32.464235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c61f1-de38-494e-be82-2b6c10d6dcdf service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:32.476957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1146/2308] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:08:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:08:32.784261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885b18b-4311-43a0-a2ba-a0814a0be814 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:32.784835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885b18b-4311-43a0-a2ba-a0814a0be814 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:32.785171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885b18b-4311-43a0-a2ba-a0814a0be814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:32.806652 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4885b18b-4311-43a0-a2ba-a0814a0be814 None None] MFA Rules not processed for user `a17e6e20d5d84cf29803263ab19fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:32.808011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4885b18b-4311-43a0-a2ba-a0814a0be814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:32.880919 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1163/2309] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:08:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:08:42.471650 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=32 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:08:42.872478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=50 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:08:46.367655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c61f1-de38-494e-be82-2b6c10d6dcdf service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:46.377348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c61f1-de38-494e-be82-2b6c10d6dcdf service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:46.381837 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcf0ef-9aa0-4055-a08c-8446f4853fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:46.382443 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcf0ef-9aa0-4055-a08c-8446f4853fec service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:46.382727 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcf0ef-9aa0-4055-a08c-8446f4853fec service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:46.383030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcf0ef-9aa0-4055-a08c-8446f4853fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:46.392698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcf0ef-9aa0-4055-a08c-8446f4853fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:46.394705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcf0ef-9aa0-4055-a08c-8446f4853fec service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:46.405502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1147/2310] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:08:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:08:53.042221 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885b18b-4311-43a0-a2ba-a0814a0be814 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:53.056258 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885b18b-4311-43a0-a2ba-a0814a0be814 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:53.061900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf322d-aa56-448b-85a3-bbad251442a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:53.062548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf322d-aa56-448b-85a3-bbad251442a0 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:53.062833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf322d-aa56-448b-85a3-bbad251442a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:53.063108 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf322d-aa56-448b-85a3-bbad251442a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:53.064919 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-44cf322d-aa56-448b-85a3-bbad251442a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:53.142772 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf322d-aa56-448b-85a3-bbad251442a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:53.144997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf322d-aa56-448b-85a3-bbad251442a0 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:53.154592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1164/2311] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:08:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:08:56.400333 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=6 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:09:03.150240 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=28 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:09:09.537760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcf0ef-9aa0-4055-a08c-8446f4853fec service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:09.551788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcf0ef-9aa0-4055-a08c-8446f4853fec service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:09.558976 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53e3ca-9892-4418-823f-eebebc0867db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:09.559988 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53e3ca-9892-4418-823f-eebebc0867db service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:09.560542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53e3ca-9892-4418-823f-eebebc0867db service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:09.561194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53e3ca-9892-4418-823f-eebebc0867db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:09.566849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-bc53e3ca-9892-4418-823f-eebebc0867db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:09.582598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53e3ca-9892-4418-823f-eebebc0867db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:09.585120 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53e3ca-9892-4418-823f-eebebc0867db service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:09.602453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1148/2312] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:09.699428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf322d-aa56-448b-85a3-bbad251442a0 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:09.712697 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf322d-aa56-448b-85a3-bbad251442a0 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:09.717728 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dca6e-5665-48fd-8c7c-80f9598caa35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:09.717994 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dca6e-5665-48fd-8c7c-80f9598caa35 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:09.718334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dca6e-5665-48fd-8c7c-80f9598caa35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:09.719296 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dca6e-5665-48fd-8c7c-80f9598caa35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:09.722077 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-878dca6e-5665-48fd-8c7c-80f9598caa35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:09.733012 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dca6e-5665-48fd-8c7c-80f9598caa35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:09.734625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dca6e-5665-48fd-8c7c-80f9598caa35 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:09.744301 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1165/2313] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:16.438642 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53e3ca-9892-4418-823f-eebebc0867db service nova] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:16.455489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53e3ca-9892-4418-823f-eebebc0867db service nova] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:16.462434 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511aca8-303c-4f02-b6a1-af4673f37998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:16.463079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511aca8-303c-4f02-b6a1-af4673f37998 service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:16.463495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511aca8-303c-4f02-b6a1-af4673f37998 service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:16.463765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511aca8-303c-4f02-b6a1-af4673f37998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:16.465699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7511aca8-303c-4f02-b6a1-af4673f37998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:16.483983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511aca8-303c-4f02-b6a1-af4673f37998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:16.485588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511aca8-303c-4f02-b6a1-af4673f37998 service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:16.498635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1149/2314] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:16.552637 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de7711-c2b0-4061-b844-87346a696509 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:16.553223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de7711-c2b0-4061-b844-87346a696509 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:16.553223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de7711-c2b0-4061-b844-87346a696509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:16.576584 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-11de7711-c2b0-4061-b844-87346a696509 None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:09:16.577925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-11de7711-c2b0-4061-b844-87346a696509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:16.641504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1166/2315] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:09:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:09:16.697950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511aca8-303c-4f02-b6a1-af4673f37998 service nova] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:16.699605 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7511aca8-303c-4f02-b6a1-af4673f37998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:16.782547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511aca8-303c-4f02-b6a1-af4673f37998 service nova] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:16.788201 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d464998-73ef-4311-9eb5-d639bb009632 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:16.788905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d464998-73ef-4311-9eb5-d639bb009632 service swift] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:16.789264 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d464998-73ef-4311-9eb5-d639bb009632 service swift] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:16.789670 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d464998-73ef-4311-9eb5-d639bb009632 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:16.799528 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d464998-73ef-4311-9eb5-d639bb009632 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:16.801249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d464998-73ef-4311-9eb5-d639bb009632 service swift] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:16.811005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1150/2316] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:09:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:09:17.246307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a0b68-fb51-4b64-9823-f2357c64d1f1 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:17.246696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a0b68-fb51-4b64-9823-f2357c64d1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:17.246978 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a0b68-fb51-4b64-9823-f2357c64d1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:17.270913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-050a0b68-fb51-4b64-9823-f2357c64d1f1 None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:09:17.273715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-050a0b68-fb51-4b64-9823-f2357c64d1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:17.285387 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1167/2317] 10.222.0.30 () {58 vars in 967 bytes} [Wed Aug 10 08:09:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:09:17.310466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d464998-73ef-4311-9eb5-d639bb009632 service swift] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:17.324042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d464998-73ef-4311-9eb5-d639bb009632 service swift] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:17.331270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8b01-f486-424d-a670-c48991db03c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:17.331936 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8b01-f486-424d-a670-c48991db03c4 service swift] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:17.332222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8b01-f486-424d-a670-c48991db03c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:17.332496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8b01-f486-424d-a670-c48991db03c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:17.344036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8b01-f486-424d-a670-c48991db03c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:17.346017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8b01-f486-424d-a670-c48991db03c4 service swift] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:17.356272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1151/2318] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:09:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:09:19.333446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a0b68-fb51-4b64-9823-f2357c64d1f1 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:19.356382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a0b68-fb51-4b64-9823-f2357c64d1f1 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:19.381034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4e578-f2f9-4011-a461-83dc3945ee8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:19.381946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4e578-f2f9-4011-a461-83dc3945ee8a service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:19.382461 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4e578-f2f9-4011-a461-83dc3945ee8a service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:19.382936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4e578-f2f9-4011-a461-83dc3945ee8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:19.386742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a0d4e578-f2f9-4011-a461-83dc3945ee8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:19.408698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4e578-f2f9-4011-a461-83dc3945ee8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:19.410843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4e578-f2f9-4011-a461-83dc3945ee8a service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:19.430352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1168/2319] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:27.353381 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=50 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:09:27.921519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8b01-f486-424d-a670-c48991db03c4 service swift] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:27.924343 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-04be8b01-f486-424d-a670-c48991db03c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:28.025093 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8b01-f486-424d-a670-c48991db03c4 service swift] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:28.040052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:28.041194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:28.041806 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:28.042244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] PATH_INFO: `/v3/users/bc7057fda920471f8912ed4dbba2698f` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:28.043456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7057fda920471f8912ed4dbba2698f)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:28.045683 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:28.117904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7057fda920471f8912ed4dbba2698f'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:28.136251 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7057fda920471f8912ed4dbba2698f'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:28.139256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7057fda920471f8912ed4dbba2698f'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:28.140351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7057fda920471f8912ed4dbba2698f'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:28.159594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7057fda920471f8912ed4dbba2698f'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:28.182270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1152/2320] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:09:27 2022] DELETE /identity/v3/users/bc7057fda920471f8912ed4dbba2698f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:09:28.488762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4e578-f2f9-4011-a461-83dc3945ee8a service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:28.533518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4e578-f2f9-4011-a461-83dc3945ee8a service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:28.653736 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:28.654459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:28.655344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:28.655773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] PATH_INFO: `/v3/projects/0e7c9c2c17964a7e8657074110c052b6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:28.657404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7c9c2c17964a7e8657074110c052b6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:28.659834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:28.737553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7c9c2c17964a7e8657074110c052b6', 'request_id': 'req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:28.750248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7c9c2c17964a7e8657074110c052b6', 'request_id': 'req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:28.760226 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7c9c2c17964a7e8657074110c052b6', 'request_id': 'req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:28.780932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] The token cache is being invalidate because project 0e7c9c2c17964a7e8657074110c052b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:09:28.781348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:28.783030 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:28.785505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1169/2321] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:09:28 2022] DELETE /identity/v3/projects/0e7c9c2c17964a7e8657074110c052b6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:09:28.789404 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:28.791248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:28.814712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff54fe-a605-4f6e-ac4e-fc0441e57317 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:28.911330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:28.912219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:28.912654 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:28.912984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] PATH_INFO: `/v3/users/5bfd405168ca47acb5ebc0a3ede60ec8` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:28.914223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bfd405168ca47acb5ebc0a3ede60ec8)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:28.916436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:28.949756 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:09:29.011202 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bfd405168ca47acb5ebc0a3ede60ec8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:29.021316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bfd405168ca47acb5ebc0a3ede60ec8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:29.022077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bfd405168ca47acb5ebc0a3ede60ec8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:29.022997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bfd405168ca47acb5ebc0a3ede60ec8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:29.038081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bfd405168ca47acb5ebc0a3ede60ec8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:29.054100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1153/2322] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:09:28 2022] DELETE /identity/v3/users/5bfd405168ca47acb5ebc0a3ede60ec8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:09:29.316440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:29.318475 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:29.335978 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:09:29.343250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39d9ff-1a9f-474e-9485-76b0597c7ddd admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:29.401183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:29.401741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:29.402020 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:29.402289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] PATH_INFO: `/v3/projects/fb9459719d784573bcd806fd5143e2e2` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:29.403402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb9459719d784573bcd806fd5143e2e2)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:29.405329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:29.451950 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb9459719d784573bcd806fd5143e2e2', 'request_id': 'req-0b80235a-4e4c-415e-9dcb-ebec966f44e6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:29.458033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb9459719d784573bcd806fd5143e2e2', 'request_id': 'req-0b80235a-4e4c-415e-9dcb-ebec966f44e6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:29.464200 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb9459719d784573bcd806fd5143e2e2', 'request_id': 'req-0b80235a-4e4c-415e-9dcb-ebec966f44e6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:29.479430 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] The token cache is being invalidate because project fb9459719d784573bcd806fd5143e2e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:09:29.479717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:29.480379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:29.481896 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1170/2323] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:09:29 2022] DELETE /identity/v3/projects/fb9459719d784573bcd806fd5143e2e2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:09:33.130649 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:33.132479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:33.216082 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6728715-d1e0-4453-a84d-9f0014cb2c92 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:33.280342 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0932e18-d9a9-41d8-be94-a0db127a7e72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:33.280865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932e18-d9a9-41d8-be94-a0db127a7e72 service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:33.281154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932e18-d9a9-41d8-be94-a0db127a7e72 service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:33.281432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932e18-d9a9-41d8-be94-a0db127a7e72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:33.283873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e0932e18-d9a9-41d8-be94-a0db127a7e72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:33.296191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0932e18-d9a9-41d8-be94-a0db127a7e72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:33.297880 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0932e18-d9a9-41d8-be94-a0db127a7e72 service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:33.310293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1154/2324] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:36.505211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:36.507456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:36.526204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80235a-4e4c-415e-9dcb-ebec966f44e6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:36.539555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0223088-61c0-4bae-9114-06bab22f2159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:36.540284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0223088-61c0-4bae-9114-06bab22f2159 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:36.540585 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0223088-61c0-4bae-9114-06bab22f2159 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:36.541014 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0223088-61c0-4bae-9114-06bab22f2159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:36.542786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b0223088-61c0-4bae-9114-06bab22f2159 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:36.612296 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0223088-61c0-4bae-9114-06bab22f2159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:36.613834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0223088-61c0-4bae-9114-06bab22f2159 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:36.623967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1171/2325] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:38.055523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0932e18-d9a9-41d8-be94-a0db127a7e72 service nova] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:38.057134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e0932e18-d9a9-41d8-be94-a0db127a7e72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:38.106181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:09:38.137134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0932e18-d9a9-41d8-be94-a0db127a7e72 service nova] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:38.141397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142e8bb-46b8-4862-93a3-a25e0e143a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:38.142547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142e8bb-46b8-4862-93a3-a25e0e143a1f service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:38.143169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142e8bb-46b8-4862-93a3-a25e0e143a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:38.143441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142e8bb-46b8-4862-93a3-a25e0e143a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:38.145495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f142e8bb-46b8-4862-93a3-a25e0e143a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:38.155937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142e8bb-46b8-4862-93a3-a25e0e143a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:38.158225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142e8bb-46b8-4862-93a3-a25e0e143a1f service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:38.168357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1155/2326] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:38.311175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112a6ce-3762-479f-afd9-2c7bbf8e4eda None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:38.312039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112a6ce-3762-479f-afd9-2c7bbf8e4eda None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:38.312202 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112a6ce-3762-479f-afd9-2c7bbf8e4eda None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:38.314891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1172/2327] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 08:09:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:09:38.326548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac96973-5764-4a15-9fc0-0b4a3e317baf None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:38.327767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac96973-5764-4a15-9fc0-0b4a3e317baf None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:38.328117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac96973-5764-4a15-9fc0-0b4a3e317baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:38.354099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-dac96973-5764-4a15-9fc0-0b4a3e317baf None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:09:38.355598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-dac96973-5764-4a15-9fc0-0b4a3e317baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:38.365897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1156/2328] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 08:09:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:09:38.379362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112a6ce-3762-479f-afd9-2c7bbf8e4eda None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:38.381236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a112a6ce-3762-479f-afd9-2c7bbf8e4eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:38.421086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:09:38.460502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112a6ce-3762-479f-afd9-2c7bbf8e4eda None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:38.464212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451cbe4-a740-4c90-8df1-8bc3063ed463 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553916344aaf40ae8abb050540f10559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:38.464833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451cbe4-a740-4c90-8df1-8bc3063ed463 service glance] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:38.465113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451cbe4-a740-4c90-8df1-8bc3063ed463 service glance] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:38.465384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451cbe4-a740-4c90-8df1-8bc3063ed463 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:38.477083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451cbe4-a740-4c90-8df1-8bc3063ed463 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:38.478522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451cbe4-a740-4c90-8df1-8bc3063ed463 service glance] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:38.489985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1173/2329] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:38.567646 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5072ac-e95c-4b34-a127-b2e20ffcb0e6 None None] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:38.568129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5072ac-e95c-4b34-a127-b2e20ffcb0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:38.568420 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5072ac-e95c-4b34-a127-b2e20ffcb0e6 None None] PATH_INFO: `/` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:38.570108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1157/2330] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 08:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:09:38.575327 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37b244-6475-4c66-b8b0-ca93126de845 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:38.575617 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37b244-6475-4c66-b8b0-ca93126de845 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:38.575921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37b244-6475-4c66-b8b0-ca93126de845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:38.596106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3b37b244-6475-4c66-b8b0-ca93126de845 None None] MFA Rules not processed for user `bb3537ce04d24347b155855d2e29cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:09:38.597252 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3b37b244-6475-4c66-b8b0-ca93126de845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:38.603949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1174/2331] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 08:09:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:09:38.615553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5072ac-e95c-4b34-a127-b2e20ffcb0e6 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:38.626862 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5072ac-e95c-4b34-a127-b2e20ffcb0e6 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:38.630464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09fe91-b41d-4123-a961-206282124418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:38.631057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09fe91-b41d-4123-a961-206282124418 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:38.631336 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09fe91-b41d-4123-a961-206282124418 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:38.631604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09fe91-b41d-4123-a961-206282124418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:38.639242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09fe91-b41d-4123-a961-206282124418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:38.640704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09fe91-b41d-4123-a961-206282124418 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:38.649242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1158/2332] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:38.732213 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b3cba-a884-4522-a382-6b1fdbb576aa None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:38.732630 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b3cba-a884-4522-a382-6b1fdbb576aa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:38.732915 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b3cba-a884-4522-a382-6b1fdbb576aa None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:38.734308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1175/2333] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 10 08:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:09:38.739940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66191b-af1a-4b1b-88d8-f3eda238f9e8 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:38.740230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66191b-af1a-4b1b-88d8-f3eda238f9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:38.740509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66191b-af1a-4b1b-88d8-f3eda238f9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:38.762268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-8e66191b-af1a-4b1b-88d8-f3eda238f9e8 None None] MFA Rules not processed for user `6c8e7a0b9eb14983ac117690e2705eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:09:38.763551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8e66191b-af1a-4b1b-88d8-f3eda238f9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:38.777170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1159/2334] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 10 08:09:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:09:38.789486 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b3cba-a884-4522-a382-6b1fdbb576aa None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:38.791653 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f01b3cba-a884-4522-a382-6b1fdbb576aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:38.808962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b3cba-a884-4522-a382-6b1fdbb576aa None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:38.812887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e57fe-5698-4f1f-878f-376d216302d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:38.814785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e57fe-5698-4f1f-878f-376d216302d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:38.815260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e57fe-5698-4f1f-878f-376d216302d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:38.815532 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e57fe-5698-4f1f-878f-376d216302d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:38.826859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e57fe-5698-4f1f-878f-376d216302d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:38.828376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e57fe-5698-4f1f-878f-376d216302d8 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:38.841475 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1176/2335] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:09:38.909053 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66191b-af1a-4b1b-88d8-f3eda238f9e8 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:38.910600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8e66191b-af1a-4b1b-88d8-f3eda238f9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:38.990305 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66191b-af1a-4b1b-88d8-f3eda238f9e8 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:38.999559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb0ad9-186f-4226-9196-10e333884ab6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccab7239a2474aa093e685d5da97f1a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:39.000913 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb0ad9-186f-4226-9196-10e333884ab6 service placement] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:39.002640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb0ad9-186f-4226-9196-10e333884ab6 service placement] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:39.003379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb0ad9-186f-4226-9196-10e333884ab6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:39.008087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1dcb0ad9-186f-4226-9196-10e333884ab6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:39.046896 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb0ad9-186f-4226-9196-10e333884ab6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:39.051217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb0ad9-186f-4226-9196-10e333884ab6 service placement] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:39.074114 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1160/2336] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:09:44.053377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237c376-eb68-428f-87b0-e3f367fc4b4b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:44.054235 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237c376-eb68-428f-87b0-e3f367fc4b4b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:44.056115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237c376-eb68-428f-87b0-e3f367fc4b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:44.107019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3237c376-eb68-428f-87b0-e3f367fc4b4b None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:09:44.108681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3237c376-eb68-428f-87b0-e3f367fc4b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:44.249009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1177/2337] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:09:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:09:44.263945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb0ad9-186f-4226-9196-10e333884ab6 service placement] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:44.266108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1dcb0ad9-186f-4226-9196-10e333884ab6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:44.379038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb0ad9-186f-4226-9196-10e333884ab6 service placement] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:44.385759 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8121a2-3764-40ba-9d69-ecccf72eb97a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:44.386499 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8121a2-3764-40ba-9d69-ecccf72eb97a service swift] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:44.386786 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8121a2-3764-40ba-9d69-ecccf72eb97a service swift] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:44.387063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8121a2-3764-40ba-9d69-ecccf72eb97a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:44.403318 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8121a2-3764-40ba-9d69-ecccf72eb97a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:44.409923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8121a2-3764-40ba-9d69-ecccf72eb97a service swift] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:44.425043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1161/2338] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:09:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:09:48.432392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237c376-eb68-428f-87b0-e3f367fc4b4b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:48.444413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237c376-eb68-428f-87b0-e3f367fc4b4b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:48.449632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcda55f-c782-4ebb-b1a8-90eeb3ee45ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:48.450494 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcda55f-c782-4ebb-b1a8-90eeb3ee45ad service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:48.451154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcda55f-c782-4ebb-b1a8-90eeb3ee45ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:48.451523 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcda55f-c782-4ebb-b1a8-90eeb3ee45ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:48.453506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6bcda55f-c782-4ebb-b1a8-90eeb3ee45ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:48.533144 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcda55f-c782-4ebb-b1a8-90eeb3ee45ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:48.535313 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcda55f-c782-4ebb-b1a8-90eeb3ee45ad service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:48.546691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1178/2339] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:52.822012 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8121a2-3764-40ba-9d69-ecccf72eb97a service swift] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:52.823515 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4f8121a2-3764-40ba-9d69-ecccf72eb97a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:52.861665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8121a2-3764-40ba-9d69-ecccf72eb97a service swift] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:52.898111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63fcfd-488b-4c95-8199-8bd48c5d108a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:52.899007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63fcfd-488b-4c95-8199-8bd48c5d108a service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:52.899720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63fcfd-488b-4c95-8199-8bd48c5d108a service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:52.901237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63fcfd-488b-4c95-8199-8bd48c5d108a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:52.916926 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6e63fcfd-488b-4c95-8199-8bd48c5d108a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:52.958331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:09:53.028718 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63fcfd-488b-4c95-8199-8bd48c5d108a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:53.030933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63fcfd-488b-4c95-8199-8bd48c5d108a service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:53.042009 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1162/2340] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:09:53.596764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcda55f-c782-4ebb-b1a8-90eeb3ee45ad service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:53.608272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcda55f-c782-4ebb-b1a8-90eeb3ee45ad service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:53.613575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2625ba8-2eff-425d-b95e-f4433edfc0c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccab7239a2474aa093e685d5da97f1a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:53.614285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2625ba8-2eff-425d-b95e-f4433edfc0c4 service placement] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:53.614576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2625ba8-2eff-425d-b95e-f4433edfc0c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:53.614996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2625ba8-2eff-425d-b95e-f4433edfc0c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:53.616996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d2625ba8-2eff-425d-b95e-f4433edfc0c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:53.629747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2625ba8-2eff-425d-b95e-f4433edfc0c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:53.631671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2625ba8-2eff-425d-b95e-f4433edfc0c4 service placement] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:53.645612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1179/2341] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:53.649682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63fcfd-488b-4c95-8199-8bd48c5d108a service nova] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:53.651219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-6e63fcfd-488b-4c95-8199-8bd48c5d108a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:53.666465 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63fcfd-488b-4c95-8199-8bd48c5d108a service nova] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:53.671771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af75e4-1823-47b3-bb16-2573fa94dc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:53.672778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af75e4-1823-47b3-bb16-2573fa94dc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:53.672941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af75e4-1823-47b3-bb16-2573fa94dc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:53.673209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af75e4-1823-47b3-bb16-2573fa94dc8c admin admin] PATH_INFO: `/v3/users/ee4d6facfb4249fd9ff38b7a59837d61` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:53.674722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af75e4-1823-47b3-bb16-2573fa94dc8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4d6facfb4249fd9ff38b7a59837d61)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:53.676773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af75e4-1823-47b3-bb16-2573fa94dc8c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:53.732137 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-71af75e4-1823-47b3-bb16-2573fa94dc8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4d6facfb4249fd9ff38b7a59837d61'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:53.745804 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-71af75e4-1823-47b3-bb16-2573fa94dc8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4d6facfb4249fd9ff38b7a59837d61'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:53.746568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-71af75e4-1823-47b3-bb16-2573fa94dc8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4d6facfb4249fd9ff38b7a59837d61'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:53.747326 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-71af75e4-1823-47b3-bb16-2573fa94dc8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4d6facfb4249fd9ff38b7a59837d61'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:53.761870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-71af75e4-1823-47b3-bb16-2573fa94dc8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4d6facfb4249fd9ff38b7a59837d61'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:53.775095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1163/2342] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:09:53 2022] DELETE /identity/v3/users/ee4d6facfb4249fd9ff38b7a59837d61 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:09:53.961550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2625ba8-2eff-425d-b95e-f4433edfc0c4 service placement] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:53.983002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2625ba8-2eff-425d-b95e-f4433edfc0c4 service placement] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:54.023050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:09:54.050059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b8936-937f-498a-8f50-87058394bba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:54.052220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b8936-937f-498a-8f50-87058394bba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:54.052802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b8936-937f-498a-8f50-87058394bba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:54.053302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b8936-937f-498a-8f50-87058394bba2 admin admin] PATH_INFO: `/v3/projects/b4137deae66a4187ad5ea2757a9b737b` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:54.055357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b8936-937f-498a-8f50-87058394bba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4137deae66a4187ad5ea2757a9b737b)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:54.059181 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b8936-937f-498a-8f50-87058394bba2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:54.123701 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac1b8936-937f-498a-8f50-87058394bba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4137deae66a4187ad5ea2757a9b737b', 'request_id': 'req-ac1b8936-937f-498a-8f50-87058394bba2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:54.130927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac1b8936-937f-498a-8f50-87058394bba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4137deae66a4187ad5ea2757a9b737b', 'request_id': 'req-ac1b8936-937f-498a-8f50-87058394bba2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:54.137300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac1b8936-937f-498a-8f50-87058394bba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4137deae66a4187ad5ea2757a9b737b', 'request_id': 'req-ac1b8936-937f-498a-8f50-87058394bba2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:54.149682 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac1b8936-937f-498a-8f50-87058394bba2 admin admin] The token cache is being invalidate because project b4137deae66a4187ad5ea2757a9b737b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:09:54.149997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac1b8936-937f-498a-8f50-87058394bba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:54.150621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac1b8936-937f-498a-8f50-87058394bba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:09:54.152143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1180/2343] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:09:53 2022] DELETE /identity/v3/projects/b4137deae66a4187ad5ea2757a9b737b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:09:54.157180 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ff36-d6ae-42c7-896c-7ff4b1609325 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:54.157660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ff36-d6ae-42c7-896c-7ff4b1609325 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:54.157764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ff36-d6ae-42c7-896c-7ff4b1609325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:54.177814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-5e35ff36-d6ae-42c7-896c-7ff4b1609325 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:09:54.179026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5e35ff36-d6ae-42c7-896c-7ff4b1609325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:54.237487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1164/2344] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:09:54.245250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c026f-f7b1-48a1-8f64-66559343a9ff None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:54.245539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c026f-f7b1-48a1-8f64-66559343a9ff None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:54.245813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c026f-f7b1-48a1-8f64-66559343a9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:54.268402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-425c026f-f7b1-48a1-8f64-66559343a9ff None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:09:54.269710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-425c026f-f7b1-48a1-8f64-66559343a9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:54.278163 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1181/2345] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:09:54.282482 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35ff36-d6ae-42c7-896c-7ff4b1609325 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:54.294116 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35ff36-d6ae-42c7-896c-7ff4b1609325 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:54.299957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1473aa6-722b-4e9c-ba23-7a67e70c9f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:54.300717 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1473aa6-722b-4e9c-ba23-7a67e70c9f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:54.301103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1473aa6-722b-4e9c-ba23-7a67e70c9f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:54.301501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1473aa6-722b-4e9c-ba23-7a67e70c9f7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:54.302247 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1473aa6-722b-4e9c-ba23-7a67e70c9f7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:09:54.302673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1473aa6-722b-4e9c-ba23-7a67e70c9f7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:54.304487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1473aa6-722b-4e9c-ba23-7a67e70c9f7a admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:54.317114 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1165/2346] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:09:54.321446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c026f-f7b1-48a1-8f64-66559343a9ff None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:54.331147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c026f-f7b1-48a1-8f64-66559343a9ff None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:54.336167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11987d50-e0b4-407c-88ad-60b3fc8e62e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:54.336780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11987d50-e0b4-407c-88ad-60b3fc8e62e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:54.337062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11987d50-e0b4-407c-88ad-60b3fc8e62e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:54.337337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11987d50-e0b4-407c-88ad-60b3fc8e62e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:54.337968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11987d50-e0b4-407c-88ad-60b3fc8e62e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:54.339932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11987d50-e0b4-407c-88ad-60b3fc8e62e2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:54.377405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1182/2347] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:09:54 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:09:54.378646 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1473aa6-722b-4e9c-ba23-7a67e70c9f7a admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:54.389349 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1473aa6-722b-4e9c-ba23-7a67e70c9f7a admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:54.401204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:09:54.448470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da788a-557c-46e1-9aab-40c4aea0d93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:54.449085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da788a-557c-46e1-9aab-40c4aea0d93e admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:54.449366 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da788a-557c-46e1-9aab-40c4aea0d93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:54.449637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da788a-557c-46e1-9aab-40c4aea0d93e admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:54.450252 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da788a-557c-46e1-9aab-40c4aea0d93e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:54.452179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da788a-557c-46e1-9aab-40c4aea0d93e admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:54.473607 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1166/2348] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:09:54 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:09:54.477732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11987d50-e0b4-407c-88ad-60b3fc8e62e2 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:54.488967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11987d50-e0b4-407c-88ad-60b3fc8e62e2 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:54.493587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa45cfd-30f7-4933-ad66-2019f7fa9439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:54.494190 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa45cfd-30f7-4933-ad66-2019f7fa9439 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:54.494477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa45cfd-30f7-4933-ad66-2019f7fa9439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:54.494773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa45cfd-30f7-4933-ad66-2019f7fa9439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:54.495424 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa45cfd-30f7-4933-ad66-2019f7fa9439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:54.497070 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa45cfd-30f7-4933-ad66-2019f7fa9439 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:54.507060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1183/2349] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:09:54.511233 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da788a-557c-46e1-9aab-40c4aea0d93e admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:54.521387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da788a-557c-46e1-9aab-40c4aea0d93e admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:54.526113 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7f1c2-6140-468c-9749-b957512c1b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:54.526712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7f1c2-6140-468c-9749-b957512c1b85 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:54.527023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7f1c2-6140-468c-9749-b957512c1b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:54.527300 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7f1c2-6140-468c-9749-b957512c1b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:54.527986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7f1c2-6140-468c-9749-b957512c1b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:54.529562 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7f1c2-6140-468c-9749-b957512c1b85 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:54.540795 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1167/2350] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:09:54.544933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa45cfd-30f7-4933-ad66-2019f7fa9439 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:54.556395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa45cfd-30f7-4933-ad66-2019f7fa9439 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:54.561586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c2928-057b-49e1-b7b3-1917ba28581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:54.562330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c2928-057b-49e1-b7b3-1917ba28581e admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:54.562715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c2928-057b-49e1-b7b3-1917ba28581e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:54.563130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c2928-057b-49e1-b7b3-1917ba28581e admin admin] PATH_INFO: `/v3/projects/4af37e64db954cbb8c45f8808ade264c/users/ebf8394b52a24146a4015e5e4b4b423b/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:54.579104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c2928-057b-49e1-b7b3-1917ba28581e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af37e64db954cbb8c45f8808ade264c, user_id=ebf8394b52a24146a4015e5e4b4b423b, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:54.581775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c2928-057b-49e1-b7b3-1917ba28581e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:54.595662 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1184/2351] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:09:54 2022] PUT /identity/v3/projects/4af37e64db954cbb8c45f8808ade264c/users/ebf8394b52a24146a4015e5e4b4b423b/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:09:54.606383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b8b53-6fa9-422e-ad51-1a24d79b6d8e None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:54.606684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b8b53-6fa9-422e-ad51-1a24d79b6d8e None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:54.606971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b8b53-6fa9-422e-ad51-1a24d79b6d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:54.638508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-423b8b53-6fa9-422e-ad51-1a24d79b6d8e None None] MFA Rules not processed for user `ebf8394b52a24146a4015e5e4b4b423b`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:09:54.639810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-423b8b53-6fa9-422e-ad51-1a24d79b6d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:54.731590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1168/2352] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:09:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:09:54.745381 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c2928-057b-49e1-b7b3-1917ba28581e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:54.748792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-356c2928-057b-49e1-b7b3-1917ba28581e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:54.843838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c2928-057b-49e1-b7b3-1917ba28581e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:54.847762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60f433-324e-4d27-94d5-e44435aaa30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:54.848463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60f433-324e-4d27-94d5-e44435aaa30b service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:54.848737 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60f433-324e-4d27-94d5-e44435aaa30b service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:54.849021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60f433-324e-4d27-94d5-e44435aaa30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:54.861815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60f433-324e-4d27-94d5-e44435aaa30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:54.863400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60f433-324e-4d27-94d5-e44435aaa30b service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:54.899951 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1185/2353] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:00.402497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b8b53-6fa9-422e-ad51-1a24d79b6d8e None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:00.403966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-423b8b53-6fa9-422e-ad51-1a24d79b6d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:00.469824 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b8b53-6fa9-422e-ad51-1a24d79b6d8e None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:00.473591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fc5ca-6087-486c-83b8-b2c3cfaedbe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:00.474193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fc5ca-6087-486c-83b8-b2c3cfaedbe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:00.474725 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fc5ca-6087-486c-83b8-b2c3cfaedbe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:00.475121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fc5ca-6087-486c-83b8-b2c3cfaedbe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:00.477256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a98fc5ca-6087-486c-83b8-b2c3cfaedbe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:00.521664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:00.549051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fc5ca-6087-486c-83b8-b2c3cfaedbe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:00.550531 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fc5ca-6087-486c-83b8-b2c3cfaedbe1 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:00.561799 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1169/2354] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:01.392435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7886-43c1-4caf-8c70-3ebff93c35ab None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:01.392924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7886-43c1-4caf-8c70-3ebff93c35ab None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:01.393032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7886-43c1-4caf-8c70-3ebff93c35ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:01.416904 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e94d7886-43c1-4caf-8c70-3ebff93c35ab None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:01.418404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e94d7886-43c1-4caf-8c70-3ebff93c35ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:01.427382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:01.535193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1186/2355] 10.222.0.30 () {58 vars in 967 bytes} [Wed Aug 10 08:10:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:01.546885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fc5ca-6087-486c-83b8-b2c3cfaedbe1 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:01.548499 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a98fc5ca-6087-486c-83b8-b2c3cfaedbe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:01.668286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fc5ca-6087-486c-83b8-b2c3cfaedbe1 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:01.677225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34289495-5b19-4aaf-9d88-d04dfa0aaf69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:01.678697 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34289495-5b19-4aaf-9d88-d04dfa0aaf69 service swift] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:01.679210 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34289495-5b19-4aaf-9d88-d04dfa0aaf69 service swift] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:01.679673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34289495-5b19-4aaf-9d88-d04dfa0aaf69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:01.710563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34289495-5b19-4aaf-9d88-d04dfa0aaf69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:01.714483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34289495-5b19-4aaf-9d88-d04dfa0aaf69 service swift] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:01.746606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1170/2356] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:10:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:10:03.774223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7886-43c1-4caf-8c70-3ebff93c35ab None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:03.790466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7886-43c1-4caf-8c70-3ebff93c35ab None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:03.795466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:03.796287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:03.797624 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:03.798017 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] PATH_INFO: `/v3/users/ebf8394b52a24146a4015e5e4b4b423b` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:03.800400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf8394b52a24146a4015e5e4b4b423b)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:03.802529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:03.873773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf8394b52a24146a4015e5e4b4b423b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:03.885657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf8394b52a24146a4015e5e4b4b423b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:03.895604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf8394b52a24146a4015e5e4b4b423b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:03.896872 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf8394b52a24146a4015e5e4b4b423b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:03.921295 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf8394b52a24146a4015e5e4b4b423b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:03.929698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1187/2357] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:03 2022] DELETE /identity/v3/users/ebf8394b52a24146a4015e5e4b4b423b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:03.934307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e3edb-2bd9-4824-9608-123a0f151483 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:03.934792 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e3edb-2bd9-4824-9608-123a0f151483 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:03.935870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e3edb-2bd9-4824-9608-123a0f151483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:03.959859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d48e3edb-2bd9-4824-9608-123a0f151483 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:03.961398 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d48e3edb-2bd9-4824-9608-123a0f151483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:03.986185 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:03.987775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:04.046518 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1171/2358] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:04.057210 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e3edb-2bd9-4824-9608-123a0f151483 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:04.058935 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d48e3edb-2bd9-4824-9608-123a0f151483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:04.072078 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f2c21-de75-47aa-aac4-cdfe04842e95 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:04.076838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:04.077476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:04.077753 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:04.078701 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] PATH_INFO: `/v3/users/a17e6e20d5d84cf29803263ab19fcfa9` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:04.079913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17e6e20d5d84cf29803263ab19fcfa9)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:04.081877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:04.112116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:04.118316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e3edb-2bd9-4824-9608-123a0f151483 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:04.122293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b02e40-9b44-484d-b6ad-b30a12232c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:04.122922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b02e40-9b44-484d-b6ad-b30a12232c39 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:04.123308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b02e40-9b44-484d-b6ad-b30a12232c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:04.123636 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b02e40-9b44-484d-b6ad-b30a12232c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:04.133529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17e6e20d5d84cf29803263ab19fcfa9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:04.134001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b02e40-9b44-484d-b6ad-b30a12232c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:04.135476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b02e40-9b44-484d-b6ad-b30a12232c39 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:04.143300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17e6e20d5d84cf29803263ab19fcfa9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:04.147490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1172/2359] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:04.153827 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17e6e20d5d84cf29803263ab19fcfa9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:04.154910 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17e6e20d5d84cf29803263ab19fcfa9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:04.169485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17e6e20d5d84cf29803263ab19fcfa9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:04.180302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1188/2360] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:03 2022] DELETE /identity/v3/users/a17e6e20d5d84cf29803263ab19fcfa9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:04.256664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b02e40-9b44-484d-b6ad-b30a12232c39 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:04.266638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b02e40-9b44-484d-b6ad-b30a12232c39 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:04.271444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:04.342135 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddf5e5-b0c5-43a8-99bd-704aa48beb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:04.343015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddf5e5-b0c5-43a8-99bd-704aa48beb00 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:04.343293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddf5e5-b0c5-43a8-99bd-704aa48beb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:04.343628 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddf5e5-b0c5-43a8-99bd-704aa48beb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:04.345507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-82ddf5e5-b0c5-43a8-99bd-704aa48beb00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:04.392109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:04.394238 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:04.434255 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddf5e5-b0c5-43a8-99bd-704aa48beb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:04.436166 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddf5e5-b0c5-43a8-99bd-704aa48beb00 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:04.450863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1173/2361] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:04.492823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65161d8-1e63-4208-ad3c-5c1390cc6daa admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:04.497666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5d3b4-b56e-4936-b485-2321c415fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:04.498369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5d3b4-b56e-4936-b485-2321c415fe89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:04.498720 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5d3b4-b56e-4936-b485-2321c415fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:04.499061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5d3b4-b56e-4936-b485-2321c415fe89 admin admin] PATH_INFO: `/v3/projects/5150d2ba68ac4df9926fa2c88882eb9a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:04.501390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5d3b4-b56e-4936-b485-2321c415fe89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5150d2ba68ac4df9926fa2c88882eb9a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:04.503535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5d3b4-b56e-4936-b485-2321c415fe89 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:04.552229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2ee5d3b4-b56e-4936-b485-2321c415fe89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5150d2ba68ac4df9926fa2c88882eb9a', 'request_id': 'req-2ee5d3b4-b56e-4936-b485-2321c415fe89'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:04.557916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2ee5d3b4-b56e-4936-b485-2321c415fe89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5150d2ba68ac4df9926fa2c88882eb9a', 'request_id': 'req-2ee5d3b4-b56e-4936-b485-2321c415fe89'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:04.564383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2ee5d3b4-b56e-4936-b485-2321c415fe89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5150d2ba68ac4df9926fa2c88882eb9a', 'request_id': 'req-2ee5d3b4-b56e-4936-b485-2321c415fe89'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:04.580048 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2ee5d3b4-b56e-4936-b485-2321c415fe89 admin admin] The token cache is being invalidate because project 5150d2ba68ac4df9926fa2c88882eb9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:04.580378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2ee5d3b4-b56e-4936-b485-2321c415fe89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:04.581076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2ee5d3b4-b56e-4936-b485-2321c415fe89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:04.582605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1189/2362] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:04 2022] DELETE /identity/v3/projects/5150d2ba68ac4df9926fa2c88882eb9a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:04.587931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2e7c5-82c1-43bb-81f1-e4ad8d84096c None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:04.588208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2e7c5-82c1-43bb-81f1-e4ad8d84096c None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:04.588503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2e7c5-82c1-43bb-81f1-e4ad8d84096c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:04.609432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-07a2e7c5-82c1-43bb-81f1-e4ad8d84096c None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:04.610691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-07a2e7c5-82c1-43bb-81f1-e4ad8d84096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:04.676321 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1174/2363] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:04.684604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad496901-9c0c-48a6-abb4-5f7432672dae None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:04.684879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad496901-9c0c-48a6-abb4-5f7432672dae None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:04.685159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad496901-9c0c-48a6-abb4-5f7432672dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:04.706361 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ad496901-9c0c-48a6-abb4-5f7432672dae None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:04.707567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ad496901-9c0c-48a6-abb4-5f7432672dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:04.715852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1190/2364] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:04.721143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2e7c5-82c1-43bb-81f1-e4ad8d84096c None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:04.731760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2e7c5-82c1-43bb-81f1-e4ad8d84096c None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:04.736770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0839cb7-2faf-497a-94e8-d36422d589e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:04.737388 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0839cb7-2faf-497a-94e8-d36422d589e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:04.737667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0839cb7-2faf-497a-94e8-d36422d589e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:04.737939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0839cb7-2faf-497a-94e8-d36422d589e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:04.738630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0839cb7-2faf-497a-94e8-d36422d589e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:04.738931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0839cb7-2faf-497a-94e8-d36422d589e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:04.740654 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0839cb7-2faf-497a-94e8-d36422d589e7 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:04.753933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1175/2365] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:04.758440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad496901-9c0c-48a6-abb4-5f7432672dae None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:04.769006 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad496901-9c0c-48a6-abb4-5f7432672dae None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:04.773801 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2625d0-38d6-48f1-8780-a3d7ac2e9ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:04.774418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2625d0-38d6-48f1-8780-a3d7ac2e9ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:04.774967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2625d0-38d6-48f1-8780-a3d7ac2e9ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:04.774967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2625d0-38d6-48f1-8780-a3d7ac2e9ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:04.775593 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2625d0-38d6-48f1-8780-a3d7ac2e9ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:04.777543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2625d0-38d6-48f1-8780-a3d7ac2e9ccc admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:04.807251 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1191/2366] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:04 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:04.811631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0839cb7-2faf-497a-94e8-d36422d589e7 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:04.825494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0839cb7-2faf-497a-94e8-d36422d589e7 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:04.881642 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:04.898768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2625d0-38d6-48f1-8780-a3d7ac2e9ccc admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:04.901143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4a2625d0-38d6-48f1-8780-a3d7ac2e9ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:04.903263 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4488019-8528-4547-a1c7-04af107da9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:04.904469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4488019-8528-4547-a1c7-04af107da9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:04.904937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4488019-8528-4547-a1c7-04af107da9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:04.905390 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4488019-8528-4547-a1c7-04af107da9a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:04.906402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4488019-8528-4547-a1c7-04af107da9a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:04.908621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4488019-8528-4547-a1c7-04af107da9a7 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:04.916999 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2625d0-38d6-48f1-8780-a3d7ac2e9ccc admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:04.940430 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21451b-06d3-47c7-b978-be2da62a3ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:04.941279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21451b-06d3-47c7-b978-be2da62a3ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:04.941483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1176/2367] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:04 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:04.941933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21451b-06d3-47c7-b978-be2da62a3ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:04.941933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21451b-06d3-47c7-b978-be2da62a3ca7 admin admin] PATH_INFO: `/v3/projects/4af37e64db954cbb8c45f8808ade264c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:04.943143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21451b-06d3-47c7-b978-be2da62a3ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af37e64db954cbb8c45f8808ade264c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:04.945927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21451b-06d3-47c7-b978-be2da62a3ca7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:04.948063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:04.948974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4488019-8528-4547-a1c7-04af107da9a7 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:04.977704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4488019-8528-4547-a1c7-04af107da9a7 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:04.987347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0232d-b0ad-497c-96a8-0299f7ad3d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:04.988059 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0232d-b0ad-497c-96a8-0299f7ad3d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:04.988433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0232d-b0ad-497c-96a8-0299f7ad3d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:04.988771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0232d-b0ad-497c-96a8-0299f7ad3d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:04.989474 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0232d-b0ad-497c-96a8-0299f7ad3d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:04.991263 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0232d-b0ad-497c-96a8-0299f7ad3d61 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:05.007919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1177/2368] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:05.013091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0232d-b0ad-497c-96a8-0299f7ad3d61 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:05.016376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af21451b-06d3-47c7-b978-be2da62a3ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af37e64db954cbb8c45f8808ade264c', 'request_id': 'req-af21451b-06d3-47c7-b978-be2da62a3ca7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:05.023425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af21451b-06d3-47c7-b978-be2da62a3ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af37e64db954cbb8c45f8808ade264c', 'request_id': 'req-af21451b-06d3-47c7-b978-be2da62a3ca7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:05.027348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0232d-b0ad-497c-96a8-0299f7ad3d61 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:05.030278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af21451b-06d3-47c7-b978-be2da62a3ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af37e64db954cbb8c45f8808ade264c', 'request_id': 'req-af21451b-06d3-47c7-b978-be2da62a3ca7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:05.050805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af21451b-06d3-47c7-b978-be2da62a3ca7 admin admin] The token cache is being invalidate because project 4af37e64db954cbb8c45f8808ade264c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:05.051220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af21451b-06d3-47c7-b978-be2da62a3ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:05.052400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af21451b-06d3-47c7-b978-be2da62a3ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:05.054498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1192/2369] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:04 2022] DELETE /identity/v3/projects/4af37e64db954cbb8c45f8808ade264c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:05.059160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e91c14-565f-473d-9849-81f7cd3d7e49 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.059445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e91c14-565f-473d-9849-81f7cd3d7e49 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.059716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e91c14-565f-473d-9849-81f7cd3d7e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.081014 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-11e91c14-565f-473d-9849-81f7cd3d7e49 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:05.081966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-11e91c14-565f-473d-9849-81f7cd3d7e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:05.102023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4f00-1079-47ce-ab0e-afc69336954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:05.102729 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4f00-1079-47ce-ab0e-afc69336954c admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.103083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4f00-1079-47ce-ab0e-afc69336954c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.103425 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4f00-1079-47ce-ab0e-afc69336954c admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.104180 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d4f00-1079-47ce-ab0e-afc69336954c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:05.105871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d4f00-1079-47ce-ab0e-afc69336954c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:05.118235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1178/2370] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:05.122293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4f00-1079-47ce-ab0e-afc69336954c admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:05.124569 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-dc9d4f00-1079-47ce-ab0e-afc69336954c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:05.138989 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4f00-1079-47ce-ab0e-afc69336954c admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:05.144386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae0695-6365-48c5-802f-c53830cb3ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:05.145214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae0695-6365-48c5-802f-c53830cb3ced admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.145578 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae0695-6365-48c5-802f-c53830cb3ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.145788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae0695-6365-48c5-802f-c53830cb3ced admin admin] PATH_INFO: `/v3/projects/e6ca1f9e0d844554a1a2afeeda887d2a/users/f03c94728cb148e9a05920872ad572f8/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.152071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1193/2371] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:05.161287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eab23-b259-4f01-90ec-7a052e615f0f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.161830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eab23-b259-4f01-90ec-7a052e615f0f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.162410 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eab23-b259-4f01-90ec-7a052e615f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.164800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae0695-6365-48c5-802f-c53830cb3ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca1f9e0d844554a1a2afeeda887d2a, user_id=f03c94728cb148e9a05920872ad572f8, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:05.168173 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae0695-6365-48c5-802f-c53830cb3ced admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:05.184803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-694eab23-b259-4f01-90ec-7a052e615f0f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:05.186043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-694eab23-b259-4f01-90ec-7a052e615f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:05.190609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1179/2372] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:05 2022] PUT /identity/v3/projects/e6ca1f9e0d844554a1a2afeeda887d2a/users/f03c94728cb148e9a05920872ad572f8/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:05.201570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7823863-8e82-42ef-82be-2d98f1c55cd1 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.201853 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7823863-8e82-42ef-82be-2d98f1c55cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.202125 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7823863-8e82-42ef-82be-2d98f1c55cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.230665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e7823863-8e82-42ef-82be-2d98f1c55cd1 None None] MFA Rules not processed for user `f03c94728cb148e9a05920872ad572f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:05.232050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e7823863-8e82-42ef-82be-2d98f1c55cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:05.254642 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1194/2373] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:05.258946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eab23-b259-4f01-90ec-7a052e615f0f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:05.268814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eab23-b259-4f01-90ec-7a052e615f0f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:05.273743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05a742-475f-4ce1-87ef-6f811d61b84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:05.274465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05a742-475f-4ce1-87ef-6f811d61b84f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.274852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05a742-475f-4ce1-87ef-6f811d61b84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.275231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05a742-475f-4ce1-87ef-6f811d61b84f admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.276036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05a742-475f-4ce1-87ef-6f811d61b84f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:05.276446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05a742-475f-4ce1-87ef-6f811d61b84f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:05.278166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05a742-475f-4ce1-87ef-6f811d61b84f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:05.292615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1195/2374] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:10:05.297181 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05a742-475f-4ce1-87ef-6f811d61b84f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:05.311072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1180/2375] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:05.312702 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05a742-475f-4ce1-87ef-6f811d61b84f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:05.319554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43515806-a6ac-4d29-a823-e58ad1690144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:05.320218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43515806-a6ac-4d29-a823-e58ad1690144 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.320677 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43515806-a6ac-4d29-a823-e58ad1690144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.320960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43515806-a6ac-4d29-a823-e58ad1690144 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.321606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43515806-a6ac-4d29-a823-e58ad1690144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:05.322921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7823863-8e82-42ef-82be-2d98f1c55cd1 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:05.323838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43515806-a6ac-4d29-a823-e58ad1690144 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:05.324351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e7823863-8e82-42ef-82be-2d98f1c55cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:05.341223 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:05.358118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:05.361435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1196/2376] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:05 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:05.366137 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43515806-a6ac-4d29-a823-e58ad1690144 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:05.412911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7823863-8e82-42ef-82be-2d98f1c55cd1 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:05.445718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43515806-a6ac-4d29-a823-e58ad1690144 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:05.452607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974d9ed-6dda-425e-b428-a2ab7d7ad7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:05.453180 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d9ed-6dda-425e-b428-a2ab7d7ad7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.453464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d9ed-6dda-425e-b428-a2ab7d7ad7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.453741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d9ed-6dda-425e-b428-a2ab7d7ad7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.454379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974d9ed-6dda-425e-b428-a2ab7d7ad7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:05.456809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974d9ed-6dda-425e-b428-a2ab7d7ad7e6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:05.483174 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38112f4e-9898-4a7e-986c-79239d8bd82e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:05.483839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38112f4e-9898-4a7e-986c-79239d8bd82e service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.484633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38112f4e-9898-4a7e-986c-79239d8bd82e service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.484915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38112f4e-9898-4a7e-986c-79239d8bd82e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.488062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1197/2377] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:05 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:05.488918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974d9ed-6dda-425e-b428-a2ab7d7ad7e6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:05.502109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974d9ed-6dda-425e-b428-a2ab7d7ad7e6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:05.508272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a31a02-7c6f-417b-8e0a-922d7fe80fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:05.508914 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a31a02-7c6f-417b-8e0a-922d7fe80fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.509257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a31a02-7c6f-417b-8e0a-922d7fe80fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.509531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a31a02-7c6f-417b-8e0a-922d7fe80fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.510319 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a31a02-7c6f-417b-8e0a-922d7fe80fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:05.512065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a31a02-7c6f-417b-8e0a-922d7fe80fc7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:05.522559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1198/2378] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:05.526479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a31a02-7c6f-417b-8e0a-922d7fe80fc7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:05.537648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a31a02-7c6f-417b-8e0a-922d7fe80fc7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:05.542367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543cde5-0a53-4f82-97cb-2572aff91da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:05.542634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543cde5-0a53-4f82-97cb-2572aff91da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.542915 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543cde5-0a53-4f82-97cb-2572aff91da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.543188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543cde5-0a53-4f82-97cb-2572aff91da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.543882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543cde5-0a53-4f82-97cb-2572aff91da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:05.545479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543cde5-0a53-4f82-97cb-2572aff91da2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:05.547875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38112f4e-9898-4a7e-986c-79239d8bd82e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:05.550549 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38112f4e-9898-4a7e-986c-79239d8bd82e service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:05.560550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1181/2379] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:05.562918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1199/2380] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:05.567815 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38112f4e-9898-4a7e-986c-79239d8bd82e service nova] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:05.581558 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38112f4e-9898-4a7e-986c-79239d8bd82e service nova] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:05.586611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc462819-0889-4da4-bd0a-cc60ac40fe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:05.587337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462819-0889-4da4-bd0a-cc60ac40fe1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.587682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462819-0889-4da4-bd0a-cc60ac40fe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.588055 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462819-0889-4da4-bd0a-cc60ac40fe1b admin admin] PATH_INFO: `/v3/projects/b28d09a2a3db4f0195472acc2f739bab/users/0617d4e974904c7b8507860b8aa92e41/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.605442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc462819-0889-4da4-bd0a-cc60ac40fe1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28d09a2a3db4f0195472acc2f739bab, user_id=0617d4e974904c7b8507860b8aa92e41, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:05.608451 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc462819-0889-4da4-bd0a-cc60ac40fe1b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:05.625700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1182/2381] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:05 2022] PUT /identity/v3/projects/b28d09a2a3db4f0195472acc2f739bab/users/0617d4e974904c7b8507860b8aa92e41/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:05.636622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad803eb-6281-46cc-be32-238500734355 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.636916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad803eb-6281-46cc-be32-238500734355 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.637198 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad803eb-6281-46cc-be32-238500734355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.670658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-aad803eb-6281-46cc-be32-238500734355 None None] MFA Rules not processed for user `0617d4e974904c7b8507860b8aa92e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:05.672211 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-aad803eb-6281-46cc-be32-238500734355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:05.752071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1200/2382] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:05.763835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc462819-0889-4da4-bd0a-cc60ac40fe1b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:05.766431 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-fc462819-0889-4da4-bd0a-cc60ac40fe1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:05.826454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:05.914528 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc462819-0889-4da4-bd0a-cc60ac40fe1b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:05.930842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a6e39-509c-47be-b78e-c6d74f7af6b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8e7a0b9eb14983ac117690e2705eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:05.931552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a6e39-509c-47be-b78e-c6d74f7af6b2 service nova] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:05.933014 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a6e39-509c-47be-b78e-c6d74f7af6b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:05.933386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a6e39-509c-47be-b78e-c6d74f7af6b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:05.946169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a6e39-509c-47be-b78e-c6d74f7af6b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:05.948438 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a6e39-509c-47be-b78e-c6d74f7af6b2 service nova] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:05.962081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1183/2383] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:06.219504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad803eb-6281-46cc-be32-238500734355 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:06.272010 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:06.285617 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad803eb-6281-46cc-be32-238500734355 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:06.290489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:06.291124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:06.291405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:06.291676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] PATH_INFO: `/v3/users/0617d4e974904c7b8507860b8aa92e41` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:06.292835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0617d4e974904c7b8507860b8aa92e41)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:06.294754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:06.352952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0617d4e974904c7b8507860b8aa92e41'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:06.363166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0617d4e974904c7b8507860b8aa92e41'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:06.371651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0617d4e974904c7b8507860b8aa92e41'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:06.372522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0617d4e974904c7b8507860b8aa92e41'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:06.386384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0617d4e974904c7b8507860b8aa92e41'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:06.393646 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1201/2384] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:06 2022] DELETE /identity/v3/users/0617d4e974904c7b8507860b8aa92e41 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:06.397999 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e5808-d09c-4638-ac3a-a97fc542d196 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:06.400044 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e5808-d09c-4638-ac3a-a97fc542d196 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:06.400597 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e5808-d09c-4638-ac3a-a97fc542d196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:06.426418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-1e5e5808-d09c-4638-ac3a-a97fc542d196 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:06.427659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1e5e5808-d09c-4638-ac3a-a97fc542d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:06.503457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1184/2385] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:06.514836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:06.516371 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:06.585201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a2b91-b036-451c-a627-a0b2d70ded15 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:06.589974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42db58-6d1d-4731-8af5-8b8c713d532d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:06.590592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42db58-6d1d-4731-8af5-8b8c713d532d service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:06.590989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42db58-6d1d-4731-8af5-8b8c713d532d service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:06.591349 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42db58-6d1d-4731-8af5-8b8c713d532d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:06.603991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42db58-6d1d-4731-8af5-8b8c713d532d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:06.605442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42db58-6d1d-4731-8af5-8b8c713d532d service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:06.621057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1202/2386] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:07.244779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e5808-d09c-4638-ac3a-a97fc542d196 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:07.246287 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1e5e5808-d09c-4638-ac3a-a97fc542d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:07.267046 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e5808-d09c-4638-ac3a-a97fc542d196 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:07.272295 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:07.273258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:07.273382 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:07.273652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e admin admin] PATH_INFO: `/v3/projects/b28d09a2a3db4f0195472acc2f739bab` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:07.275155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28d09a2a3db4f0195472acc2f739bab)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:07.277176 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:07.362025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28d09a2a3db4f0195472acc2f739bab', 'request_id': 'req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:07.370903 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28d09a2a3db4f0195472acc2f739bab', 'request_id': 'req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:07.377795 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28d09a2a3db4f0195472acc2f739bab', 'request_id': 'req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:07.397914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e admin admin] The token cache is being invalidate because project b28d09a2a3db4f0195472acc2f739bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:07.398212 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:07.398890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d3ff5221-5e49-48fd-ae6c-1a219473ee7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:07.400458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1185/2387] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:07 2022] DELETE /identity/v3/projects/b28d09a2a3db4f0195472acc2f739bab => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:07.405562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89666005-e48c-4e09-8651-5c87bbc7f5ff None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:07.406660 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89666005-e48c-4e09-8651-5c87bbc7f5ff None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:07.406763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89666005-e48c-4e09-8651-5c87bbc7f5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:07.426909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-89666005-e48c-4e09-8651-5c87bbc7f5ff None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:07.428172 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-89666005-e48c-4e09-8651-5c87bbc7f5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:07.496372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1203/2388] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:07.505716 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163e2dc-b68e-4ae3-966b-89cac5dc57e6 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:07.506001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163e2dc-b68e-4ae3-966b-89cac5dc57e6 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:07.506271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163e2dc-b68e-4ae3-966b-89cac5dc57e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:07.527148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-3163e2dc-b68e-4ae3-966b-89cac5dc57e6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:07.528444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-3163e2dc-b68e-4ae3-966b-89cac5dc57e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:07.537612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1186/2389] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:07.541977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89666005-e48c-4e09-8651-5c87bbc7f5ff None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:07.553115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89666005-e48c-4e09-8651-5c87bbc7f5ff None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:07.558491 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6f41c-59a2-49b0-9c54-9f8aad94cbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:07.559311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6f41c-59a2-49b0-9c54-9f8aad94cbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:07.559666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6f41c-59a2-49b0-9c54-9f8aad94cbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:07.560061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6f41c-59a2-49b0-9c54-9f8aad94cbf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:07.560802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6f41c-59a2-49b0-9c54-9f8aad94cbf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:07.561665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6f41c-59a2-49b0-9c54-9f8aad94cbf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:07.563098 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6f41c-59a2-49b0-9c54-9f8aad94cbf8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:07.582398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1204/2390] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:07.583780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163e2dc-b68e-4ae3-966b-89cac5dc57e6 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:07.593971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163e2dc-b68e-4ae3-966b-89cac5dc57e6 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:07.599605 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a502be-9982-4026-bfb2-82078ef4afb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:07.600370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a502be-9982-4026-bfb2-82078ef4afb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:07.600644 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a502be-9982-4026-bfb2-82078ef4afb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:07.601026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a502be-9982-4026-bfb2-82078ef4afb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:07.601527 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a502be-9982-4026-bfb2-82078ef4afb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:07.603409 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a502be-9982-4026-bfb2-82078ef4afb6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:07.646516 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1187/2391] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:07 2022] POST /identity/v3/projects => generated 401 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:07.650228 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6f41c-59a2-49b0-9c54-9f8aad94cbf8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:07.657374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:07.665634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6f41c-59a2-49b0-9c54-9f8aad94cbf8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:07.747280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cba8d-2347-40bb-92f8-a28a1942ed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:07.747978 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cba8d-2347-40bb-92f8-a28a1942ed1d admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:07.748268 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cba8d-2347-40bb-92f8-a28a1942ed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:07.748547 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cba8d-2347-40bb-92f8-a28a1942ed1d admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:07.749375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cba8d-2347-40bb-92f8-a28a1942ed1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:07.751920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cba8d-2347-40bb-92f8-a28a1942ed1d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:07.780918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1205/2392] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:07 2022] POST /identity/v3/users => generated 301 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:07.782810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a502be-9982-4026-bfb2-82078ef4afb6 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:07.794555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a502be-9982-4026-bfb2-82078ef4afb6 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:07.799852 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8555afb-185c-4ed2-a325-5b77c64c40c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:07.800465 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8555afb-185c-4ed2-a325-5b77c64c40c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:07.801441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8555afb-185c-4ed2-a325-5b77c64c40c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:07.801729 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8555afb-185c-4ed2-a325-5b77c64c40c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:07.802382 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8555afb-185c-4ed2-a325-5b77c64c40c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:07.804072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8555afb-185c-4ed2-a325-5b77c64c40c0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:07.818640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1188/2393] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:07.821021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cba8d-2347-40bb-92f8-a28a1942ed1d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:07.835774 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cba8d-2347-40bb-92f8-a28a1942ed1d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:07.848700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8faaf-5546-44bd-b3d3-6ae763d92dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:07.849443 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8faaf-5546-44bd-b3d3-6ae763d92dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:07.849735 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8faaf-5546-44bd-b3d3-6ae763d92dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:07.850015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8faaf-5546-44bd-b3d3-6ae763d92dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:07.850711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8faaf-5546-44bd-b3d3-6ae763d92dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:07.852907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8faaf-5546-44bd-b3d3-6ae763d92dd8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:07.865025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1206/2394] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:07.869676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8555afb-185c-4ed2-a325-5b77c64c40c0 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:07.877363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:07.885763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8555afb-185c-4ed2-a325-5b77c64c40c0 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:07.893079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fce8e9-0be1-4e12-acb8-d69d89fee283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:07.894085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fce8e9-0be1-4e12-acb8-d69d89fee283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:07.894550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fce8e9-0be1-4e12-acb8-d69d89fee283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:07.895005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fce8e9-0be1-4e12-acb8-d69d89fee283 admin admin] PATH_INFO: `/v3/projects/58564d64f15647798af00e6b43436c4a/users/88986c2956fb4d41b4bcd44c5d62e472/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:07.912002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fce8e9-0be1-4e12-acb8-d69d89fee283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58564d64f15647798af00e6b43436c4a, user_id=88986c2956fb4d41b4bcd44c5d62e472, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:07.916352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fce8e9-0be1-4e12-acb8-d69d89fee283 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:07.933797 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1189/2395] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:07 2022] PUT /identity/v3/projects/58564d64f15647798af00e6b43436c4a/users/88986c2956fb4d41b4bcd44c5d62e472/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:07.939450 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d74e9-e490-4536-bae5-30d5dd21952b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:07.940051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d74e9-e490-4536-bae5-30d5dd21952b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:07.940589 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d74e9-e490-4536-bae5-30d5dd21952b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:07.962534 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c29d74e9-e490-4536-bae5-30d5dd21952b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:07.963920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c29d74e9-e490-4536-bae5-30d5dd21952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:08.038311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1207/2396] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:08.048228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fce8e9-0be1-4e12-acb8-d69d89fee283 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:08.050672 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-26fce8e9-0be1-4e12-acb8-d69d89fee283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:08.127358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fce8e9-0be1-4e12-acb8-d69d89fee283 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:08.131209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b991040-084d-4278-b73a-1dcc4b939ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:08.131984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991040-084d-4278-b73a-1dcc4b939ede service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:08.132273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991040-084d-4278-b73a-1dcc4b939ede service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:08.132552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991040-084d-4278-b73a-1dcc4b939ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:08.144259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b991040-084d-4278-b73a-1dcc4b939ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:08.145720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b991040-084d-4278-b73a-1dcc4b939ede service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:08.156835 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1190/2397] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:08.254757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d74e9-e490-4536-bae5-30d5dd21952b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:08.256705 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c29d74e9-e490-4536-bae5-30d5dd21952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:08.272748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d74e9-e490-4536-bae5-30d5dd21952b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:08.277395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca72816-2ce4-4642-9230-45d7e643c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:08.278034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72816-2ce4-4642-9230-45d7e643c0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:08.278309 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72816-2ce4-4642-9230-45d7e643c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:08.278581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72816-2ce4-4642-9230-45d7e643c0f9 admin admin] PATH_INFO: `/v3/users/27fb790313bb48538af59998e949e2d8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:08.279711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca72816-2ce4-4642-9230-45d7e643c0f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27fb790313bb48538af59998e949e2d8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:08.282302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca72816-2ce4-4642-9230-45d7e643c0f9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:08.334125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cca72816-2ce4-4642-9230-45d7e643c0f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27fb790313bb48538af59998e949e2d8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:08.341998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cca72816-2ce4-4642-9230-45d7e643c0f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27fb790313bb48538af59998e949e2d8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:08.351568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cca72816-2ce4-4642-9230-45d7e643c0f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27fb790313bb48538af59998e949e2d8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:08.352667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cca72816-2ce4-4642-9230-45d7e643c0f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27fb790313bb48538af59998e949e2d8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:08.365711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:08.368559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cca72816-2ce4-4642-9230-45d7e643c0f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27fb790313bb48538af59998e949e2d8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:08.376772 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1208/2398] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:08 2022] DELETE /identity/v3/users/27fb790313bb48538af59998e949e2d8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:08.428682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b991040-084d-4278-b73a-1dcc4b939ede service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:08.428682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1b991040-084d-4278-b73a-1dcc4b939ede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:08.442036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b991040-084d-4278-b73a-1dcc4b939ede service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:08.530461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:08.531831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:08.532147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:08.532402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] PATH_INFO: `/v3/users/f03c94728cb148e9a05920872ad572f8` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:08.533955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f03c94728cb148e9a05920872ad572f8)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:08.536001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:08.602705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f03c94728cb148e9a05920872ad572f8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:08.613595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f03c94728cb148e9a05920872ad572f8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:08.614251 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f03c94728cb148e9a05920872ad572f8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:08.614940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f03c94728cb148e9a05920872ad572f8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:08.628871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f03c94728cb148e9a05920872ad572f8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:08.642225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1191/2399] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:08 2022] DELETE /identity/v3/users/f03c94728cb148e9a05920872ad572f8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:08.647027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8f075-aa61-469d-a5d5-f636c0dfd16a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:08.647566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8f075-aa61-469d-a5d5-f636c0dfd16a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:08.647653 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8f075-aa61-469d-a5d5-f636c0dfd16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:08.672272 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-49a8f075-aa61-469d-a5d5-f636c0dfd16a None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:08.673771 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-49a8f075-aa61-469d-a5d5-f636c0dfd16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:08.732485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:08.734029 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:08.741721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:08.751572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1209/2400] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:08.765692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8f075-aa61-469d-a5d5-f636c0dfd16a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:08.767389 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-49a8f075-aa61-469d-a5d5-f636c0dfd16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:08.852156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8f075-aa61-469d-a5d5-f636c0dfd16a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:08.861883 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e93f36-56ef-4fd1-bb1e-abba3897aeb1 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:08.863030 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723fdc7-b81f-4a8d-b071-8d89efdd57d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:08.864443 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723fdc7-b81f-4a8d-b071-8d89efdd57d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:08.866131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723fdc7-b81f-4a8d-b071-8d89efdd57d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:08.866719 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723fdc7-b81f-4a8d-b071-8d89efdd57d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:08.868051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19953c-d87b-43ec-8216-b0870d064eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:08.868698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19953c-d87b-43ec-8216-b0870d064eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:08.868982 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19953c-d87b-43ec-8216-b0870d064eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:08.869257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19953c-d87b-43ec-8216-b0870d064eaf admin admin] PATH_INFO: `/v3/projects/99714d574da34560b352551e538af2ea` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:08.870764 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19953c-d87b-43ec-8216-b0870d064eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=99714d574da34560b352551e538af2ea)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:08.874713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19953c-d87b-43ec-8216-b0870d064eaf admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:08.882420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723fdc7-b81f-4a8d-b071-8d89efdd57d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:08.884260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723fdc7-b81f-4a8d-b071-8d89efdd57d6 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:08.898373 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1210/2401] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:08.973454 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6cb21-c77f-4a71-ba1c-085c31356b7a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:08.973821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6cb21-c77f-4a71-ba1c-085c31356b7a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:08.974320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6cb21-c77f-4a71-ba1c-085c31356b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:08.977503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5b19953c-d87b-43ec-8216-b0870d064eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99714d574da34560b352551e538af2ea', 'request_id': 'req-5b19953c-d87b-43ec-8216-b0870d064eaf'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:08.990297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5b19953c-d87b-43ec-8216-b0870d064eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99714d574da34560b352551e538af2ea', 'request_id': 'req-5b19953c-d87b-43ec-8216-b0870d064eaf'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:09.001386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5b19953c-d87b-43ec-8216-b0870d064eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99714d574da34560b352551e538af2ea', 'request_id': 'req-5b19953c-d87b-43ec-8216-b0870d064eaf'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:09.012452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8de6cb21-c77f-4a71-ba1c-085c31356b7a None None] MFA Rules not processed for user `88986c2956fb4d41b4bcd44c5d62e472`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:09.014030 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8de6cb21-c77f-4a71-ba1c-085c31356b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:09.022836 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5b19953c-d87b-43ec-8216-b0870d064eaf admin admin] The token cache is being invalidate because project 99714d574da34560b352551e538af2ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:09.022964 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5b19953c-d87b-43ec-8216-b0870d064eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:09.024144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5b19953c-d87b-43ec-8216-b0870d064eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:09.027588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1192/2402] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:08 2022] DELETE /identity/v3/projects/99714d574da34560b352551e538af2ea => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:09.034583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80028960-d7d1-40ee-8999-edcbcb6638c9 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.034871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80028960-d7d1-40ee-8999-edcbcb6638c9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.035146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80028960-d7d1-40ee-8999-edcbcb6638c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.072607 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-80028960-d7d1-40ee-8999-edcbcb6638c9 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:09.074089 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-80028960-d7d1-40ee-8999-edcbcb6638c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:09.143680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1211/2403] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:08 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:09.148767 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6cb21-c77f-4a71-ba1c-085c31356b7a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.150259 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8de6cb21-c77f-4a71-ba1c-085c31356b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:09.189662 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:09.201020 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1193/2404] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:09.205861 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1e54e-f9bd-4a85-8a1d-6d0986339bdf None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.206201 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1e54e-f9bd-4a85-8a1d-6d0986339bdf None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.206606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1e54e-f9bd-4a85-8a1d-6d0986339bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.236061 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d5b1e54e-f9bd-4a85-8a1d-6d0986339bdf None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:09.237398 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d5b1e54e-f9bd-4a85-8a1d-6d0986339bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:09.242408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6cb21-c77f-4a71-ba1c-085c31356b7a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.246862 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1194/2405] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:09.249424 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82165522-1124-450e-a1dc-99e3fb90ea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.251062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82165522-1124-450e-a1dc-99e3fb90ea6e admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.251352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82165522-1124-450e-a1dc-99e3fb90ea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.251967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82165522-1124-450e-a1dc-99e3fb90ea6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.252568 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1e54e-f9bd-4a85-8a1d-6d0986339bdf None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.252741 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82165522-1124-450e-a1dc-99e3fb90ea6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.254713 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82165522-1124-450e-a1dc-99e3fb90ea6e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.266925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1e54e-f9bd-4a85-8a1d-6d0986339bdf None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.277950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a99c53-3ccf-4a69-9e80-d65e23da3fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.278591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a99c53-3ccf-4a69-9e80-d65e23da3fde admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.279605 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a99c53-3ccf-4a69-9e80-d65e23da3fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.279967 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a99c53-3ccf-4a69-9e80-d65e23da3fde admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.281529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a99c53-3ccf-4a69-9e80-d65e23da3fde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:09.281912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a99c53-3ccf-4a69-9e80-d65e23da3fde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.283927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a99c53-3ccf-4a69-9e80-d65e23da3fde admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.299849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1195/2406] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:09.303913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1212/2407] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:09 2022] POST /identity/v3/projects => generated 403 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:09.304720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a99c53-3ccf-4a69-9e80-d65e23da3fde admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.305964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82165522-1124-450e-a1dc-99e3fb90ea6e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.315718 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a99c53-3ccf-4a69-9e80-d65e23da3fde admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.333473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:09.382154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82165522-1124-450e-a1dc-99e3fb90ea6e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.387101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485e21b-efcc-4f36-94c8-f853724e828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.387705 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485e21b-efcc-4f36-94c8-f853724e828f admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.388018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485e21b-efcc-4f36-94c8-f853724e828f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.388290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485e21b-efcc-4f36-94c8-f853724e828f admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.388911 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485e21b-efcc-4f36-94c8-f853724e828f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.391331 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485e21b-efcc-4f36-94c8-f853724e828f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.397359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b89d3-a2a8-494d-b0f1-285b21a6328b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.398097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b89d3-a2a8-494d-b0f1-285b21a6328b admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.398531 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b89d3-a2a8-494d-b0f1-285b21a6328b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.398810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b89d3-a2a8-494d-b0f1-285b21a6328b admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.399778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b89d3-a2a8-494d-b0f1-285b21a6328b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.402098 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b89d3-a2a8-494d-b0f1-285b21a6328b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.417516 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1213/2408] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:09 2022] POST /identity/v3/users => generated 308 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:09.417516 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485e21b-efcc-4f36-94c8-f853724e828f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.418826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0485e21b-efcc-4f36-94c8-f853724e828f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:09.433350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485e21b-efcc-4f36-94c8-f853724e828f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.438199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1196/2409] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:09 2022] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:09.438199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b89d3-a2a8-494d-b0f1-285b21a6328b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.501453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.502189 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.502477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.502766 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] PATH_INFO: `/v3/projects/e6ca1f9e0d844554a1a2afeeda887d2a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.504936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ca1f9e0d844554a1a2afeeda887d2a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.505402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b89d3-a2a8-494d-b0f1-285b21a6328b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.507077 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.510367 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50797532-941e-44fb-a5fc-6d7102824eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.510974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50797532-941e-44fb-a5fc-6d7102824eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.511260 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50797532-941e-44fb-a5fc-6d7102824eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.511535 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50797532-941e-44fb-a5fc-6d7102824eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.512225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50797532-941e-44fb-a5fc-6d7102824eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.513805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50797532-941e-44fb-a5fc-6d7102824eb0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.527470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1197/2410] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:09.527470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50797532-941e-44fb-a5fc-6d7102824eb0 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.536269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50797532-941e-44fb-a5fc-6d7102824eb0 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.542229 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a1109-fc63-40b7-b733-05f68703bb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.542886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a1109-fc63-40b7-b733-05f68703bb89 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.543174 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a1109-fc63-40b7-b733-05f68703bb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.543534 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a1109-fc63-40b7-b733-05f68703bb89 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.544238 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a1109-fc63-40b7-b733-05f68703bb89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.546200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a1109-fc63-40b7-b733-05f68703bb89 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.560428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:09.566181 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ca1f9e0d844554a1a2afeeda887d2a', 'request_id': 'req-29457cd8-6990-46a5-9237-318563074fa4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:09.569882 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1198/2411] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:09 2022] POST /identity/v3/users => generated 303 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:09.570898 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a1109-fc63-40b7-b733-05f68703bb89 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.574028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ca1f9e0d844554a1a2afeeda887d2a', 'request_id': 'req-29457cd8-6990-46a5-9237-318563074fa4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:09.582276 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a1109-fc63-40b7-b733-05f68703bb89 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.584056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ca1f9e0d844554a1a2afeeda887d2a', 'request_id': 'req-29457cd8-6990-46a5-9237-318563074fa4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:09.599438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] The token cache is being invalidate because project e6ca1f9e0d844554a1a2afeeda887d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:09.599866 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:09.600596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:09.602334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1214/2412] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:09 2022] DELETE /identity/v3/projects/e6ca1f9e0d844554a1a2afeeda887d2a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:09.603195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.604831 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:09.648502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845814cd-cbc6-46fd-adfa-45b4f4ef0339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.649078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845814cd-cbc6-46fd-adfa-45b4f4ef0339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.649354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845814cd-cbc6-46fd-adfa-45b4f4ef0339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.649632 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845814cd-cbc6-46fd-adfa-45b4f4ef0339 admin admin] PATH_INFO: `/v3/projects/3f9598aa99df4628872c32172ef05b1a/users/453cb50378814d269ac1d0f34f5d05b2/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.666706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845814cd-cbc6-46fd-adfa-45b4f4ef0339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9598aa99df4628872c32172ef05b1a, user_id=453cb50378814d269ac1d0f34f5d05b2, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.669737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845814cd-cbc6-46fd-adfa-45b4f4ef0339 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.678850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457cd8-6990-46a5-9237-318563074fa4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.682111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:09.685141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cee49-be2c-4b0b-8b4e-22bc7dcd8241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.685746 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cee49-be2c-4b0b-8b4e-22bc7dcd8241 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.686024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cee49-be2c-4b0b-8b4e-22bc7dcd8241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.686292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cee49-be2c-4b0b-8b4e-22bc7dcd8241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.686939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cee49-be2c-4b0b-8b4e-22bc7dcd8241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.687146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1199/2413] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:09 2022] PUT /identity/v3/projects/3f9598aa99df4628872c32172ef05b1a/users/453cb50378814d269ac1d0f34f5d05b2/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:09.691080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdcfb6-f502-4c76-a9f6-8fbf071bf63e None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.691246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cee49-be2c-4b0b-8b4e-22bc7dcd8241 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.691337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdcfb6-f502-4c76-a9f6-8fbf071bf63e None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.691337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdcfb6-f502-4c76-a9f6-8fbf071bf63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.700157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1215/2414] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:09.701027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cee49-be2c-4b0b-8b4e-22bc7dcd8241 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.705209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a91cee49-be2c-4b0b-8b4e-22bc7dcd8241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:09.711479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-1bfdcfb6-f502-4c76-a9f6-8fbf071bf63e None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:09.712752 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1bfdcfb6-f502-4c76-a9f6-8fbf071bf63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:09.719132 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cee49-be2c-4b0b-8b4e-22bc7dcd8241 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.789044 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1200/2415] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:09.790188 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdcfb6-f502-4c76-a9f6-8fbf071bf63e None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.798090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966a02c-cbc3-4899-af5e-a57288957cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.798965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966a02c-cbc3-4899-af5e-a57288957cce admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.799244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966a02c-cbc3-4899-af5e-a57288957cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.799522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966a02c-cbc3-4899-af5e-a57288957cce admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.800227 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966a02c-cbc3-4899-af5e-a57288957cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.801855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966a02c-cbc3-4899-af5e-a57288957cce admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.805860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdcfb6-f502-4c76-a9f6-8fbf071bf63e None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.810962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912b811-41be-4a27-8ba7-73554a1124e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.811571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912b811-41be-4a27-8ba7-73554a1124e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.812067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912b811-41be-4a27-8ba7-73554a1124e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.812362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912b811-41be-4a27-8ba7-73554a1124e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.815832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1216/2416] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:09.815987 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912b811-41be-4a27-8ba7-73554a1124e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.816088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba4626-39f3-44e4-ac21-b3c2bf405fdc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.816088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba4626-39f3-44e4-ac21-b3c2bf405fdc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.816088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba4626-39f3-44e4-ac21-b3c2bf405fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.816358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912b811-41be-4a27-8ba7-73554a1124e7 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.826049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1201/2417] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:09.826859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912b811-41be-4a27-8ba7-73554a1124e7 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.836018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-93ba4626-39f3-44e4-ac21-b3c2bf405fdc None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:09.837253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-93ba4626-39f3-44e4-ac21-b3c2bf405fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:09.837490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912b811-41be-4a27-8ba7-73554a1124e7 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.842224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9863e16-1ea2-42e6-913e-3b5dcea3e452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.843010 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9863e16-1ea2-42e6-913e-3b5dcea3e452 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.843376 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9863e16-1ea2-42e6-913e-3b5dcea3e452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.844146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9863e16-1ea2-42e6-913e-3b5dcea3e452 admin admin] PATH_INFO: `/v3/projects/3f9598aa99df4628872c32172ef05b1a/users/453cb50378814d269ac1d0f34f5d05b2/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.846049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9863e16-1ea2-42e6-913e-3b5dcea3e452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9598aa99df4628872c32172ef05b1a, user_id=453cb50378814d269ac1d0f34f5d05b2, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.846201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1217/2418] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:09.847492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba4626-39f3-44e4-ac21-b3c2bf405fdc None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.848716 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9863e16-1ea2-42e6-913e-3b5dcea3e452 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.857135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba4626-39f3-44e4-ac21-b3c2bf405fdc None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.861474 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1202/2419] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:09 2022] PUT /identity/v3/projects/3f9598aa99df4628872c32172ef05b1a/users/453cb50378814d269ac1d0f34f5d05b2/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:09.861474 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9863e16-1ea2-42e6-913e-3b5dcea3e452 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:09.941791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:09.950152 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac376e7d-33c3-4ec5-900b-55c0fb426b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.952091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac376e7d-33c3-4ec5-900b-55c0fb426b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.953488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac376e7d-33c3-4ec5-900b-55c0fb426b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.953645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9863e16-1ea2-42e6-913e-3b5dcea3e452 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:09.954119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac376e7d-33c3-4ec5-900b-55c0fb426b56 admin admin] PATH_INFO: `/v3/projects/cd8557d0ad294cbeb7efea6f3f6f1437/users/6784f4ec8954476081a017b6754cc93a/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.959191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4261d5-3395-482e-bb16-299d04703045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:09.960050 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4261d5-3395-482e-bb16-299d04703045 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:09.960400 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4261d5-3395-482e-bb16-299d04703045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:09.960750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4261d5-3395-482e-bb16-299d04703045 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:09.961437 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4261d5-3395-482e-bb16-299d04703045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:09.961703 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4261d5-3395-482e-bb16-299d04703045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.963296 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4261d5-3395-482e-bb16-299d04703045 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.979897 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac376e7d-33c3-4ec5-900b-55c0fb426b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8557d0ad294cbeb7efea6f3f6f1437, user_id=6784f4ec8954476081a017b6754cc93a, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:09.984428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac376e7d-33c3-4ec5-900b-55c0fb426b56 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:09.985574 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1203/2420] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:09.999438 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4261d5-3395-482e-bb16-299d04703045 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.004484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4261d5-3395-482e-bb16-299d04703045 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.012602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1218/2421] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:09 2022] PUT /identity/v3/projects/cd8557d0ad294cbeb7efea6f3f6f1437/users/6784f4ec8954476081a017b6754cc93a/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:10.024352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f2e31-81a1-471c-b0c0-abc1a561c9ac None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.024656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f2e31-81a1-471c-b0c0-abc1a561c9ac None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.024918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f2e31-81a1-471c-b0c0-abc1a561c9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.057698 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-993f2e31-81a1-471c-b0c0-abc1a561c9ac None None] MFA Rules not processed for user `6784f4ec8954476081a017b6754cc93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:10.060113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-993f2e31-81a1-471c-b0c0-abc1a561c9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:10.101948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fb121-15a4-4dea-a4a5-97dd62f3b2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.102715 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fb121-15a4-4dea-a4a5-97dd62f3b2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.103170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fb121-15a4-4dea-a4a5-97dd62f3b2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.103700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fb121-15a4-4dea-a4a5-97dd62f3b2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.105619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fb121-15a4-4dea-a4a5-97dd62f3b2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.108426 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fb121-15a4-4dea-a4a5-97dd62f3b2a9 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:10.132266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:10.149156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1204/2422] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:09 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:10.153456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fb121-15a4-4dea-a4a5-97dd62f3b2a9 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.160825 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1219/2423] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:10 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:10.163063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f2e31-81a1-471c-b0c0-abc1a561c9ac None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.176607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f2e31-81a1-471c-b0c0-abc1a561c9ac None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.242747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fb121-15a4-4dea-a4a5-97dd62f3b2a9 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.248366 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49a7e-0287-41fb-9110-ad822b1f93a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.248778 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49a7e-0287-41fb-9110-ad822b1f93a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.249154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49a7e-0287-41fb-9110-ad822b1f93a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.250320 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49a7e-0287-41fb-9110-ad822b1f93a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.250917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b49a7e-0287-41fb-9110-ad822b1f93a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.251506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297214e-04d5-4686-b440-79b5bff5d662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.252279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297214e-04d5-4686-b440-79b5bff5d662 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.252622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297214e-04d5-4686-b440-79b5bff5d662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.252901 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297214e-04d5-4686-b440-79b5bff5d662 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.253520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b49a7e-0287-41fb-9110-ad822b1f93a0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:10.253644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297214e-04d5-4686-b440-79b5bff5d662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.255975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297214e-04d5-4686-b440-79b5bff5d662 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:10.284789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1205/2424] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:10 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:10.287040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1220/2425] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:10 2022] POST /identity/v3/projects => generated 405 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:10.288891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49a7e-0287-41fb-9110-ad822b1f93a0 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.292850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297214e-04d5-4686-b440-79b5bff5d662 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.306063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49a7e-0287-41fb-9110-ad822b1f93a0 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.370365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:10.377402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297214e-04d5-4686-b440-79b5bff5d662 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.384084 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c784a1-6298-4346-a544-518f34a64339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.384336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a7622-b7b9-4a53-b37f-a159602336c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.384702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c784a1-6298-4346-a544-518f34a64339 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.384960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7622-b7b9-4a53-b37f-a159602336c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.385101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c784a1-6298-4346-a544-518f34a64339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.385216 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7622-b7b9-4a53-b37f-a159602336c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.385394 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c784a1-6298-4346-a544-518f34a64339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.385491 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7622-b7b9-4a53-b37f-a159602336c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.385886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c784a1-6298-4346-a544-518f34a64339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.386141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a7622-b7b9-4a53-b37f-a159602336c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.387484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c784a1-6298-4346-a544-518f34a64339 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:10.388086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a7622-b7b9-4a53-b37f-a159602336c8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:10.398807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1206/2426] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:10.403661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c784a1-6298-4346-a544-518f34a64339 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.420285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c784a1-6298-4346-a544-518f34a64339 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.422799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1221/2427] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:10 2022] POST /identity/v3/users => generated 309 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:10.427019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a7622-b7b9-4a53-b37f-a159602336c8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.427960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d6f25-73e5-4ac2-a4a1-c97fcd4108df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.428807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d6f25-73e5-4ac2-a4a1-c97fcd4108df admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.429244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d6f25-73e5-4ac2-a4a1-c97fcd4108df admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.429699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d6f25-73e5-4ac2-a4a1-c97fcd4108df admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.430578 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d6f25-73e5-4ac2-a4a1-c97fcd4108df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.432891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d6f25-73e5-4ac2-a4a1-c97fcd4108df admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:10.437843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a7622-b7b9-4a53-b37f-a159602336c8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.443150 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe562f5-d22c-4b4d-a8fb-f8c75da4c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.443392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe562f5-d22c-4b4d-a8fb-f8c75da4c0df admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.443567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe562f5-d22c-4b4d-a8fb-f8c75da4c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.443842 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe562f5-d22c-4b4d-a8fb-f8c75da4c0df admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.444501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe562f5-d22c-4b4d-a8fb-f8c75da4c0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.446114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe562f5-d22c-4b4d-a8fb-f8c75da4c0df admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:10.459801 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1222/2428] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:10.460623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1207/2429] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:10.461740 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe562f5-d22c-4b4d-a8fb-f8c75da4c0df admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.462886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d6f25-73e5-4ac2-a4a1-c97fcd4108df admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.472219 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe562f5-d22c-4b4d-a8fb-f8c75da4c0df admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.477153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dfc7e-6ca8-4183-9094-ade3fb87dbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.477480 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d6f25-73e5-4ac2-a4a1-c97fcd4108df admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.477816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dfc7e-6ca8-4183-9094-ade3fb87dbdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.478095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dfc7e-6ca8-4183-9094-ade3fb87dbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.478365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dfc7e-6ca8-4183-9094-ade3fb87dbdc admin admin] PATH_INFO: `/v3/projects/6be7b1bbdff64be09642a7d8123912c5/users/c869f8c46e984a56945966a32a8743c9/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.486051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610aa32-6046-4709-a51c-50b59cbe1f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.486871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610aa32-6046-4709-a51c-50b59cbe1f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.487160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610aa32-6046-4709-a51c-50b59cbe1f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.487434 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610aa32-6046-4709-a51c-50b59cbe1f26 admin admin] PATH_INFO: `/v3/projects/2045278c85e94b0ebf54030312509162/users/d6a22498fe6843649064d5906f061446/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.495604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dfc7e-6ca8-4183-9094-ade3fb87dbdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be7b1bbdff64be09642a7d8123912c5, user_id=c869f8c46e984a56945966a32a8743c9, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.498289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dfc7e-6ca8-4183-9094-ade3fb87dbdc admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:10.506058 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610aa32-6046-4709-a51c-50b59cbe1f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2045278c85e94b0ebf54030312509162, user_id=d6a22498fe6843649064d5906f061446, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.509370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610aa32-6046-4709-a51c-50b59cbe1f26 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:10.517853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1223/2430] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:10 2022] PUT /identity/v3/projects/6be7b1bbdff64be09642a7d8123912c5/users/c869f8c46e984a56945966a32a8743c9/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:10.528083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1208/2431] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:10 2022] PUT /identity/v3/projects/2045278c85e94b0ebf54030312509162/users/d6a22498fe6843649064d5906f061446/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:10.529015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c3046-6784-490b-b1f3-b1486bf3d28d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.529306 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c3046-6784-490b-b1f3-b1486bf3d28d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.529580 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c3046-6784-490b-b1f3-b1486bf3d28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.532664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610aa32-6046-4709-a51c-50b59cbe1f26 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.560536 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a20c3046-6784-490b-b1f3-b1486bf3d28d None None] MFA Rules not processed for user `c869f8c46e984a56945966a32a8743c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:10.561808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a20c3046-6784-490b-b1f3-b1486bf3d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:10.598329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:10.620900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610aa32-6046-4709-a51c-50b59cbe1f26 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.626630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884164bd-804c-4480-bb0b-c29bea1e3ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.627412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884164bd-804c-4480-bb0b-c29bea1e3ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.627753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884164bd-804c-4480-bb0b-c29bea1e3ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.628128 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884164bd-804c-4480-bb0b-c29bea1e3ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.629074 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884164bd-804c-4480-bb0b-c29bea1e3ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.630914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884164bd-804c-4480-bb0b-c29bea1e3ee8 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:10.647785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1209/2432] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:10.650945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884164bd-804c-4480-bb0b-c29bea1e3ee8 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.659786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1224/2433] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:10.664761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c3046-6784-490b-b1f3-b1486bf3d28d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.664926 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884164bd-804c-4480-bb0b-c29bea1e3ee8 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.670188 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac6888-f63c-4fc2-a55e-a60753b2ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.670805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac6888-f63c-4fc2-a55e-a60753b2ca23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.671077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac6888-f63c-4fc2-a55e-a60753b2ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.671447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac6888-f63c-4fc2-a55e-a60753b2ca23 admin admin] PATH_INFO: `/v3/projects/2045278c85e94b0ebf54030312509162/users/d6a22498fe6843649064d5906f061446/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.674266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac6888-f63c-4fc2-a55e-a60753b2ca23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2045278c85e94b0ebf54030312509162, user_id=d6a22498fe6843649064d5906f061446, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.677103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac6888-f63c-4fc2-a55e-a60753b2ca23 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:10.679757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c3046-6784-490b-b1f3-b1486bf3d28d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.684773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f43d9-d7cb-4562-9c50-e4194b9ed8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.685395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f43d9-d7cb-4562-9c50-e4194b9ed8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.685679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f43d9-d7cb-4562-9c50-e4194b9ed8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.685954 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f43d9-d7cb-4562-9c50-e4194b9ed8f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.686594 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f43d9-d7cb-4562-9c50-e4194b9ed8f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.688626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f43d9-d7cb-4562-9c50-e4194b9ed8f5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:10.695870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1210/2434] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:10 2022] PUT /identity/v3/projects/2045278c85e94b0ebf54030312509162/users/d6a22498fe6843649064d5906f061446/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:10.695870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd4da0-cf19-4898-b87e-6ef6180d5337 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.695870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd4da0-cf19-4898-b87e-6ef6180d5337 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.695870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd4da0-cf19-4898-b87e-6ef6180d5337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.731025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-95bd4da0-cf19-4898-b87e-6ef6180d5337 None None] MFA Rules not processed for user `453cb50378814d269ac1d0f34f5d05b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:10.735360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1225/2435] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:10 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:10.735523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-95bd4da0-cf19-4898-b87e-6ef6180d5337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:10.735640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2da65-d269-4c9a-b4ca-a5eecbc2d478 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.735640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2da65-d269-4c9a-b4ca-a5eecbc2d478 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.735640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2da65-d269-4c9a-b4ca-a5eecbc2d478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.770386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a1d2da65-d269-4c9a-b4ca-a5eecbc2d478 None None] MFA Rules not processed for user `d6a22498fe6843649064d5906f061446`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:10.770386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a1d2da65-d269-4c9a-b4ca-a5eecbc2d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:10.829613 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1211/2436] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:10 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:10.830633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd4da0-cf19-4898-b87e-6ef6180d5337 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.856454 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1226/2437] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:10 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:10.868598 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2da65-d269-4c9a-b4ca-a5eecbc2d478 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.871343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a1d2da65-d269-4c9a-b4ca-a5eecbc2d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:10.878739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:10.936140 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd4da0-cf19-4898-b87e-6ef6180d5337 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.946556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17b531-3bfe-41d2-8eb5-91e94a74ab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.947446 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17b531-3bfe-41d2-8eb5-91e94a74ab24 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.947869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17b531-3bfe-41d2-8eb5-91e94a74ab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.948242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17b531-3bfe-41d2-8eb5-91e94a74ab24 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.949638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17b531-3bfe-41d2-8eb5-91e94a74ab24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.952490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17b531-3bfe-41d2-8eb5-91e94a74ab24 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:10.969130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2da65-d269-4c9a-b4ca-a5eecbc2d478 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:10.975856 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53078542-dd55-4f47-b80a-1e0d2631c8f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:10.977032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078542-dd55-4f47-b80a-1e0d2631c8f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:10.977416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078542-dd55-4f47-b80a-1e0d2631c8f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:10.977762 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078542-dd55-4f47-b80a-1e0d2631c8f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:10.983053 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1212/2438] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:10 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:10.987682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17b531-3bfe-41d2-8eb5-91e94a74ab24 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:10.990509 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53078542-dd55-4f47-b80a-1e0d2631c8f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:10.992110 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53078542-dd55-4f47-b80a-1e0d2631c8f7 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:11.002996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17b531-3bfe-41d2-8eb5-91e94a74ab24 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:11.010656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf99f55-d301-4f07-85f7-473958a89879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:11.011496 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf99f55-d301-4f07-85f7-473958a89879 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:11.012209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf99f55-d301-4f07-85f7-473958a89879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:11.012647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf99f55-d301-4f07-85f7-473958a89879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:11.013497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf99f55-d301-4f07-85f7-473958a89879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:11.016883 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf99f55-d301-4f07-85f7-473958a89879 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:11.017818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1227/2439] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:10 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:11.029430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1213/2440] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:11.035212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53078542-dd55-4f47-b80a-1e0d2631c8f7 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:11.050883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53078542-dd55-4f47-b80a-1e0d2631c8f7 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:11.056415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b934e9a-2d6d-49d8-a7d2-9d548ef1c111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:11.057770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934e9a-2d6d-49d8-a7d2-9d548ef1c111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:11.058192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934e9a-2d6d-49d8-a7d2-9d548ef1c111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:11.058659 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934e9a-2d6d-49d8-a7d2-9d548ef1c111 admin admin] PATH_INFO: `/v3/projects/868b1b321ac8407fb87e9472f2ab3991/users/536ff54fc44f4e91bf37165232ee6962/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:11.083116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b934e9a-2d6d-49d8-a7d2-9d548ef1c111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868b1b321ac8407fb87e9472f2ab3991, user_id=536ff54fc44f4e91bf37165232ee6962, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:11.086059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b934e9a-2d6d-49d8-a7d2-9d548ef1c111 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:11.101853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1228/2441] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:11 2022] PUT /identity/v3/projects/868b1b321ac8407fb87e9472f2ab3991/users/536ff54fc44f4e91bf37165232ee6962/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:11.105911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf99f55-d301-4f07-85f7-473958a89879 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:11.120396 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf99f55-d301-4f07-85f7-473958a89879 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:11.188372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b934e9a-2d6d-49d8-a7d2-9d548ef1c111 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:11.196659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:11.246180 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468d116-626a-43de-a93c-3450fdef0f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:11.246387 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468d116-626a-43de-a93c-3450fdef0f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:11.246806 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468d116-626a-43de-a93c-3450fdef0f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:11.247274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468d116-626a-43de-a93c-3450fdef0f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:11.248178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468d116-626a-43de-a93c-3450fdef0f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:11.250661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468d116-626a-43de-a93c-3450fdef0f8e admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:11.272663 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1214/2442] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:11.273820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468d116-626a-43de-a93c-3450fdef0f8e admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:11.278860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b934e9a-2d6d-49d8-a7d2-9d548ef1c111 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:11.284808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1669eb2-e031-4ddd-9eaa-85dd46c6da17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:11.285833 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468d116-626a-43de-a93c-3450fdef0f8e admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:11.286011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1669eb2-e031-4ddd-9eaa-85dd46c6da17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:11.287052 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1669eb2-e031-4ddd-9eaa-85dd46c6da17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:11.287403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1669eb2-e031-4ddd-9eaa-85dd46c6da17 admin admin] PATH_INFO: `/v3/users/6784f4ec8954476081a017b6754cc93a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:11.288806 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1669eb2-e031-4ddd-9eaa-85dd46c6da17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6784f4ec8954476081a017b6754cc93a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:11.290758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1669eb2-e031-4ddd-9eaa-85dd46c6da17 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:11.291033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f89a97-46bb-4fbf-bc3c-f94fbd834946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:11.291661 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f89a97-46bb-4fbf-bc3c-f94fbd834946 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:11.291977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f89a97-46bb-4fbf-bc3c-f94fbd834946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:11.292245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f89a97-46bb-4fbf-bc3c-f94fbd834946 admin admin] PATH_INFO: `/v3/projects/868b1b321ac8407fb87e9472f2ab3991/users/536ff54fc44f4e91bf37165232ee6962/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:11.294256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f89a97-46bb-4fbf-bc3c-f94fbd834946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868b1b321ac8407fb87e9472f2ab3991, user_id=536ff54fc44f4e91bf37165232ee6962, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:11.297950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f89a97-46bb-4fbf-bc3c-f94fbd834946 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:11.310576 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1215/2443] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:11 2022] PUT /identity/v3/projects/868b1b321ac8407fb87e9472f2ab3991/users/536ff54fc44f4e91bf37165232ee6962/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:11.323788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ed97-61aa-49a8-985c-7291a7a13337 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:11.323996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ed97-61aa-49a8-985c-7291a7a13337 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:11.324449 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ed97-61aa-49a8-985c-7291a7a13337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:11.359511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-06b0ed97-61aa-49a8-985c-7291a7a13337 None None] MFA Rules not processed for user `536ff54fc44f4e91bf37165232ee6962`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:11.360985 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-06b0ed97-61aa-49a8-985c-7291a7a13337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:11.365625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b1669eb2-e031-4ddd-9eaa-85dd46c6da17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6784f4ec8954476081a017b6754cc93a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:11.388836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b1669eb2-e031-4ddd-9eaa-85dd46c6da17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6784f4ec8954476081a017b6754cc93a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:11.400318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b1669eb2-e031-4ddd-9eaa-85dd46c6da17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6784f4ec8954476081a017b6754cc93a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:11.401080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b1669eb2-e031-4ddd-9eaa-85dd46c6da17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6784f4ec8954476081a017b6754cc93a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:11.420988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b1669eb2-e031-4ddd-9eaa-85dd46c6da17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6784f4ec8954476081a017b6754cc93a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:11.428796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:11.431070 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1229/2444] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:11 2022] DELETE /identity/v3/users/6784f4ec8954476081a017b6754cc93a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:11.437760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caefad6-8525-4253-8252-e89b6b3e1c1a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:11.438187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caefad6-8525-4253-8252-e89b6b3e1c1a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:11.438570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caefad6-8525-4253-8252-e89b6b3e1c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:11.461249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1216/2445] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:11.469845 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0ed97-61aa-49a8-985c-7291a7a13337 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:11.471545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-06b0ed97-61aa-49a8-985c-7291a7a13337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:11.473300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9caefad6-8525-4253-8252-e89b6b3e1c1a None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:11.476739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9caefad6-8525-4253-8252-e89b6b3e1c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:11.554603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0ed97-61aa-49a8-985c-7291a7a13337 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:11.564583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1230/2446] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:11.574168 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caefad6-8525-4253-8252-e89b6b3e1c1a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:11.581285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9caefad6-8525-4253-8252-e89b6b3e1c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:11.619659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2192ce-a6a3-407f-b5eb-e5c299896313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:11.620743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2192ce-a6a3-407f-b5eb-e5c299896313 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:11.621131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2192ce-a6a3-407f-b5eb-e5c299896313 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:11.622172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2192ce-a6a3-407f-b5eb-e5c299896313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:11.637684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:11.663155 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caefad6-8525-4253-8252-e89b6b3e1c1a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:11.667542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3ebff-1573-4495-b198-001f0d4d3bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:11.668210 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3ebff-1573-4495-b198-001f0d4d3bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:11.668492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3ebff-1573-4495-b198-001f0d4d3bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:11.668785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3ebff-1573-4495-b198-001f0d4d3bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:11.679278 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3ebff-1573-4495-b198-001f0d4d3bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:11.680852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3ebff-1573-4495-b198-001f0d4d3bd7 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:11.693095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1231/2447] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:11.714813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2192ce-a6a3-407f-b5eb-e5c299896313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:11.716383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2192ce-a6a3-407f-b5eb-e5c299896313 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:11.730100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1217/2448] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:11.820841 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3ebff-1573-4495-b198-001f0d4d3bd7 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:11.839289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3ebff-1573-4495-b198-001f0d4d3bd7 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:11.846514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6416c-2ddc-4c2d-82f4-bab20fb87d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:11.847893 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6416c-2ddc-4c2d-82f4-bab20fb87d24 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:11.848394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6416c-2ddc-4c2d-82f4-bab20fb87d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:11.849087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6416c-2ddc-4c2d-82f4-bab20fb87d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:11.852715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-82f6416c-2ddc-4c2d-82f4-bab20fb87d24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:11.939030 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6416c-2ddc-4c2d-82f4-bab20fb87d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:11.940570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6416c-2ddc-4c2d-82f4-bab20fb87d24 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:11.955772 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1232/2449] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:12.274517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2192ce-a6a3-407f-b5eb-e5c299896313 service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:12.276077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-cb2192ce-a6a3-407f-b5eb-e5c299896313 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:12.293690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2192ce-a6a3-407f-b5eb-e5c299896313 service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:12.304325 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:12.310457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:12.310735 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6416c-2ddc-4c2d-82f4-bab20fb87d24 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:12.311115 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:12.311645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] PATH_INFO: `/v3/projects/cd8557d0ad294cbeb7efea6f3f6f1437` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:12.313487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-82f6416c-2ddc-4c2d-82f4-bab20fb87d24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:12.313816 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8557d0ad294cbeb7efea6f3f6f1437)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:12.316400 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:12.332478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6416c-2ddc-4c2d-82f4-bab20fb87d24 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:12.338487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:12.339796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:12.340183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:12.340656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] PATH_INFO: `/v3/users/88986c2956fb4d41b4bcd44c5d62e472` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:12.342477 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=88986c2956fb4d41b4bcd44c5d62e472)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:12.345099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:12.392256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8557d0ad294cbeb7efea6f3f6f1437', 'request_id': 'req-3fc7966b-709f-4327-a649-162300bf8abb'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.396676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:12.403702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8557d0ad294cbeb7efea6f3f6f1437', 'request_id': 'req-3fc7966b-709f-4327-a649-162300bf8abb'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.412682 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88986c2956fb4d41b4bcd44c5d62e472'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.414064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8557d0ad294cbeb7efea6f3f6f1437', 'request_id': 'req-3fc7966b-709f-4327-a649-162300bf8abb'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.420750 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88986c2956fb4d41b4bcd44c5d62e472'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.429598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] The token cache is being invalidate because project cd8557d0ad294cbeb7efea6f3f6f1437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:12.429890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.430576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88986c2956fb4d41b4bcd44c5d62e472'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.430820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.431290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88986c2956fb4d41b4bcd44c5d62e472'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.432270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1218/2450] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:12 2022] DELETE /identity/v3/projects/cd8557d0ad294cbeb7efea6f3f6f1437 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:12.436479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:12.437894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:12.448909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88986c2956fb4d41b4bcd44c5d62e472'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.455454 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1233/2451] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:12 2022] DELETE /identity/v3/users/88986c2956fb4d41b4bcd44c5d62e472 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:12.509176 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7966b-709f-4327-a649-162300bf8abb admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:12.554295 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:12.591922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:12.592773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:12.593171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:12.594188 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] PATH_INFO: `/v3/users/d6a22498fe6843649064d5906f061446` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:12.595639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a22498fe6843649064d5906f061446)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:12.597806 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:12.651983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a22498fe6843649064d5906f061446'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.653102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:12.654841 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:12.666910 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a22498fe6843649064d5906f061446'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.667685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a22498fe6843649064d5906f061446'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.668520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a22498fe6843649064d5906f061446'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.668651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf3df6-25ff-4b39-a0f1-3cc6bd5af4bd admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:12.674366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:12.674984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:12.675266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:12.675537 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] PATH_INFO: `/v3/projects/58564d64f15647798af00e6b43436c4a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:12.676739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58564d64f15647798af00e6b43436c4a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:12.678688 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:12.695686 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a22498fe6843649064d5906f061446'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.709429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1219/2452] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:12 2022] DELETE /identity/v3/users/d6a22498fe6843649064d5906f061446 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:12.749464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58564d64f15647798af00e6b43436c4a', 'request_id': 'req-61c593b3-7d97-4e38-9813-383c6e53c650'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.757213 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58564d64f15647798af00e6b43436c4a', 'request_id': 'req-61c593b3-7d97-4e38-9813-383c6e53c650'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.765515 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58564d64f15647798af00e6b43436c4a', 'request_id': 'req-61c593b3-7d97-4e38-9813-383c6e53c650'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.785036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] The token cache is being invalidate because project 58564d64f15647798af00e6b43436c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:12.786033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.787393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:12.789923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1234/2453] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:12 2022] DELETE /identity/v3/projects/58564d64f15647798af00e6b43436c4a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:12.794264 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:12.795813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:12.885070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1153c4-9391-4007-8f04-7db8a4de4e18 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:12.977941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2914e84-e1ee-438e-9d67-693d6b263c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:12.978503 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2914e84-e1ee-438e-9d67-693d6b263c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:12.978792 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2914e84-e1ee-438e-9d67-693d6b263c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:12.979210 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2914e84-e1ee-438e-9d67-693d6b263c54 admin admin] PATH_INFO: `/v3/users/453cb50378814d269ac1d0f34f5d05b2` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:12.980605 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2914e84-e1ee-438e-9d67-693d6b263c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453cb50378814d269ac1d0f34f5d05b2)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:12.982585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2914e84-e1ee-438e-9d67-693d6b263c54 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:12.988390 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:13.017716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:13.020860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:13.043470 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c593b3-7d97-4e38-9813-383c6e53c650 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:13.049840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:13.050505 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.050903 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.051065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700 admin admin] PATH_INFO: `/v3/projects/2045278c85e94b0ebf54030312509162` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.052433 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2045278c85e94b0ebf54030312509162)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:13.054463 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:13.069047 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d2914e84-e1ee-438e-9d67-693d6b263c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453cb50378814d269ac1d0f34f5d05b2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.077996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d2914e84-e1ee-438e-9d67-693d6b263c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453cb50378814d269ac1d0f34f5d05b2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.078667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d2914e84-e1ee-438e-9d67-693d6b263c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453cb50378814d269ac1d0f34f5d05b2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.079767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d2914e84-e1ee-438e-9d67-693d6b263c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453cb50378814d269ac1d0f34f5d05b2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.093095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d2914e84-e1ee-438e-9d67-693d6b263c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453cb50378814d269ac1d0f34f5d05b2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.109916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1220/2454] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:12 2022] DELETE /identity/v3/users/453cb50378814d269ac1d0f34f5d05b2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:13.110404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2045278c85e94b0ebf54030312509162', 'request_id': 'req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.117095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2045278c85e94b0ebf54030312509162', 'request_id': 'req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.124134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2045278c85e94b0ebf54030312509162', 'request_id': 'req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.142056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700 admin admin] The token cache is being invalidate because project 2045278c85e94b0ebf54030312509162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:13.142352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.143048 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2501dfc2-79f1-4c75-ac3c-20c2ddfe2700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.145703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1235/2455] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:13 2022] DELETE /identity/v3/projects/2045278c85e94b0ebf54030312509162 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:13.150828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf1c2-0f56-4e2f-936a-0d99c3ec9a94 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.151127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf1c2-0f56-4e2f-936a-0d99c3ec9a94 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.151470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf1c2-0f56-4e2f-936a-0d99c3ec9a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.177547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-183cf1c2-0f56-4e2f-936a-0d99c3ec9a94 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:13.178984 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-183cf1c2-0f56-4e2f-936a-0d99c3ec9a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:13.258940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1221/2456] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:13.266728 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2447700-0228-4120-a671-5c2a77360522 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.267106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2447700-0228-4120-a671-5c2a77360522 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.267473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2447700-0228-4120-a671-5c2a77360522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.289636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c2447700-0228-4120-a671-5c2a77360522 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:13.291039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c2447700-0228-4120-a671-5c2a77360522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:13.301253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1236/2457] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:13.306030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cf1c2-0f56-4e2f-936a-0d99c3ec9a94 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:13.318014 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cf1c2-0f56-4e2f-936a-0d99c3ec9a94 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:13.330803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2447700-0228-4120-a671-5c2a77360522 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:13.332265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c2447700-0228-4120-a671-5c2a77360522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:13.333544 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff216df-1c5c-45e3-85be-96eb01cddec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:13.335131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff216df-1c5c-45e3-85be-96eb01cddec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.335623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff216df-1c5c-45e3-85be-96eb01cddec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.336895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff216df-1c5c-45e3-85be-96eb01cddec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.337584 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff216df-1c5c-45e3-85be-96eb01cddec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:13.337928 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff216df-1c5c-45e3-85be-96eb01cddec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:13.340069 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff216df-1c5c-45e3-85be-96eb01cddec6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:13.349995 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2447700-0228-4120-a671-5c2a77360522 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:13.358012 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36defa8-6a6a-4d89-b388-1acdfe25a397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:13.359586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36defa8-6a6a-4d89-b388-1acdfe25a397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.359586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36defa8-6a6a-4d89-b388-1acdfe25a397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.359955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36defa8-6a6a-4d89-b388-1acdfe25a397 admin admin] PATH_INFO: `/v3/projects/3f9598aa99df4628872c32172ef05b1a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.361243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36defa8-6a6a-4d89-b388-1acdfe25a397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9598aa99df4628872c32172ef05b1a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:13.361481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1222/2458] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:13.363444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36defa8-6a6a-4d89-b388-1acdfe25a397 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:13.366966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff216df-1c5c-45e3-85be-96eb01cddec6 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:13.374316 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:13.382630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff216df-1c5c-45e3-85be-96eb01cddec6 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:13.391219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ee10-63cd-4626-979f-7d888632d4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:13.392256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ee10-63cd-4626-979f-7d888632d4db admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.392721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ee10-63cd-4626-979f-7d888632d4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.393145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ee10-63cd-4626-979f-7d888632d4db admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.394189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7ee10-63cd-4626-979f-7d888632d4db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:13.399032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7ee10-63cd-4626-979f-7d888632d4db admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:13.431010 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e36defa8-6a6a-4d89-b388-1acdfe25a397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9598aa99df4628872c32172ef05b1a', 'request_id': 'req-e36defa8-6a6a-4d89-b388-1acdfe25a397'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.446245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1223/2459] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:13 2022] POST /identity/v3/projects => generated 357 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:13.446438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e36defa8-6a6a-4d89-b388-1acdfe25a397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9598aa99df4628872c32172ef05b1a', 'request_id': 'req-e36defa8-6a6a-4d89-b388-1acdfe25a397'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.447648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ee10-63cd-4626-979f-7d888632d4db admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:13.465028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e36defa8-6a6a-4d89-b388-1acdfe25a397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9598aa99df4628872c32172ef05b1a', 'request_id': 'req-e36defa8-6a6a-4d89-b388-1acdfe25a397'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.485414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e36defa8-6a6a-4d89-b388-1acdfe25a397 admin admin] The token cache is being invalidate because project 3f9598aa99df4628872c32172ef05b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:13.485716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e36defa8-6a6a-4d89-b388-1acdfe25a397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.486399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e36defa8-6a6a-4d89-b388-1acdfe25a397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:13.488171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1237/2460] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:13 2022] DELETE /identity/v3/projects/3f9598aa99df4628872c32172ef05b1a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:13.493366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069c0f4-1343-4938-8e0e-1486f7d31ee3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.493654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069c0f4-1343-4938-8e0e-1486f7d31ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.494036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069c0f4-1343-4938-8e0e-1486f7d31ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.517601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:13.538162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4069c0f4-1343-4938-8e0e-1486f7d31ee3 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:13.543486 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ee10-63cd-4626-979f-7d888632d4db admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:13.548379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4069c0f4-1343-4938-8e0e-1486f7d31ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:13.568827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade9559-19fa-4043-9341-fc304e643562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:13.570061 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade9559-19fa-4043-9341-fc304e643562 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.571567 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade9559-19fa-4043-9341-fc304e643562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.572031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade9559-19fa-4043-9341-fc304e643562 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.574359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade9559-19fa-4043-9341-fc304e643562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:13.576748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade9559-19fa-4043-9341-fc304e643562 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:13.582969 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1238/2461] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:13.594003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0b25c-7b63-463e-ba9f-5c6dc1422203 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.594415 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0b25c-7b63-463e-ba9f-5c6dc1422203 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.594830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0b25c-7b63-463e-ba9f-5c6dc1422203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.610711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1224/2462] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:13 2022] POST /identity/v3/users => generated 279 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:13.616106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade9559-19fa-4043-9341-fc304e643562 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:13.620845 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8ade9559-19fa-4043-9341-fc304e643562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:13.626702 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-95c0b25c-7b63-463e-ba9f-5c6dc1422203 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:13.628003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-95c0b25c-7b63-463e-ba9f-5c6dc1422203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:13.637816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1239/2463] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:13.642481 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0b25c-7b63-463e-ba9f-5c6dc1422203 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:13.642707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade9559-19fa-4043-9341-fc304e643562 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:13.648711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b8cb0-79fd-479e-9046-f712381bb379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:13.649716 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b8cb0-79fd-479e-9046-f712381bb379 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.649988 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b8cb0-79fd-479e-9046-f712381bb379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.650377 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b8cb0-79fd-479e-9046-f712381bb379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.651876 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b8cb0-79fd-479e-9046-f712381bb379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:13.653398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0b25c-7b63-463e-ba9f-5c6dc1422203 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:13.660711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b8cb0-79fd-479e-9046-f712381bb379 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:13.661091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f4e35-f029-4429-9f0d-bb8df5d1fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:13.661802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f4e35-f029-4429-9f0d-bb8df5d1fdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.662296 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f4e35-f029-4429-9f0d-bb8df5d1fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.662576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f4e35-f029-4429-9f0d-bb8df5d1fdf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.663237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f4e35-f029-4429-9f0d-bb8df5d1fdf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:13.663602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f4e35-f029-4429-9f0d-bb8df5d1fdf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:13.665571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f4e35-f029-4429-9f0d-bb8df5d1fdf9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:13.679587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1225/2464] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:13.680912 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1240/2465] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:13.681041 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b8cb0-79fd-479e-9046-f712381bb379 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:13.685284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f4e35-f029-4429-9f0d-bb8df5d1fdf9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:13.691980 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b8cb0-79fd-479e-9046-f712381bb379 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:13.695718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f4e35-f029-4429-9f0d-bb8df5d1fdf9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:13.696671 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a77909-223f-4464-84ff-b8ca08ff41c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:13.697273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a77909-223f-4464-84ff-b8ca08ff41c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.697555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a77909-223f-4464-84ff-b8ca08ff41c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.697828 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a77909-223f-4464-84ff-b8ca08ff41c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.698464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a77909-223f-4464-84ff-b8ca08ff41c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:13.700283 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a77909-223f-4464-84ff-b8ca08ff41c4 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:13.703244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b388a0-8fea-4770-92c6-620e07fe15cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:13.704057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b388a0-8fea-4770-92c6-620e07fe15cf admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.704343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b388a0-8fea-4770-92c6-620e07fe15cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.704621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b388a0-8fea-4770-92c6-620e07fe15cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.705279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b388a0-8fea-4770-92c6-620e07fe15cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:13.707217 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b388a0-8fea-4770-92c6-620e07fe15cf admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:13.713170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1226/2466] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:13.717990 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a77909-223f-4464-84ff-b8ca08ff41c4 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:13.741261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a77909-223f-4464-84ff-b8ca08ff41c4 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:13.745902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98a4d6-261b-4349-bbe4-17c3301ca33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:13.746593 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98a4d6-261b-4349-bbe4-17c3301ca33a admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.746881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98a4d6-261b-4349-bbe4-17c3301ca33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.747158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98a4d6-261b-4349-bbe4-17c3301ca33a admin admin] PATH_INFO: `/v3/projects/f0f9beff8b4a43ffb6d1f15819b59a63/users/093dd19e5b1340c28d4a46990d221d71/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.761789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1241/2467] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:13 2022] POST /identity/v3/projects => generated 361 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:13.767180 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b388a0-8fea-4770-92c6-620e07fe15cf admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:13.770873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98a4d6-261b-4349-bbe4-17c3301ca33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f9beff8b4a43ffb6d1f15819b59a63, user_id=093dd19e5b1340c28d4a46990d221d71, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:13.775614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98a4d6-261b-4349-bbe4-17c3301ca33a admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:13.792165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1227/2468] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:13 2022] PUT /identity/v3/projects/f0f9beff8b4a43ffb6d1f15819b59a63/users/093dd19e5b1340c28d4a46990d221d71/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:13.803770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4188ce3-48d1-4e6b-99ed-0014770a6b76 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.804129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4188ce3-48d1-4e6b-99ed-0014770a6b76 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.804395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4188ce3-48d1-4e6b-99ed-0014770a6b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.837095 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-f4188ce3-48d1-4e6b-99ed-0014770a6b76 None None] MFA Rules not processed for user `093dd19e5b1340c28d4a46990d221d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:13.838466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f4188ce3-48d1-4e6b-99ed-0014770a6b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:13.854387 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b388a0-8fea-4770-92c6-620e07fe15cf admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:13.911410 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:13.920083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1228/2469] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:13.921197 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4188ce3-48d1-4e6b-99ed-0014770a6b76 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:13.926546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000720-9b99-4b01-a862-dea5aa74c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:13.927858 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000720-9b99-4b01-a862-dea5aa74c806 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.928749 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000720-9b99-4b01-a862-dea5aa74c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.929299 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000720-9b99-4b01-a862-dea5aa74c806 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.930707 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34000720-9b99-4b01-a862-dea5aa74c806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:13.933220 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4188ce3-48d1-4e6b-99ed-0014770a6b76 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:13.933880 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34000720-9b99-4b01-a862-dea5aa74c806 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:13.938603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d71176-16ae-45aa-986d-2e26cb408f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:13.939222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d71176-16ae-45aa-986d-2e26cb408f9d admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:13.939508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d71176-16ae-45aa-986d-2e26cb408f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:13.939820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d71176-16ae-45aa-986d-2e26cb408f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:13.940584 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d71176-16ae-45aa-986d-2e26cb408f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:13.942599 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d71176-16ae-45aa-986d-2e26cb408f9d admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:13.956529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1242/2470] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:13 2022] POST /identity/v3/users => generated 281 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:13.960704 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000720-9b99-4b01-a862-dea5aa74c806 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:13.972011 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000720-9b99-4b01-a862-dea5aa74c806 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:13.972443 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1229/2471] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:13 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:13.976578 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d71176-16ae-45aa-986d-2e26cb408f9d admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.041249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a60121-2f98-47f9-8cba-184f32d891e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.041780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a60121-2f98-47f9-8cba-184f32d891e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.042068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a60121-2f98-47f9-8cba-184f32d891e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.042346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a60121-2f98-47f9-8cba-184f32d891e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.043012 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a60121-2f98-47f9-8cba-184f32d891e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.043657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d71176-16ae-45aa-986d-2e26cb408f9d admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.044688 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a60121-2f98-47f9-8cba-184f32d891e2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.049839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86810a2e-963b-429d-89dd-ca8cd9da03bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.050460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86810a2e-963b-429d-89dd-ca8cd9da03bf admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.051250 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86810a2e-963b-429d-89dd-ca8cd9da03bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.051532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86810a2e-963b-429d-89dd-ca8cd9da03bf admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.052589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86810a2e-963b-429d-89dd-ca8cd9da03bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.054450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86810a2e-963b-429d-89dd-ca8cd9da03bf admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.055985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1243/2472] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:14.061049 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a60121-2f98-47f9-8cba-184f32d891e2 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.064523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:14.073740 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a60121-2f98-47f9-8cba-184f32d891e2 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.080968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1230/2473] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:13 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:14.084047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71765e-8806-4867-a81b-501fbf6338be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.084805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71765e-8806-4867-a81b-501fbf6338be admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.085093 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71765e-8806-4867-a81b-501fbf6338be admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.085394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71765e-8806-4867-a81b-501fbf6338be admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.085785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86810a2e-963b-429d-89dd-ca8cd9da03bf admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.086156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71765e-8806-4867-a81b-501fbf6338be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.087905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71765e-8806-4867-a81b-501fbf6338be admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.096343 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86810a2e-963b-429d-89dd-ca8cd9da03bf admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.102162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cd444-4eb1-45ad-adc6-693d5f5e2f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.102372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1244/2474] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:14.102775 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cd444-4eb1-45ad-adc6-693d5f5e2f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.103058 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cd444-4eb1-45ad-adc6-693d5f5e2f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.103330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cd444-4eb1-45ad-adc6-693d5f5e2f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.104015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cd444-4eb1-45ad-adc6-693d5f5e2f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.105598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cd444-4eb1-45ad-adc6-693d5f5e2f9f admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.106518 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71765e-8806-4867-a81b-501fbf6338be admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.117381 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1231/2475] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:14.119395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71765e-8806-4867-a81b-501fbf6338be admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.123248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cd444-4eb1-45ad-adc6-693d5f5e2f9f admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.124906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05a9ec-36f3-409f-9a91-1c1a74b194d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.125568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05a9ec-36f3-409f-9a91-1c1a74b194d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.125848 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05a9ec-36f3-409f-9a91-1c1a74b194d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.126122 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05a9ec-36f3-409f-9a91-1c1a74b194d9 admin admin] PATH_INFO: `/v3/projects/a6c6b27dc9dc4211a1dbe4b913b7de84/users/8d1f36dbe98849c2a951adf96776ce7e/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.136479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cd444-4eb1-45ad-adc6-693d5f5e2f9f admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.142563 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05a9ec-36f3-409f-9a91-1c1a74b194d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c6b27dc9dc4211a1dbe4b913b7de84, user_id=8d1f36dbe98849c2a951adf96776ce7e, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.142738 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315f6fb-3b4e-4153-8db6-aae8a18e405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.143365 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315f6fb-3b4e-4153-8db6-aae8a18e405e admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.143651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315f6fb-3b4e-4153-8db6-aae8a18e405e admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.143973 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315f6fb-3b4e-4153-8db6-aae8a18e405e admin admin] PATH_INFO: `/v3/projects/5d8cbf5831b84c9fbecb371d8744bb34/users/19ed0c118e164a73806c35a379f6c79b/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.145263 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05a9ec-36f3-409f-9a91-1c1a74b194d9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.164292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1245/2476] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:14 2022] PUT /identity/v3/projects/a6c6b27dc9dc4211a1dbe4b913b7de84/users/8d1f36dbe98849c2a951adf96776ce7e/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:14.164542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315f6fb-3b4e-4153-8db6-aae8a18e405e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8cbf5831b84c9fbecb371d8744bb34, user_id=19ed0c118e164a73806c35a379f6c79b, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.167216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315f6fb-3b4e-4153-8db6-aae8a18e405e admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.181290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b9fa-5ec3-432b-a6b8-7ed73d410cd4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.181626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b9fa-5ec3-432b-a6b8-7ed73d410cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.181861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b9fa-5ec3-432b-a6b8-7ed73d410cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.185940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1232/2477] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:14 2022] PUT /identity/v3/projects/5d8cbf5831b84c9fbecb371d8744bb34/users/19ed0c118e164a73806c35a379f6c79b/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:14.190591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315f6fb-3b4e-4153-8db6-aae8a18e405e admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.218029 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c463b9fa-5ec3-432b-a6b8-7ed73d410cd4 None None] MFA Rules not processed for user `8d1f36dbe98849c2a951adf96776ce7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:14.219429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c463b9fa-5ec3-432b-a6b8-7ed73d410cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:14.259213 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315f6fb-3b4e-4153-8db6-aae8a18e405e admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.264043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a667c6b-2daf-496b-b587-3eefc13ad462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.264665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a667c6b-2daf-496b-b587-3eefc13ad462 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.265004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a667c6b-2daf-496b-b587-3eefc13ad462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.265296 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a667c6b-2daf-496b-b587-3eefc13ad462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.265950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a667c6b-2daf-496b-b587-3eefc13ad462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.267581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a667c6b-2daf-496b-b587-3eefc13ad462 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.281796 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1233/2478] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:14.284885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a667c6b-2daf-496b-b587-3eefc13ad462 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.298763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a667c6b-2daf-496b-b587-3eefc13ad462 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.301651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1246/2479] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:14.306177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463b9fa-5ec3-432b-a6b8-7ed73d410cd4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.307224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20335e4-e4ac-448b-8c18-313841cb062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.307947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20335e4-e4ac-448b-8c18-313841cb062e admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.308287 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20335e4-e4ac-448b-8c18-313841cb062e admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.308574 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20335e4-e4ac-448b-8c18-313841cb062e admin admin] PATH_INFO: `/v3/projects/5d8cbf5831b84c9fbecb371d8744bb34/users/19ed0c118e164a73806c35a379f6c79b/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.310760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20335e4-e4ac-448b-8c18-313841cb062e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8cbf5831b84c9fbecb371d8744bb34, user_id=19ed0c118e164a73806c35a379f6c79b, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.314413 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20335e4-e4ac-448b-8c18-313841cb062e admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.320215 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463b9fa-5ec3-432b-a6b8-7ed73d410cd4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.325898 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1234/2480] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:14 2022] PUT /identity/v3/projects/5d8cbf5831b84c9fbecb371d8744bb34/users/19ed0c118e164a73806c35a379f6c79b/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:14.337879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc48cd-7c35-43d9-95d7-e7ebaf381823 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.338174 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc48cd-7c35-43d9-95d7-e7ebaf381823 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.338453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc48cd-7c35-43d9-95d7-e7ebaf381823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.359271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:14.375370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-27dc48cd-7c35-43d9-95d7-e7ebaf381823 None None] MFA Rules not processed for user `19ed0c118e164a73806c35a379f6c79b`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:14.376657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-27dc48cd-7c35-43d9-95d7-e7ebaf381823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:14.392814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bea6a8-c4cf-4776-94c0-ff1d41d161f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.393628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bea6a8-c4cf-4776-94c0-ff1d41d161f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.393628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bea6a8-c4cf-4776-94c0-ff1d41d161f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.394066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bea6a8-c4cf-4776-94c0-ff1d41d161f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.394654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bea6a8-c4cf-4776-94c0-ff1d41d161f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.396712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bea6a8-c4cf-4776-94c0-ff1d41d161f9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.425633 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1247/2481] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:14 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:14.430000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bea6a8-c4cf-4776-94c0-ff1d41d161f9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.475561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1235/2482] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:14.489988 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc48cd-7c35-43d9-95d7-e7ebaf381823 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.491625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-27dc48cd-7c35-43d9-95d7-e7ebaf381823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:14.504586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bea6a8-c4cf-4776-94c0-ff1d41d161f9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.509421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430ee2a-18b6-4cc1-a4bd-d70184dd60f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.510034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430ee2a-18b6-4cc1-a4bd-d70184dd60f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.510311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430ee2a-18b6-4cc1-a4bd-d70184dd60f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.510615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430ee2a-18b6-4cc1-a4bd-d70184dd60f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.511247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430ee2a-18b6-4cc1-a4bd-d70184dd60f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.513216 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430ee2a-18b6-4cc1-a4bd-d70184dd60f9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.520487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:14.537022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1248/2483] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:14 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:14.541220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430ee2a-18b6-4cc1-a4bd-d70184dd60f9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.553073 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430ee2a-18b6-4cc1-a4bd-d70184dd60f9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.558492 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc48cd-7c35-43d9-95d7-e7ebaf381823 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.564571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbc6fd-5cb5-4975-b23e-50cb25c2efc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.565280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbc6fd-5cb5-4975-b23e-50cb25c2efc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.565565 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbc6fd-5cb5-4975-b23e-50cb25c2efc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.565837 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbc6fd-5cb5-4975-b23e-50cb25c2efc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.566500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbc6fd-5cb5-4975-b23e-50cb25c2efc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.568186 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbc6fd-5cb5-4975-b23e-50cb25c2efc8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.588225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1249/2484] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:14.589679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbc6fd-5cb5-4975-b23e-50cb25c2efc8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.601685 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbc6fd-5cb5-4975-b23e-50cb25c2efc8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.606865 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b17ca-76f6-41b2-985d-4ff7087bbca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.607545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b17ca-76f6-41b2-985d-4ff7087bbca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.607863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b17ca-76f6-41b2-985d-4ff7087bbca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.608144 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b17ca-76f6-41b2-985d-4ff7087bbca9 admin admin] PATH_INFO: `/v3/projects/5a2b5e028e6a47649ae08e809806e8c9/users/fa7cc078ca354dd0a07e999778e16358/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.619242 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268730d-3bb4-4572-885c-d96c584d5148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.619893 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268730d-3bb4-4572-885c-d96c584d5148 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.620171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268730d-3bb4-4572-885c-d96c584d5148 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.620427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268730d-3bb4-4572-885c-d96c584d5148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.628599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b17ca-76f6-41b2-985d-4ff7087bbca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2b5e028e6a47649ae08e809806e8c9, user_id=fa7cc078ca354dd0a07e999778e16358, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.631407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b17ca-76f6-41b2-985d-4ff7087bbca9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.649746 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1250/2485] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:14 2022] PUT /identity/v3/projects/5a2b5e028e6a47649ae08e809806e8c9/users/fa7cc078ca354dd0a07e999778e16358/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:14.653635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b17ca-76f6-41b2-985d-4ff7087bbca9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.689236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268730d-3bb4-4572-885c-d96c584d5148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.690671 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268730d-3bb4-4572-885c-d96c584d5148 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.701563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1236/2486] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:14.754129 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b17ca-76f6-41b2-985d-4ff7087bbca9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.763336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca8e88-cf20-46b8-98e1-d28da9573e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.764438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca8e88-cf20-46b8-98e1-d28da9573e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.765796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca8e88-cf20-46b8-98e1-d28da9573e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.765796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca8e88-cf20-46b8-98e1-d28da9573e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.766398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca8e88-cf20-46b8-98e1-d28da9573e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.769291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca8e88-cf20-46b8-98e1-d28da9573e54 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.788454 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1251/2487] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:14.791255 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268730d-3bb4-4572-885c-d96c584d5148 service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.792615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca8e88-cf20-46b8-98e1-d28da9573e54 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:14.804204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca8e88-cf20-46b8-98e1-d28da9573e54 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.804366 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268730d-3bb4-4572-885c-d96c584d5148 service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:14.810034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaf982-af10-40bb-95af-c78838799e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.810839 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaf982-af10-40bb-95af-c78838799e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.811186 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaf982-af10-40bb-95af-c78838799e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.811530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaf982-af10-40bb-95af-c78838799e30 admin admin] PATH_INFO: `/v3/projects/5a2b5e028e6a47649ae08e809806e8c9/users/fa7cc078ca354dd0a07e999778e16358/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.813889 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaf982-af10-40bb-95af-c78838799e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2b5e028e6a47649ae08e809806e8c9, user_id=fa7cc078ca354dd0a07e999778e16358, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.816860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaf982-af10-40bb-95af-c78838799e30 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.824382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:14.835397 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1252/2488] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:14 2022] PUT /identity/v3/projects/5a2b5e028e6a47649ae08e809806e8c9/users/fa7cc078ca354dd0a07e999778e16358/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:14.848403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8fe6c-c0b0-4e6e-a293-150e9b879690 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.848732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8fe6c-c0b0-4e6e-a293-150e9b879690 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.849501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8fe6c-c0b0-4e6e-a293-150e9b879690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.868534 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78fde2-1027-469c-aa4f-c02cf1a4ee4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:14.869157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78fde2-1027-469c-aa4f-c02cf1a4ee4d service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:14.869441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78fde2-1027-469c-aa4f-c02cf1a4ee4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:14.869711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78fde2-1027-469c-aa4f-c02cf1a4ee4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:14.899087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f4c8fe6c-c0b0-4e6e-a293-150e9b879690 None None] MFA Rules not processed for user `fa7cc078ca354dd0a07e999778e16358`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:14.901056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f4c8fe6c-c0b0-4e6e-a293-150e9b879690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:14.940366 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:14.963286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78fde2-1027-469c-aa4f-c02cf1a4ee4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:14.966071 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78fde2-1027-469c-aa4f-c02cf1a4ee4d service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:14.978866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1237/2489] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:15.024587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1253/2490] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:15.036257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78fde2-1027-469c-aa4f-c02cf1a4ee4d service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:15.037709 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-da78fde2-1027-469c-aa4f-c02cf1a4ee4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:15.054772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78fde2-1027-469c-aa4f-c02cf1a4ee4d service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:15.116495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8fa1a-c852-461b-97a1-b854dbb428c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:15.117108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8fa1a-c852-461b-97a1-b854dbb428c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:15.117393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8fa1a-c852-461b-97a1-b854dbb428c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:15.117667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8fa1a-c852-461b-97a1-b854dbb428c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:15.135569 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8fa1a-c852-461b-97a1-b854dbb428c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:15.137221 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8fa1a-c852-461b-97a1-b854dbb428c9 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:15.149543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1238/2491] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:15.244445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8fe6c-c0b0-4e6e-a293-150e9b879690 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:15.254938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8fe6c-c0b0-4e6e-a293-150e9b879690 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:15.258717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61218db5-0b63-4e7c-8e99-e384a2e3a4a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:15.259329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61218db5-0b63-4e7c-8e99-e384a2e3a4a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:15.259607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61218db5-0b63-4e7c-8e99-e384a2e3a4a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:15.259921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61218db5-0b63-4e7c-8e99-e384a2e3a4a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:15.326423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61218db5-0b63-4e7c-8e99-e384a2e3a4a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:15.327869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61218db5-0b63-4e7c-8e99-e384a2e3a4a6 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:15.341328 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1254/2492] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:21.564541 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8fa1a-c852-461b-97a1-b854dbb428c9 service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:21.630696 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8fa1a-c852-461b-97a1-b854dbb428c9 service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:21.635472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:21.636206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:21.636492 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:21.636769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] PATH_INFO: `/v3/users/8d1f36dbe98849c2a951adf96776ce7e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:21.637925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1f36dbe98849c2a951adf96776ce7e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:21.640371 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:21.700528 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1f36dbe98849c2a951adf96776ce7e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:21.715417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1f36dbe98849c2a951adf96776ce7e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:21.716259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1f36dbe98849c2a951adf96776ce7e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:21.716908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1f36dbe98849c2a951adf96776ce7e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:21.732701 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1f36dbe98849c2a951adf96776ce7e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:21.746996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1239/2493] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:21 2022] DELETE /identity/v3/users/8d1f36dbe98849c2a951adf96776ce7e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:21.751579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b4bc7-f6ce-4582-adc7-4c6b57fb097c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:21.752140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b4bc7-f6ce-4582-adc7-4c6b57fb097c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:21.752140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b4bc7-f6ce-4582-adc7-4c6b57fb097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:21.772124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8d5b4bc7-f6ce-4582-adc7-4c6b57fb097c None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:21.773357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8d5b4bc7-f6ce-4582-adc7-4c6b57fb097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:21.851771 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1255/2494] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:21.860072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:21.861577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:21.868750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:21.950062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b1bf6-0bbd-4d91-899e-7f958495b77b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:21.956906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950febe-c72b-488f-96ed-28effb1ad1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:21.957877 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950febe-c72b-488f-96ed-28effb1ad1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:21.958351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950febe-c72b-488f-96ed-28effb1ad1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:21.958796 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950febe-c72b-488f-96ed-28effb1ad1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:21.971506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950febe-c72b-488f-96ed-28effb1ad1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:21.973061 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950febe-c72b-488f-96ed-28effb1ad1f3 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:21.984182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1240/2495] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:22.297977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b4bc7-f6ce-4582-adc7-4c6b57fb097c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:22.299943 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8d5b4bc7-f6ce-4582-adc7-4c6b57fb097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:22.314208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b4bc7-f6ce-4582-adc7-4c6b57fb097c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:22.323717 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:22.324473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:22.324763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:22.325043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] PATH_INFO: `/v3/projects/a6c6b27dc9dc4211a1dbe4b913b7de84` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:22.326412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c6b27dc9dc4211a1dbe4b913b7de84)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:22.334611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:22.354731 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:22.391274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c6b27dc9dc4211a1dbe4b913b7de84', 'request_id': 'req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:22.397080 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c6b27dc9dc4211a1dbe4b913b7de84', 'request_id': 'req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:22.403754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c6b27dc9dc4211a1dbe4b913b7de84', 'request_id': 'req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:22.427192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] The token cache is being invalidate because project a6c6b27dc9dc4211a1dbe4b913b7de84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:22.427598 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:22.428572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:22.430807 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1256/2496] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:22 2022] DELETE /identity/v3/projects/a6c6b27dc9dc4211a1dbe4b913b7de84 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:22.435086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950febe-c72b-488f-96ed-28effb1ad1f3 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:22.446143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950febe-c72b-488f-96ed-28effb1ad1f3 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:22.512285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6fe68-22d7-4f29-a929-f5b105737138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:22.512925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6fe68-22d7-4f29-a929-f5b105737138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:22.513203 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6fe68-22d7-4f29-a929-f5b105737138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:22.513475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6fe68-22d7-4f29-a929-f5b105737138 admin admin] PATH_INFO: `/v3/users/fa7cc078ca354dd0a07e999778e16358` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:22.514676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6fe68-22d7-4f29-a929-f5b105737138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7cc078ca354dd0a07e999778e16358)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:22.516710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6fe68-22d7-4f29-a929-f5b105737138 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:22.579091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e6d6fe68-22d7-4f29-a929-f5b105737138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7cc078ca354dd0a07e999778e16358'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:22.588715 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e6d6fe68-22d7-4f29-a929-f5b105737138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7cc078ca354dd0a07e999778e16358'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:22.589518 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e6d6fe68-22d7-4f29-a929-f5b105737138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7cc078ca354dd0a07e999778e16358'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:22.590314 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e6d6fe68-22d7-4f29-a929-f5b105737138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7cc078ca354dd0a07e999778e16358'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:22.614002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e6d6fe68-22d7-4f29-a929-f5b105737138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7cc078ca354dd0a07e999778e16358'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:22.642040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1241/2497] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:22 2022] DELETE /identity/v3/users/fa7cc078ca354dd0a07e999778e16358 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:22.958086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:22.959554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:22.974562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db4853-3220-42b1-a0b3-5b1f1b18c3d1 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:23.042735 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8a526-f942-4db9-8038-92e36d020ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:23.043392 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8a526-f942-4db9-8038-92e36d020ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:23.043669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8a526-f942-4db9-8038-92e36d020ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:23.043976 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8a526-f942-4db9-8038-92e36d020ec1 admin admin] PATH_INFO: `/v3/projects/5a2b5e028e6a47649ae08e809806e8c9` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:23.045189 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8a526-f942-4db9-8038-92e36d020ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a2b5e028e6a47649ae08e809806e8c9)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:23.047137 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8a526-f942-4db9-8038-92e36d020ec1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:23.095147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-58d8a526-f942-4db9-8038-92e36d020ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a2b5e028e6a47649ae08e809806e8c9', 'request_id': 'req-58d8a526-f942-4db9-8038-92e36d020ec1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:23.100590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-58d8a526-f942-4db9-8038-92e36d020ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a2b5e028e6a47649ae08e809806e8c9', 'request_id': 'req-58d8a526-f942-4db9-8038-92e36d020ec1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:23.106886 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-58d8a526-f942-4db9-8038-92e36d020ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a2b5e028e6a47649ae08e809806e8c9', 'request_id': 'req-58d8a526-f942-4db9-8038-92e36d020ec1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:23.122981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-58d8a526-f942-4db9-8038-92e36d020ec1 admin admin] The token cache is being invalidate because project 5a2b5e028e6a47649ae08e809806e8c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:23.123250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-58d8a526-f942-4db9-8038-92e36d020ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:23.123941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-58d8a526-f942-4db9-8038-92e36d020ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:23.125985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1257/2498] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:22 2022] DELETE /identity/v3/projects/5a2b5e028e6a47649ae08e809806e8c9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:23.130963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2556c6-3b6c-4693-988e-920b0f1cde28 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:23.131261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2556c6-3b6c-4693-988e-920b0f1cde28 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:23.131546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2556c6-3b6c-4693-988e-920b0f1cde28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:23.157696 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-ee2556c6-3b6c-4693-988e-920b0f1cde28 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:23.158929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ee2556c6-3b6c-4693-988e-920b0f1cde28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:23.182104 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:23.232836 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1242/2499] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:23.241352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870f07d-b712-4634-8849-c9a8fc6b98ff None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:23.241516 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870f07d-b712-4634-8849-c9a8fc6b98ff None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:23.241772 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870f07d-b712-4634-8849-c9a8fc6b98ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:23.263119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4870f07d-b712-4634-8849-c9a8fc6b98ff None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:23.264399 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4870f07d-b712-4634-8849-c9a8fc6b98ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:23.272671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1258/2500] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:23.277003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2556c6-3b6c-4693-988e-920b0f1cde28 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:23.287294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2556c6-3b6c-4693-988e-920b0f1cde28 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:23.292499 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bd88c-8bb2-43a2-95fa-061056d48711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:23.293245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bd88c-8bb2-43a2-95fa-061056d48711 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:23.293480 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bd88c-8bb2-43a2-95fa-061056d48711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:23.293829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bd88c-8bb2-43a2-95fa-061056d48711 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:23.294592 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bd88c-8bb2-43a2-95fa-061056d48711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:23.294922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bd88c-8bb2-43a2-95fa-061056d48711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:23.297157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bd88c-8bb2-43a2-95fa-061056d48711 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:23.314336 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1243/2501] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:23.315474 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870f07d-b712-4634-8849-c9a8fc6b98ff None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:23.324760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870f07d-b712-4634-8849-c9a8fc6b98ff None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:23.329569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1efd-de24-426e-8474-da4bccad266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:23.330194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1efd-de24-426e-8474-da4bccad266b admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:23.330473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1efd-de24-426e-8474-da4bccad266b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:23.330744 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1efd-de24-426e-8474-da4bccad266b admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:23.331520 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a1efd-de24-426e-8474-da4bccad266b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:23.333530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a1efd-de24-426e-8474-da4bccad266b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:23.366258 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1259/2502] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:23 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:23.370634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bd88c-8bb2-43a2-95fa-061056d48711 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:23.382925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bd88c-8bb2-43a2-95fa-061056d48711 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:23.448221 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88415e7e-be8f-4ea3-8676-35f4e0ebec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:23.448832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88415e7e-be8f-4ea3-8676-35f4e0ebec4f admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:23.449233 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88415e7e-be8f-4ea3-8676-35f4e0ebec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:23.449534 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88415e7e-be8f-4ea3-8676-35f4e0ebec4f admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:23.450171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88415e7e-be8f-4ea3-8676-35f4e0ebec4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:23.452194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88415e7e-be8f-4ea3-8676-35f4e0ebec4f admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:23.482831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1244/2503] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:23 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:23.490213 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1efd-de24-426e-8474-da4bccad266b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:23.506500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1efd-de24-426e-8474-da4bccad266b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:23.511844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9714f2-cba0-487a-b9b0-e271ce5bc152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:23.512478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9714f2-cba0-487a-b9b0-e271ce5bc152 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:23.512765 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9714f2-cba0-487a-b9b0-e271ce5bc152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:23.513040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9714f2-cba0-487a-b9b0-e271ce5bc152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:23.513953 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9714f2-cba0-487a-b9b0-e271ce5bc152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:23.515883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9714f2-cba0-487a-b9b0-e271ce5bc152 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:23.517751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:23.544566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1260/2504] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:23.549678 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88415e7e-be8f-4ea3-8676-35f4e0ebec4f admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:23.561172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88415e7e-be8f-4ea3-8676-35f4e0ebec4f admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:23.573217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0e74c-39b8-4cc6-abf3-b315c4dc9b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:23.574063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0e74c-39b8-4cc6-abf3-b315c4dc9b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:23.574413 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0e74c-39b8-4cc6-abf3-b315c4dc9b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:23.574754 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0e74c-39b8-4cc6-abf3-b315c4dc9b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:23.575550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0e74c-39b8-4cc6-abf3-b315c4dc9b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:23.578791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0e74c-39b8-4cc6-abf3-b315c4dc9b36 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:23.601590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1245/2505] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:23.602990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9714f2-cba0-487a-b9b0-e271ce5bc152 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:23.621375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9714f2-cba0-487a-b9b0-e271ce5bc152 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:23.626889 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1625d-5893-4cf8-bfa2-1932796c7fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:23.627779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1625d-5893-4cf8-bfa2-1932796c7fce admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:23.628073 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1625d-5893-4cf8-bfa2-1932796c7fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:23.628468 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1625d-5893-4cf8-bfa2-1932796c7fce admin admin] PATH_INFO: `/v3/projects/122bbc0be727426291535b1bc981440a/users/a7aa659f00544cffa8e0f9460c585e75/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:23.647531 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1625d-5893-4cf8-bfa2-1932796c7fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=122bbc0be727426291535b1bc981440a, user_id=a7aa659f00544cffa8e0f9460c585e75, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:23.650408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1625d-5893-4cf8-bfa2-1932796c7fce admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:23.665632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1261/2506] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:23 2022] PUT /identity/v3/projects/122bbc0be727426291535b1bc981440a/users/a7aa659f00544cffa8e0f9460c585e75/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:23.677019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17a19-774a-43d3-8c7f-3b1ae79baeab None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:23.677309 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17a19-774a-43d3-8c7f-3b1ae79baeab None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:23.677588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17a19-774a-43d3-8c7f-3b1ae79baeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:23.707133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-90d17a19-774a-43d3-8c7f-3b1ae79baeab None None] MFA Rules not processed for user `a7aa659f00544cffa8e0f9460c585e75`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:23.708402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-90d17a19-774a-43d3-8c7f-3b1ae79baeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:23.819068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1246/2507] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:23.823470 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1625d-5893-4cf8-bfa2-1932796c7fce admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:23.898243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1625d-5893-4cf8-bfa2-1932796c7fce admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:23.903276 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd3eb1-c8f7-48f4-9810-6bf8c5af0710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:23.903936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3eb1-c8f7-48f4-9810-6bf8c5af0710 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:23.904222 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3eb1-c8f7-48f4-9810-6bf8c5af0710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:23.904506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3eb1-c8f7-48f4-9810-6bf8c5af0710 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:23.905131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd3eb1-c8f7-48f4-9810-6bf8c5af0710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:23.907617 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd3eb1-c8f7-48f4-9810-6bf8c5af0710 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:23.941005 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1262/2508] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:23 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:23.942170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d17a19-774a-43d3-8c7f-3b1ae79baeab None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:23.953785 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d17a19-774a-43d3-8c7f-3b1ae79baeab None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:23.973211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:24.016989 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4942585-28e4-43f2-b853-e71fdd9e4d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:24.017611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942585-28e4-43f2-b853-e71fdd9e4d1b admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:24.017895 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942585-28e4-43f2-b853-e71fdd9e4d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:24.018171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942585-28e4-43f2-b853-e71fdd9e4d1b admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:24.019057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4942585-28e4-43f2-b853-e71fdd9e4d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:24.021716 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4942585-28e4-43f2-b853-e71fdd9e4d1b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:24.048090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1247/2509] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:23 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:24.052977 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd3eb1-c8f7-48f4-9810-6bf8c5af0710 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:24.063962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd3eb1-c8f7-48f4-9810-6bf8c5af0710 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:24.068931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec1445-7a20-4c74-8e32-f9b3ae8cf0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:24.069744 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec1445-7a20-4c74-8e32-f9b3ae8cf0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:24.070124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec1445-7a20-4c74-8e32-f9b3ae8cf0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:24.070486 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec1445-7a20-4c74-8e32-f9b3ae8cf0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:24.071214 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec1445-7a20-4c74-8e32-f9b3ae8cf0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:24.072931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec1445-7a20-4c74-8e32-f9b3ae8cf0d9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:24.087058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1263/2510] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:24.091458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4942585-28e4-43f2-b853-e71fdd9e4d1b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:24.103346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4942585-28e4-43f2-b853-e71fdd9e4d1b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:24.109240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aed8a4-99de-4c4c-99d4-a137ca4708ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:24.109920 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aed8a4-99de-4c4c-99d4-a137ca4708ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:24.110225 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aed8a4-99de-4c4c-99d4-a137ca4708ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:24.110498 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aed8a4-99de-4c4c-99d4-a137ca4708ac admin admin] PATH_INFO: `/v3/projects/3a030cb8734a42e09043558362ffd8ab/users/ff69dd79b5d04d50b13514ab3072dbc0/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:24.127842 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aed8a4-99de-4c4c-99d4-a137ca4708ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a030cb8734a42e09043558362ffd8ab, user_id=ff69dd79b5d04d50b13514ab3072dbc0, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:24.130768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aed8a4-99de-4c4c-99d4-a137ca4708ac admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:24.148432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1248/2511] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:24 2022] PUT /identity/v3/projects/3a030cb8734a42e09043558362ffd8ab/users/ff69dd79b5d04d50b13514ab3072dbc0/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:24.152400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec1445-7a20-4c74-8e32-f9b3ae8cf0d9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:24.163307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec1445-7a20-4c74-8e32-f9b3ae8cf0d9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:24.237101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260f70a-609d-4b53-a0b8-6547765e7398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:24.237722 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260f70a-609d-4b53-a0b8-6547765e7398 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:24.238007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260f70a-609d-4b53-a0b8-6547765e7398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:24.238280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260f70a-609d-4b53-a0b8-6547765e7398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:24.238932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260f70a-609d-4b53-a0b8-6547765e7398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:24.240586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260f70a-609d-4b53-a0b8-6547765e7398 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:24.252451 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1264/2512] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:24.256812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aed8a4-99de-4c4c-99d4-a137ca4708ac admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:24.267890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aed8a4-99de-4c4c-99d4-a137ca4708ac admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:24.272527 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362b014-582e-4105-93a0-1f63ee94d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:24.273193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b014-582e-4105-93a0-1f63ee94d28c admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:24.273478 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b014-582e-4105-93a0-1f63ee94d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:24.273757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b014-582e-4105-93a0-1f63ee94d28c admin admin] PATH_INFO: `/v3/projects/3a030cb8734a42e09043558362ffd8ab/users/ff69dd79b5d04d50b13514ab3072dbc0/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:24.275718 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362b014-582e-4105-93a0-1f63ee94d28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a030cb8734a42e09043558362ffd8ab, user_id=ff69dd79b5d04d50b13514ab3072dbc0, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:24.278379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362b014-582e-4105-93a0-1f63ee94d28c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:24.290963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1249/2513] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:24 2022] PUT /identity/v3/projects/3a030cb8734a42e09043558362ffd8ab/users/ff69dd79b5d04d50b13514ab3072dbc0/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:24.309438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3661527-c38a-4006-abcb-2a5c483b8978 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:24.309724 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3661527-c38a-4006-abcb-2a5c483b8978 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:24.309998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3661527-c38a-4006-abcb-2a5c483b8978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:24.340326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c3661527-c38a-4006-abcb-2a5c483b8978 None None] MFA Rules not processed for user `ff69dd79b5d04d50b13514ab3072dbc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:24.341658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c3661527-c38a-4006-abcb-2a5c483b8978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:24.375707 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:24.418475 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1265/2514] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:24.431004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362b014-582e-4105-93a0-1f63ee94d28c admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:24.432852 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8362b014-582e-4105-93a0-1f63ee94d28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:24.494506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362b014-582e-4105-93a0-1f63ee94d28c admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:24.498382 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecf261-2422-4b5a-9faa-cb08613695bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:24.498891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecf261-2422-4b5a-9faa-cb08613695bb service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:24.499243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecf261-2422-4b5a-9faa-cb08613695bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:24.499500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecf261-2422-4b5a-9faa-cb08613695bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:24.563952 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecf261-2422-4b5a-9faa-cb08613695bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:24.565329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecf261-2422-4b5a-9faa-cb08613695bb service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:24.574614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1250/2515] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:25.991145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3661527-c38a-4006-abcb-2a5c483b8978 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:25.992602 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c3661527-c38a-4006-abcb-2a5c483b8978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.005208 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3661527-c38a-4006-abcb-2a5c483b8978 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.008856 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998487ce-e09a-41ba-b7f8-2fbc854964d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.009478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998487ce-e09a-41ba-b7f8-2fbc854964d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.009755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998487ce-e09a-41ba-b7f8-2fbc854964d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.010021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998487ce-e09a-41ba-b7f8-2fbc854964d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.020673 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998487ce-e09a-41ba-b7f8-2fbc854964d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:26.022143 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998487ce-e09a-41ba-b7f8-2fbc854964d5 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:26.032555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1266/2516] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:29.463471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecf261-2422-4b5a-9faa-cb08613695bb service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:29.464940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-42ecf261-2422-4b5a-9faa-cb08613695bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:29.497841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:29.533034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecf261-2422-4b5a-9faa-cb08613695bb service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:29.537680 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:29.538312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:29.538596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:29.538874 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] PATH_INFO: `/v3/users/093dd19e5b1340c28d4a46990d221d71` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.540063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093dd19e5b1340c28d4a46990d221d71)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:29.541969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:29.593421 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093dd19e5b1340c28d4a46990d221d71'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:29.602726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093dd19e5b1340c28d4a46990d221d71'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:29.603338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093dd19e5b1340c28d4a46990d221d71'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:29.604007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093dd19e5b1340c28d4a46990d221d71'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:29.616391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093dd19e5b1340c28d4a46990d221d71'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:29.628879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1251/2517] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:29 2022] DELETE /identity/v3/users/093dd19e5b1340c28d4a46990d221d71 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:29.633345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2887b85-df8f-478f-9c91-fda7b92caff6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:29.634024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2887b85-df8f-478f-9c91-fda7b92caff6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:29.634024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2887b85-df8f-478f-9c91-fda7b92caff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.654165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a2887b85-df8f-478f-9c91-fda7b92caff6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:29.655583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a2887b85-df8f-478f-9c91-fda7b92caff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:29.721713 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1267/2518] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:29.731743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:29.733230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:29.816240 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5ada6-b48f-4fab-b09b-25597c5f9de6 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:29.821646 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cd6be-4668-4994-8bcb-5fa36c1fd7b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:29.822493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cd6be-4668-4994-8bcb-5fa36c1fd7b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:29.822873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cd6be-4668-4994-8bcb-5fa36c1fd7b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:29.823252 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cd6be-4668-4994-8bcb-5fa36c1fd7b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.833595 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cd6be-4668-4994-8bcb-5fa36c1fd7b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:29.835021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cd6be-4668-4994-8bcb-5fa36c1fd7b9 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:29.844783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1252/2519] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:30.066413 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2887b85-df8f-478f-9c91-fda7b92caff6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:30.068661 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a2887b85-df8f-478f-9c91-fda7b92caff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:30.081974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2887b85-df8f-478f-9c91-fda7b92caff6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:30.087141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca8177-19d7-4a86-91f8-a1e5264a2daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:30.087944 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca8177-19d7-4a86-91f8-a1e5264a2daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:30.088423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca8177-19d7-4a86-91f8-a1e5264a2daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:30.088782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca8177-19d7-4a86-91f8-a1e5264a2daf admin admin] PATH_INFO: `/v3/users/a7aa659f00544cffa8e0f9460c585e75` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:30.090184 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca8177-19d7-4a86-91f8-a1e5264a2daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7aa659f00544cffa8e0f9460c585e75)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:30.092517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca8177-19d7-4a86-91f8-a1e5264a2daf admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:30.161965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cd6be-4668-4994-8bcb-5fa36c1fd7b9 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:30.162577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1f0cd6be-4668-4994-8bcb-5fa36c1fd7b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:30.182252 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cd6be-4668-4994-8bcb-5fa36c1fd7b9 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:30.184443 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c6ca8177-19d7-4a86-91f8-a1e5264a2daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7aa659f00544cffa8e0f9460c585e75'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.208591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:30.209032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:30.209320 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:30.210007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] PATH_INFO: `/v3/projects/f0f9beff8b4a43ffb6d1f15819b59a63` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:30.211938 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f9beff8b4a43ffb6d1f15819b59a63)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:30.212099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c6ca8177-19d7-4a86-91f8-a1e5264a2daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7aa659f00544cffa8e0f9460c585e75'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.213834 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:30.225191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c6ca8177-19d7-4a86-91f8-a1e5264a2daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7aa659f00544cffa8e0f9460c585e75'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.226330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c6ca8177-19d7-4a86-91f8-a1e5264a2daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7aa659f00544cffa8e0f9460c585e75'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.250610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c6ca8177-19d7-4a86-91f8-a1e5264a2daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7aa659f00544cffa8e0f9460c585e75'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.255564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1268/2520] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:30 2022] DELETE /identity/v3/users/a7aa659f00544cffa8e0f9460c585e75 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:30.265712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44408598-151b-4f7c-8549-daeba890810a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:30.266118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44408598-151b-4f7c-8549-daeba890810a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:30.266457 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44408598-151b-4f7c-8549-daeba890810a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:30.271569 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:30.274550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f9beff8b4a43ffb6d1f15819b59a63', 'request_id': 'req-9fc51322-3b2e-4225-a6ec-fb94ab14678a'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.285905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f9beff8b4a43ffb6d1f15819b59a63', 'request_id': 'req-9fc51322-3b2e-4225-a6ec-fb94ab14678a'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.289822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-44408598-151b-4f7c-8549-daeba890810a None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:30.291044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-44408598-151b-4f7c-8549-daeba890810a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:30.296194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f9beff8b4a43ffb6d1f15819b59a63', 'request_id': 'req-9fc51322-3b2e-4225-a6ec-fb94ab14678a'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.314760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:30.315001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] The token cache is being invalidate because project f0f9beff8b4a43ffb6d1f15819b59a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:30.315207 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.316280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.320783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1253/2521] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:30 2022] DELETE /identity/v3/projects/f0f9beff8b4a43ffb6d1f15819b59a63 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:30.322381 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:30.324291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:30.374577 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1269/2522] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:30.385704 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44408598-151b-4f7c-8549-daeba890810a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:30.387287 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-44408598-151b-4f7c-8549-daeba890810a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:30.424540 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc51322-3b2e-4225-a6ec-fb94ab14678a admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:30.433559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:30.433559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:30.434090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:30.434249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] PATH_INFO: `/v3/users/19ed0c118e164a73806c35a379f6c79b` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:30.435561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ed0c118e164a73806c35a379f6c79b)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:30.438276 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:30.461058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44408598-151b-4f7c-8549-daeba890810a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:30.465175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae050-210a-4179-b7ad-2de841138106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:30.465816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae050-210a-4179-b7ad-2de841138106 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:30.466134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae050-210a-4179-b7ad-2de841138106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:30.466407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae050-210a-4179-b7ad-2de841138106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:30.478456 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae050-210a-4179-b7ad-2de841138106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:30.480048 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae050-210a-4179-b7ad-2de841138106 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:30.491140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1270/2523] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:30.497751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ed0c118e164a73806c35a379f6c79b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.507124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ed0c118e164a73806c35a379f6c79b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.507832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ed0c118e164a73806c35a379f6c79b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.508499 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ed0c118e164a73806c35a379f6c79b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.523040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ed0c118e164a73806c35a379f6c79b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:30.537146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1254/2524] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:30 2022] DELETE /identity/v3/users/19ed0c118e164a73806c35a379f6c79b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:30.840820 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae050-210a-4179-b7ad-2de841138106 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:30.842551 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d88ae050-210a-4179-b7ad-2de841138106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:30.860069 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae050-210a-4179-b7ad-2de841138106 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:30.895324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:30.897254 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:30.942872 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:30.943418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:30.943704 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:30.944015 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] PATH_INFO: `/v3/projects/122bbc0be727426291535b1bc981440a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:30.945193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=122bbc0be727426291535b1bc981440a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:30.947149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:30.977700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:30.991453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418dc20-74db-419f-8721-5cc24502fe5a admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:30.997360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:30.998004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:30.998281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:30.998555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a admin admin] PATH_INFO: `/v3/projects/5d8cbf5831b84c9fbecb371d8744bb34` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.000427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8cbf5831b84c9fbecb371d8744bb34)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:31.002344 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:31.016541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122bbc0be727426291535b1bc981440a', 'request_id': 'req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.022320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122bbc0be727426291535b1bc981440a', 'request_id': 'req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.032626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122bbc0be727426291535b1bc981440a', 'request_id': 'req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.042394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:31.047396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] The token cache is being invalidate because project 122bbc0be727426291535b1bc981440a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:31.049003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.049776 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.052268 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1271/2525] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:30 2022] DELETE /identity/v3/projects/122bbc0be727426291535b1bc981440a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:31.057714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:31.059748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8cbf5831b84c9fbecb371d8744bb34', 'request_id': 'req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.060882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:31.067333 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8cbf5831b84c9fbecb371d8744bb34', 'request_id': 'req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.080293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8cbf5831b84c9fbecb371d8744bb34', 'request_id': 'req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.105601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a admin admin] The token cache is being invalidate because project 5d8cbf5831b84c9fbecb371d8744bb34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:31.105970 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.106933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9c1c6a08-c6b7-4cb8-ba70-e39f59f0127a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.109197 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1255/2526] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:30 2022] DELETE /identity/v3/projects/5d8cbf5831b84c9fbecb371d8744bb34 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:31.116083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c855150-f0ae-4d2f-a07b-9f7451a64e78 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.116550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c855150-f0ae-4d2f-a07b-9f7451a64e78 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.116972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c855150-f0ae-4d2f-a07b-9f7451a64e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.149456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-5c855150-f0ae-4d2f-a07b-9f7451a64e78 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:31.149911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5c855150-f0ae-4d2f-a07b-9f7451a64e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:31.178114 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c9b01-09e9-47e5-b7a0-1a5818f5a9d8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:31.235944 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1256/2527] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:31.237549 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e9c06-f294-4164-b910-6f4cb134b041 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.237840 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e9c06-f294-4164-b910-6f4cb134b041 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.238196 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e9c06-f294-4164-b910-6f4cb134b041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.239873 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:31.240519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.240799 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.241072 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] PATH_INFO: `/v3/users/ff69dd79b5d04d50b13514ab3072dbc0` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.242722 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff69dd79b5d04d50b13514ab3072dbc0)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:31.244697 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:31.258155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b24e9c06-f294-4164-b910-6f4cb134b041 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:31.259402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b24e9c06-f294-4164-b910-6f4cb134b041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:31.268588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1257/2528] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:31.273196 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e9c06-f294-4164-b910-6f4cb134b041 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:31.284739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e9c06-f294-4164-b910-6f4cb134b041 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:31.290658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52848-2f4d-42ed-93b9-e86647d30330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:31.291550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52848-2f4d-42ed-93b9-e86647d30330 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.292057 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52848-2f4d-42ed-93b9-e86647d30330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.292511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52848-2f4d-42ed-93b9-e86647d30330 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.293603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52848-2f4d-42ed-93b9-e86647d30330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:31.294111 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52848-2f4d-42ed-93b9-e86647d30330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:31.297490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52848-2f4d-42ed-93b9-e86647d30330 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:31.299402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff69dd79b5d04d50b13514ab3072dbc0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.311294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff69dd79b5d04d50b13514ab3072dbc0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.314983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1258/2529] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:10:31.320432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52848-2f4d-42ed-93b9-e86647d30330 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:31.320706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff69dd79b5d04d50b13514ab3072dbc0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.321333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff69dd79b5d04d50b13514ab3072dbc0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.331375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52848-2f4d-42ed-93b9-e86647d30330 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:31.336739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a191d-0398-4826-afff-338db5ad7234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:31.337335 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a191d-0398-4826-afff-338db5ad7234 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.337633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a191d-0398-4826-afff-338db5ad7234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.337896 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a191d-0398-4826-afff-338db5ad7234 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.338160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff69dd79b5d04d50b13514ab3072dbc0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.338710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a191d-0398-4826-afff-338db5ad7234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:31.340721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a191d-0398-4826-afff-338db5ad7234 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:31.346529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1272/2530] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:31 2022] DELETE /identity/v3/users/ff69dd79b5d04d50b13514ab3072dbc0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:31.376811 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1259/2531] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:31 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:31.383197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:31.385150 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:31.425218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:31.471866 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7896314-030c-4364-a0d0-1b8edfa6706a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:31.566912 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd458a5f-4dc3-4362-971e-b37bfdb053f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:31.568129 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd458a5f-4dc3-4362-971e-b37bfdb053f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.568821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd458a5f-4dc3-4362-971e-b37bfdb053f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.569557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd458a5f-4dc3-4362-971e-b37bfdb053f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.570853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd458a5f-4dc3-4362-971e-b37bfdb053f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:31.574832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd458a5f-4dc3-4362-971e-b37bfdb053f2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:31.617754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1273/2532] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:31 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:31.621558 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a191d-0398-4826-afff-338db5ad7234 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:31.634345 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a191d-0398-4826-afff-338db5ad7234 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:31.639379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e54e30-b4f8-4d08-8d22-7d7af05a638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:31.640363 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54e30-b4f8-4d08-8d22-7d7af05a638c admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.640749 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54e30-b4f8-4d08-8d22-7d7af05a638c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.641109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54e30-b4f8-4d08-8d22-7d7af05a638c admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.641847 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e54e30-b4f8-4d08-8d22-7d7af05a638c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:31.643556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e54e30-b4f8-4d08-8d22-7d7af05a638c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:31.657770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1260/2533] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:31.661802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd458a5f-4dc3-4362-971e-b37bfdb053f2 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:31.677899 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e54e30-b4f8-4d08-8d22-7d7af05a638c admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:31.678815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd458a5f-4dc3-4362-971e-b37bfdb053f2 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:31.680603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f2e54e30-b4f8-4d08-8d22-7d7af05a638c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:31.685609 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934d5c8-4d57-460e-911c-5427e1ad949f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:31.687346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934d5c8-4d57-460e-911c-5427e1ad949f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.687346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934d5c8-4d57-460e-911c-5427e1ad949f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.687651 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934d5c8-4d57-460e-911c-5427e1ad949f admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.688496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934d5c8-4d57-460e-911c-5427e1ad949f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:31.690218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934d5c8-4d57-460e-911c-5427e1ad949f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:31.700126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e54e30-b4f8-4d08-8d22-7d7af05a638c admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:31.709362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedfdb3-f378-471a-b8c9-6566263a6cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:31.710170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedfdb3-f378-471a-b8c9-6566263a6cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.710523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedfdb3-f378-471a-b8c9-6566263a6cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.712163 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedfdb3-f378-471a-b8c9-6566263a6cd2 admin admin] PATH_INFO: `/v3/projects/3a030cb8734a42e09043558362ffd8ab` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.713157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedfdb3-f378-471a-b8c9-6566263a6cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a030cb8734a42e09043558362ffd8ab)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:31.715099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedfdb3-f378-471a-b8c9-6566263a6cd2 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:31.726438 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1274/2534] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:31.735680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934d5c8-4d57-460e-911c-5427e1ad949f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:31.755359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934d5c8-4d57-460e-911c-5427e1ad949f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:31.760595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281dccd-c2d6-4626-991a-223c0f2346c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:31.761295 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281dccd-c2d6-4626-991a-223c0f2346c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.761578 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281dccd-c2d6-4626-991a-223c0f2346c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.761852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281dccd-c2d6-4626-991a-223c0f2346c9 admin admin] PATH_INFO: `/v3/projects/3b8ab1516b9b48b789170727f3a2ba3f/users/ee4becbb8cf24984a68743a1c099fff5/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.772432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:31.784560 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281dccd-c2d6-4626-991a-223c0f2346c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8ab1516b9b48b789170727f3a2ba3f, user_id=ee4becbb8cf24984a68743a1c099fff5, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:31.787560 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281dccd-c2d6-4626-991a-223c0f2346c9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:31.801428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-fcedfdb3-f378-471a-b8c9-6566263a6cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a030cb8734a42e09043558362ffd8ab', 'request_id': 'req-fcedfdb3-f378-471a-b8c9-6566263a6cd2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.804327 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1275/2535] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:31 2022] PUT /identity/v3/projects/3b8ab1516b9b48b789170727f3a2ba3f/users/ee4becbb8cf24984a68743a1c099fff5/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:31.809582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-fcedfdb3-f378-471a-b8c9-6566263a6cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a030cb8734a42e09043558362ffd8ab', 'request_id': 'req-fcedfdb3-f378-471a-b8c9-6566263a6cd2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.817504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a7c71-9182-42e7-96ae-a4827f06adcd None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.817954 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a7c71-9182-42e7-96ae-a4827f06adcd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.818248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a7c71-9182-42e7-96ae-a4827f06adcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.819719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-fcedfdb3-f378-471a-b8c9-6566263a6cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a030cb8734a42e09043558362ffd8ab', 'request_id': 'req-fcedfdb3-f378-471a-b8c9-6566263a6cd2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.834801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-fcedfdb3-f378-471a-b8c9-6566263a6cd2 admin admin] The token cache is being invalidate because project 3a030cb8734a42e09043558362ffd8ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:31.835091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-fcedfdb3-f378-471a-b8c9-6566263a6cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.835849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-fcedfdb3-f378-471a-b8c9-6566263a6cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.837451 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1261/2536] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:31 2022] DELETE /identity/v3/projects/3a030cb8734a42e09043558362ffd8ab => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:31.842615 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71081de-a0db-4833-b329-ab673648579b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.842903 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71081de-a0db-4833-b329-ab673648579b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.843347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71081de-a0db-4833-b329-ab673648579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.853409 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-387a7c71-9182-42e7-96ae-a4827f06adcd None None] MFA Rules not processed for user `ee4becbb8cf24984a68743a1c099fff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:31.854860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-387a7c71-9182-42e7-96ae-a4827f06adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:31.875540 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e71081de-a0db-4833-b329-ab673648579b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:31.877344 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e71081de-a0db-4833-b329-ab673648579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:31.940330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1276/2537] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:31.944966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a7c71-9182-42e7-96ae-a4827f06adcd None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:31.946363 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-387a7c71-9182-42e7-96ae-a4827f06adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:31.972782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:31.977774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1262/2538] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:31.986029 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1d15f-cbb2-47d0-a01d-0280db5cd31f None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.988017 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1d15f-cbb2-47d0-a01d-0280db5cd31f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.988313 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1d15f-cbb2-47d0-a01d-0280db5cd31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.012700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-21a1d15f-cbb2-47d0-a01d-0280db5cd31f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:32.013850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-21a1d15f-cbb2-47d0-a01d-0280db5cd31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:32.024914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1263/2539] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:32.029668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1d15f-cbb2-47d0-a01d-0280db5cd31f None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.029899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a7c71-9182-42e7-96ae-a4827f06adcd None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.035270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625586ed-cdcd-48b2-9b37-674a519d0186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.036086 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625586ed-cdcd-48b2-9b37-674a519d0186 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.036362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625586ed-cdcd-48b2-9b37-674a519d0186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.036648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625586ed-cdcd-48b2-9b37-674a519d0186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.038888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625586ed-cdcd-48b2-9b37-674a519d0186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.039243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625586ed-cdcd-48b2-9b37-674a519d0186 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.040818 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1d15f-cbb2-47d0-a01d-0280db5cd31f None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.045821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb105c0b-8167-46de-90f6-ae635285a0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.046455 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb105c0b-8167-46de-90f6-ae635285a0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.046753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb105c0b-8167-46de-90f6-ae635285a0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.047031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb105c0b-8167-46de-90f6-ae635285a0a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.047714 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb105c0b-8167-46de-90f6-ae635285a0a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:32.048052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb105c0b-8167-46de-90f6-ae635285a0a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.049902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb105c0b-8167-46de-90f6-ae635285a0a4 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.063316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1264/2540] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:32.067950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb105c0b-8167-46de-90f6-ae635285a0a4 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.078418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1277/2541] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:31 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:32.078869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb105c0b-8167-46de-90f6-ae635285a0a4 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.079548 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625586ed-cdcd-48b2-9b37-674a519d0186 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.145145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa3989-f6ba-42ca-b67e-b693d49408fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.145816 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa3989-f6ba-42ca-b67e-b693d49408fa admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.146132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa3989-f6ba-42ca-b67e-b693d49408fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.146405 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa3989-f6ba-42ca-b67e-b693d49408fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.147041 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa3989-f6ba-42ca-b67e-b693d49408fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.148992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa3989-f6ba-42ca-b67e-b693d49408fa admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.168335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625586ed-cdcd-48b2-9b37-674a519d0186 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.177102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b120b8-8556-49f6-9328-4ee9f7e31f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.178090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b120b8-8556-49f6-9328-4ee9f7e31f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.178665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1265/2542] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:32 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:32.178793 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b120b8-8556-49f6-9328-4ee9f7e31f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.179162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b120b8-8556-49f6-9328-4ee9f7e31f19 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.180307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b120b8-8556-49f6-9328-4ee9f7e31f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.182853 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa3989-f6ba-42ca-b67e-b693d49408fa admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.184157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b120b8-8556-49f6-9328-4ee9f7e31f19 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.207144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:32.215338 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1278/2543] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:32 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:32.216778 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b120b8-8556-49f6-9328-4ee9f7e31f19 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.227679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b120b8-8556-49f6-9328-4ee9f7e31f19 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.271199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa3989-f6ba-42ca-b67e-b693d49408fa admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.276740 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ace7-20dc-40f3-a754-4775efaa3763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.277442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ace7-20dc-40f3-a754-4775efaa3763 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.278133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ace7-20dc-40f3-a754-4775efaa3763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.278133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ace7-20dc-40f3-a754-4775efaa3763 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.278832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9ace7-20dc-40f3-a754-4775efaa3763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.281614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9ace7-20dc-40f3-a754-4775efaa3763 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.294388 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba66f4-a196-4706-a385-90d99f7a5953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.295137 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba66f4-a196-4706-a385-90d99f7a5953 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.295516 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba66f4-a196-4706-a385-90d99f7a5953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.295924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba66f4-a196-4706-a385-90d99f7a5953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.296742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba66f4-a196-4706-a385-90d99f7a5953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.298732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba66f4-a196-4706-a385-90d99f7a5953 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.310076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1279/2544] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:32.315253 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1266/2545] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:32 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:32.316337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba66f4-a196-4706-a385-90d99f7a5953 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.319384 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ace7-20dc-40f3-a754-4775efaa3763 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.327843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba66f4-a196-4706-a385-90d99f7a5953 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.330001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ace7-20dc-40f3-a754-4775efaa3763 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.333071 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef4485-bcdc-42c9-a5d9-6854618dfca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.333743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4485-bcdc-42c9-a5d9-6854618dfca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.334027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4485-bcdc-42c9-a5d9-6854618dfca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.334304 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4485-bcdc-42c9-a5d9-6854618dfca1 admin admin] PATH_INFO: `/v3/projects/ff97d94ada614afc9a96b0d1fab6e69e/users/1ee96c27aef14d4c9c542aff332cdbed/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.334579 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303ba55-6055-4dba-ab53-7e88883410d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.335201 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303ba55-6055-4dba-ab53-7e88883410d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.335482 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303ba55-6055-4dba-ab53-7e88883410d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.335779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303ba55-6055-4dba-ab53-7e88883410d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.336432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303ba55-6055-4dba-ab53-7e88883410d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.338027 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303ba55-6055-4dba-ab53-7e88883410d5 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.350956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef4485-bcdc-42c9-a5d9-6854618dfca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff97d94ada614afc9a96b0d1fab6e69e, user_id=1ee96c27aef14d4c9c542aff332cdbed, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.353750 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef4485-bcdc-42c9-a5d9-6854618dfca1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.355489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1267/2546] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:32.359216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303ba55-6055-4dba-ab53-7e88883410d5 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.369162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1280/2547] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:32 2022] PUT /identity/v3/projects/ff97d94ada614afc9a96b0d1fab6e69e/users/1ee96c27aef14d4c9c542aff332cdbed/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:32.374398 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303ba55-6055-4dba-ab53-7e88883410d5 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.375294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef4485-bcdc-42c9-a5d9-6854618dfca1 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.382135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:32.438227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56400b67-8be5-4eb9-8f61-fd704e226a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.438878 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56400b67-8be5-4eb9-8f61-fd704e226a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.439221 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56400b67-8be5-4eb9-8f61-fd704e226a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.439542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56400b67-8be5-4eb9-8f61-fd704e226a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.440206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56400b67-8be5-4eb9-8f61-fd704e226a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.441819 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56400b67-8be5-4eb9-8f61-fd704e226a92 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.445358 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef4485-bcdc-42c9-a5d9-6854618dfca1 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.450200 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace2a95-702f-478f-b3c3-ae6a7077e185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.450813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace2a95-702f-478f-b3c3-ae6a7077e185 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.451165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace2a95-702f-478f-b3c3-ae6a7077e185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.451342 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace2a95-702f-478f-b3c3-ae6a7077e185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.452145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace2a95-702f-478f-b3c3-ae6a7077e185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.452676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1268/2548] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:32.453937 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace2a95-702f-478f-b3c3-ae6a7077e185 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.457455 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56400b67-8be5-4eb9-8f61-fd704e226a92 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.465254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1281/2549] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:32.469483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace2a95-702f-478f-b3c3-ae6a7077e185 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.474730 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56400b67-8be5-4eb9-8f61-fd704e226a92 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.479856 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace2a95-702f-478f-b3c3-ae6a7077e185 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.480822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886018a-c980-4f5f-9be4-8ec392eea379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.481598 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886018a-c980-4f5f-9be4-8ec392eea379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.481881 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886018a-c980-4f5f-9be4-8ec392eea379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.482160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886018a-c980-4f5f-9be4-8ec392eea379 admin admin] PATH_INFO: `/v3/projects/3a2096b22fad49ce80e18475e4e5a04e/users/1442795615a24359aefca123b1de30af/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.485368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7144db0-24c1-4a73-9e91-ae31f2947574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.486957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7144db0-24c1-4a73-9e91-ae31f2947574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.487246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7144db0-24c1-4a73-9e91-ae31f2947574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.487525 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7144db0-24c1-4a73-9e91-ae31f2947574 admin admin] PATH_INFO: `/v3/projects/ff97d94ada614afc9a96b0d1fab6e69e/users/1ee96c27aef14d4c9c542aff332cdbed/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.489546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7144db0-24c1-4a73-9e91-ae31f2947574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff97d94ada614afc9a96b0d1fab6e69e, user_id=1ee96c27aef14d4c9c542aff332cdbed, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.492703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7144db0-24c1-4a73-9e91-ae31f2947574 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.499481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886018a-c980-4f5f-9be4-8ec392eea379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2096b22fad49ce80e18475e4e5a04e, user_id=1442795615a24359aefca123b1de30af, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.502157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886018a-c980-4f5f-9be4-8ec392eea379 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.505501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1282/2550] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:32 2022] PUT /identity/v3/projects/ff97d94ada614afc9a96b0d1fab6e69e/users/1ee96c27aef14d4c9c542aff332cdbed/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:32.515866 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72d22f-6b55-408b-af5d-9c069e1d676b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.516156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72d22f-6b55-408b-af5d-9c069e1d676b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.516434 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72d22f-6b55-408b-af5d-9c069e1d676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.518542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1269/2551] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:32 2022] PUT /identity/v3/projects/3a2096b22fad49ce80e18475e4e5a04e/users/1442795615a24359aefca123b1de30af/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:32.530591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c62ab-4f99-451d-97e6-137b875379d9 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.530969 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c62ab-4f99-451d-97e6-137b875379d9 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.531954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c62ab-4f99-451d-97e6-137b875379d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.547506 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9d72d22f-6b55-408b-af5d-9c069e1d676b None None] MFA Rules not processed for user `1ee96c27aef14d4c9c542aff332cdbed`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:32.549025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9d72d22f-6b55-408b-af5d-9c069e1d676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:32.562085 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-534c62ab-4f99-451d-97e6-137b875379d9 None None] MFA Rules not processed for user `1442795615a24359aefca123b1de30af`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:32.563304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-534c62ab-4f99-451d-97e6-137b875379d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:32.630333 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:32.633065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1283/2552] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:32.638554 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1270/2553] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:32.640135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72d22f-6b55-408b-af5d-9c069e1d676b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.645176 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c62ab-4f99-451d-97e6-137b875379d9 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.646600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-534c62ab-4f99-451d-97e6-137b875379d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:32.711822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72d22f-6b55-408b-af5d-9c069e1d676b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.712705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c62ab-4f99-451d-97e6-137b875379d9 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.716366 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b6502-749c-4eeb-9663-5f7898084f59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.716716 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924dc5-06be-46ce-a7be-ae2b4a9eee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.716966 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6502-749c-4eeb-9663-5f7898084f59 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.717245 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6502-749c-4eeb-9663-5f7898084f59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.718001 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924dc5-06be-46ce-a7be-ae2b4a9eee51 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.718112 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6502-749c-4eeb-9663-5f7898084f59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.718398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924dc5-06be-46ce-a7be-ae2b4a9eee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.718737 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924dc5-06be-46ce-a7be-ae2b4a9eee51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.719358 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32924dc5-06be-46ce-a7be-ae2b4a9eee51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.721302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32924dc5-06be-46ce-a7be-ae2b4a9eee51 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.728098 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b6502-749c-4eeb-9663-5f7898084f59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.729559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b6502-749c-4eeb-9663-5f7898084f59 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.741117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1271/2554] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:32.747967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:32.757963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1284/2555] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:32 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:32.761436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b6502-749c-4eeb-9663-5f7898084f59 service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.775799 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b6502-749c-4eeb-9663-5f7898084f59 service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.837168 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924dc5-06be-46ce-a7be-ae2b4a9eee51 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.848711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c989e19-57cd-4e21-872e-7ad790ec36e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.849331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c989e19-57cd-4e21-872e-7ad790ec36e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.849792 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c989e19-57cd-4e21-872e-7ad790ec36e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.850070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c989e19-57cd-4e21-872e-7ad790ec36e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.850837 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c989e19-57cd-4e21-872e-7ad790ec36e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.852916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c989e19-57cd-4e21-872e-7ad790ec36e4 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.879825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1272/2556] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:32 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:32.880953 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c989e19-57cd-4e21-872e-7ad790ec36e4 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.896853 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c989e19-57cd-4e21-872e-7ad790ec36e4 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.901127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924dc5-06be-46ce-a7be-ae2b4a9eee51 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.902292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d918018-74d2-49b2-b784-37a76a80b2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.902927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d918018-74d2-49b2-b784-37a76a80b2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.903213 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d918018-74d2-49b2-b784-37a76a80b2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.903491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d918018-74d2-49b2-b784-37a76a80b2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.904189 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d918018-74d2-49b2-b784-37a76a80b2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.906021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426b7d6-4f2a-4135-9238-1405341e601e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.906362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d918018-74d2-49b2-b784-37a76a80b2f4 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.906803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426b7d6-4f2a-4135-9238-1405341e601e service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.907171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426b7d6-4f2a-4135-9238-1405341e601e service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.907441 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426b7d6-4f2a-4135-9238-1405341e601e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.917228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1273/2557] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:32.921799 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d918018-74d2-49b2-b784-37a76a80b2f4 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.932702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d918018-74d2-49b2-b784-37a76a80b2f4 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.937853 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9fdaf-3a65-4aa7-9059-9b4b506dc286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.938600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9fdaf-3a65-4aa7-9059-9b4b506dc286 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.938959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9fdaf-3a65-4aa7-9059-9b4b506dc286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.939362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9fdaf-3a65-4aa7-9059-9b4b506dc286 admin admin] PATH_INFO: `/v3/projects/3b0e60e0ec1c45f5b87cbf36b4e2f317/users/f3d018fb92414230a2fe85e3aa60d9eb/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.961299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9fdaf-3a65-4aa7-9059-9b4b506dc286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0e60e0ec1c45f5b87cbf36b4e2f317, user_id=f3d018fb92414230a2fe85e3aa60d9eb, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.963638 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9fdaf-3a65-4aa7-9059-9b4b506dc286 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.982341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1274/2558] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:32 2022] PUT /identity/v3/projects/3b0e60e0ec1c45f5b87cbf36b4e2f317/users/f3d018fb92414230a2fe85e3aa60d9eb/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:32.986696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426b7d6-4f2a-4135-9238-1405341e601e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.988017 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426b7d6-4f2a-4135-9238-1405341e601e service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.988299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9fdaf-3a65-4aa7-9059-9b4b506dc286 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.998002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1285/2559] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:33.066451 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:33.071335 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9fdaf-3a65-4aa7-9059-9b4b506dc286 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:33.078917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1e11b-7d2e-439f-ad31-2e3abb5e2c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:33.079524 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1e11b-7d2e-439f-ad31-2e3abb5e2c28 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:33.079833 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1e11b-7d2e-439f-ad31-2e3abb5e2c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:33.080105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1e11b-7d2e-439f-ad31-2e3abb5e2c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:33.080922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1e11b-7d2e-439f-ad31-2e3abb5e2c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:33.082577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1e11b-7d2e-439f-ad31-2e3abb5e2c28 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:33.094478 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1275/2560] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:33.104343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426b7d6-4f2a-4135-9238-1405341e601e service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:33.116261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426b7d6-4f2a-4135-9238-1405341e601e service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:33.121500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497707c-1eee-40c7-a87e-b24ffeb2cfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:33.122271 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497707c-1eee-40c7-a87e-b24ffeb2cfc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:33.122633 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497707c-1eee-40c7-a87e-b24ffeb2cfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:33.122979 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497707c-1eee-40c7-a87e-b24ffeb2cfc9 admin admin] PATH_INFO: `/v3/projects/3b0e60e0ec1c45f5b87cbf36b4e2f317/users/f3d018fb92414230a2fe85e3aa60d9eb/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:33.125124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497707c-1eee-40c7-a87e-b24ffeb2cfc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0e60e0ec1c45f5b87cbf36b4e2f317, user_id=f3d018fb92414230a2fe85e3aa60d9eb, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:33.128159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497707c-1eee-40c7-a87e-b24ffeb2cfc9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:33.145196 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1286/2561] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:33 2022] PUT /identity/v3/projects/3b0e60e0ec1c45f5b87cbf36b4e2f317/users/f3d018fb92414230a2fe85e3aa60d9eb/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:33.164233 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7733b-771f-4715-a28c-d71a0eb7b824 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:33.164722 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7733b-771f-4715-a28c-d71a0eb7b824 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:33.165219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7733b-771f-4715-a28c-d71a0eb7b824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:33.227176 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-afa7733b-771f-4715-a28c-d71a0eb7b824 None None] MFA Rules not processed for user `f3d018fb92414230a2fe85e3aa60d9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:33.227176 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-afa7733b-771f-4715-a28c-d71a0eb7b824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:33.300521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1276/2562] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:33.368754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497707c-1eee-40c7-a87e-b24ffeb2cfc9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:33.472273 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497707c-1eee-40c7-a87e-b24ffeb2cfc9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:33.476390 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05614c10-92e7-46e5-86ac-9da8ed041ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:33.477016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05614c10-92e7-46e5-86ac-9da8ed041ffc service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:33.477301 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05614c10-92e7-46e5-86ac-9da8ed041ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:33.477578 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05614c10-92e7-46e5-86ac-9da8ed041ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:33.488747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05614c10-92e7-46e5-86ac-9da8ed041ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:33.490285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05614c10-92e7-46e5-86ac-9da8ed041ffc service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:33.502810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1287/2563] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:33.908362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7733b-771f-4715-a28c-d71a0eb7b824 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:33.920323 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7733b-771f-4715-a28c-d71a0eb7b824 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:33.926019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90e150-2a07-4914-abdf-b4bfbf95f48b tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3d018fb92414230a2fe85e3aa60d9eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0e60e0ec1c45f5b87cbf36b4e2f317', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:33.926644 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90e150-2a07-4914-abdf-b4bfbf95f48b tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:33.926942 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90e150-2a07-4914-abdf-b4bfbf95f48b tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:33.927269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90e150-2a07-4914-abdf-b4bfbf95f48b tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:33.927970 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90e150-2a07-4914-abdf-b4bfbf95f48b tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:33.928281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90e150-2a07-4914-abdf-b4bfbf95f48b tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:33.929886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90e150-2a07-4914-abdf-b4bfbf95f48b tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:33.946771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1277/2564] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:33.948317 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05614c10-92e7-46e5-86ac-9da8ed041ffc service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:33.959427 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05614c10-92e7-46e5-86ac-9da8ed041ffc service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:33.964225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8239a4d-30dd-4fe5-92ae-f5cb65064fd0 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3d018fb92414230a2fe85e3aa60d9eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0e60e0ec1c45f5b87cbf36b4e2f317', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:33.964840 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8239a4d-30dd-4fe5-92ae-f5cb65064fd0 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:33.965131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8239a4d-30dd-4fe5-92ae-f5cb65064fd0 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:33.965414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8239a4d-30dd-4fe5-92ae-f5cb65064fd0 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:33.966060 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8239a4d-30dd-4fe5-92ae-f5cb65064fd0 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:33.968576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8239a4d-30dd-4fe5-92ae-f5cb65064fd0 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:34.000845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1288/2565] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:33 2022] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:34.002119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90e150-2a07-4914-abdf-b4bfbf95f48b tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:34.012768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90e150-2a07-4914-abdf-b4bfbf95f48b tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:34.073606 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbdbb2-cc04-4754-82ba-f54e7aeb35ee tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3d018fb92414230a2fe85e3aa60d9eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0e60e0ec1c45f5b87cbf36b4e2f317', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:34.074126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbdbb2-cc04-4754-82ba-f54e7aeb35ee tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:34.074418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbdbb2-cc04-4754-82ba-f54e7aeb35ee tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:34.074699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbdbb2-cc04-4754-82ba-f54e7aeb35ee tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:34.075361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbdbb2-cc04-4754-82ba-f54e7aeb35ee tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:34.075703 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbdbb2-cc04-4754-82ba-f54e7aeb35ee tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:34.077949 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbdbb2-cc04-4754-82ba-f54e7aeb35ee tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:34.090705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1278/2566] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:34.135985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8239a4d-30dd-4fe5-92ae-f5cb65064fd0 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:34.147021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8239a4d-30dd-4fe5-92ae-f5cb65064fd0 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:34.151852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1c08d-31e8-46b1-8135-6bbdd978a844 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3d018fb92414230a2fe85e3aa60d9eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0e60e0ec1c45f5b87cbf36b4e2f317', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:34.152490 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1c08d-31e8-46b1-8135-6bbdd978a844 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:34.152772 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1c08d-31e8-46b1-8135-6bbdd978a844 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:34.153051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1c08d-31e8-46b1-8135-6bbdd978a844 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] PATH_INFO: `/v3/projects/07386e6c5c8d4986bf223f5c7a7473f6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:34.154220 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1c08d-31e8-46b1-8135-6bbdd978a844 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: Authorizing `identity:delete_project(project_id=07386e6c5c8d4986bf223f5c7a7473f6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:34.156229 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1c08d-31e8-46b1-8135-6bbdd978a844 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:34.172646 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:34.210442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c9c1c08d-31e8-46b1-8135-6bbdd978a844 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07386e6c5c8d4986bf223f5c7a7473f6', 'request_id': 'req-c9c1c08d-31e8-46b1-8135-6bbdd978a844'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.216179 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c9c1c08d-31e8-46b1-8135-6bbdd978a844 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07386e6c5c8d4986bf223f5c7a7473f6', 'request_id': 'req-c9c1c08d-31e8-46b1-8135-6bbdd978a844'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.222703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c9c1c08d-31e8-46b1-8135-6bbdd978a844 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07386e6c5c8d4986bf223f5c7a7473f6', 'request_id': 'req-c9c1c08d-31e8-46b1-8135-6bbdd978a844'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.237619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c9c1c08d-31e8-46b1-8135-6bbdd978a844 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] The token cache is being invalidate because project 07386e6c5c8d4986bf223f5c7a7473f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:34.237934 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c9c1c08d-31e8-46b1-8135-6bbdd978a844 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.238659 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c9c1c08d-31e8-46b1-8135-6bbdd978a844 tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.240582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1289/2567] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:34 2022] DELETE /identity/v3/projects/07386e6c5c8d4986bf223f5c7a7473f6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:34.460806 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbdbb2-cc04-4754-82ba-f54e7aeb35ee tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:34.462538 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0fcbdbb2-cc04-4754-82ba-f54e7aeb35ee tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:34.549622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbdbb2-cc04-4754-82ba-f54e7aeb35ee tempest-VolumeQuotaClassesTest-483770159 tempest-VolumeQuotaClassesTest-483770159-project-admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:34.557065 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:34.645029 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:34.646023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:34.646507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:34.646948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] PATH_INFO: `/v3/users/1442795615a24359aefca123b1de30af` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:34.649059 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1442795615a24359aefca123b1de30af)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:34.652961 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:34.731854 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1442795615a24359aefca123b1de30af'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.746331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1442795615a24359aefca123b1de30af'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.752971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1442795615a24359aefca123b1de30af'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.752971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1442795615a24359aefca123b1de30af'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.773334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1442795615a24359aefca123b1de30af'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.799617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1279/2568] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:34 2022] DELETE /identity/v3/users/1442795615a24359aefca123b1de30af => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:34.804882 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dda3d-61fd-4626-9e37-11febc922e1f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:34.805383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dda3d-61fd-4626-9e37-11febc922e1f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:34.806100 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dda3d-61fd-4626-9e37-11febc922e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:34.835036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-be9dda3d-61fd-4626-9e37-11febc922e1f None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:34.836425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-be9dda3d-61fd-4626-9e37-11febc922e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:34.924018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1290/2569] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:34.940932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:34.943455 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:35.027748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de913e61-a822-4acf-bc60-2c00a6a23d96 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:35.032013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574a09d-477d-4d21-b25e-33d3f2ab5a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:35.032625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574a09d-477d-4d21-b25e-33d3f2ab5a24 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:35.032905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574a09d-477d-4d21-b25e-33d3f2ab5a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:35.033180 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574a09d-477d-4d21-b25e-33d3f2ab5a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:35.042751 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574a09d-477d-4d21-b25e-33d3f2ab5a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:35.044226 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574a09d-477d-4d21-b25e-33d3f2ab5a24 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:35.062965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1280/2570] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:35.606429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dda3d-61fd-4626-9e37-11febc922e1f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:35.608123 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-be9dda3d-61fd-4626-9e37-11febc922e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:35.626974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dda3d-61fd-4626-9e37-11febc922e1f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:35.631751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:35.633119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:35.633119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:35.633119 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] PATH_INFO: `/v3/projects/3a2096b22fad49ce80e18475e4e5a04e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:35.634253 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2096b22fad49ce80e18475e4e5a04e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:35.636165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:35.691998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2096b22fad49ce80e18475e4e5a04e', 'request_id': 'req-db3f480d-ef20-49fb-8230-644de8fc63fe'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:35.700465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2096b22fad49ce80e18475e4e5a04e', 'request_id': 'req-db3f480d-ef20-49fb-8230-644de8fc63fe'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:35.707859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2096b22fad49ce80e18475e4e5a04e', 'request_id': 'req-db3f480d-ef20-49fb-8230-644de8fc63fe'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:35.721669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] The token cache is being invalidate because project 3a2096b22fad49ce80e18475e4e5a04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:35.721952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:35.722627 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:35.724480 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1291/2571] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:35 2022] DELETE /identity/v3/projects/3a2096b22fad49ce80e18475e4e5a04e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:35.728524 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574a09d-477d-4d21-b25e-33d3f2ab5a24 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:35.739284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574a09d-477d-4d21-b25e-33d3f2ab5a24 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:35.769820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:35.808897 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d72b25-bbda-4077-99be-9cf7eb4bc6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:35.809553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d72b25-bbda-4077-99be-9cf7eb4bc6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:35.809837 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d72b25-bbda-4077-99be-9cf7eb4bc6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:35.810113 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d72b25-bbda-4077-99be-9cf7eb4bc6da admin admin] PATH_INFO: `/v3/users/f3d018fb92414230a2fe85e3aa60d9eb` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:35.812126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d72b25-bbda-4077-99be-9cf7eb4bc6da admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d018fb92414230a2fe85e3aa60d9eb)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:35.814410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d72b25-bbda-4077-99be-9cf7eb4bc6da admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:35.882658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-80d72b25-bbda-4077-99be-9cf7eb4bc6da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d018fb92414230a2fe85e3aa60d9eb'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:35.898623 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-80d72b25-bbda-4077-99be-9cf7eb4bc6da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d018fb92414230a2fe85e3aa60d9eb'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:35.900338 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-80d72b25-bbda-4077-99be-9cf7eb4bc6da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d018fb92414230a2fe85e3aa60d9eb'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:35.901038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-80d72b25-bbda-4077-99be-9cf7eb4bc6da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d018fb92414230a2fe85e3aa60d9eb'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:35.920020 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-80d72b25-bbda-4077-99be-9cf7eb4bc6da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d018fb92414230a2fe85e3aa60d9eb'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:35.939979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1281/2572] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:35 2022] DELETE /identity/v3/users/f3d018fb92414230a2fe85e3aa60d9eb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:36.383353 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:36.385620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:36.419159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f480d-ef20-49fb-8230-644de8fc63fe admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:36.524260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:36.600070 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d53fe-d004-4f33-9840-c87f4568f0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:36.602917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d53fe-d004-4f33-9840-c87f4568f0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:36.603209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d53fe-d004-4f33-9840-c87f4568f0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:36.603498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d53fe-d004-4f33-9840-c87f4568f0d6 admin admin] PATH_INFO: `/v3/projects/3b0e60e0ec1c45f5b87cbf36b4e2f317` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:36.608014 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d53fe-d004-4f33-9840-c87f4568f0d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0e60e0ec1c45f5b87cbf36b4e2f317)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:36.611615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d53fe-d004-4f33-9840-c87f4568f0d6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:36.735637 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e09d53fe-d004-4f33-9840-c87f4568f0d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0e60e0ec1c45f5b87cbf36b4e2f317', 'request_id': 'req-e09d53fe-d004-4f33-9840-c87f4568f0d6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:36.742000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e09d53fe-d004-4f33-9840-c87f4568f0d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0e60e0ec1c45f5b87cbf36b4e2f317', 'request_id': 'req-e09d53fe-d004-4f33-9840-c87f4568f0d6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:36.750121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e09d53fe-d004-4f33-9840-c87f4568f0d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0e60e0ec1c45f5b87cbf36b4e2f317', 'request_id': 'req-e09d53fe-d004-4f33-9840-c87f4568f0d6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:36.771579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e09d53fe-d004-4f33-9840-c87f4568f0d6 admin admin] The token cache is being invalidate because project 3b0e60e0ec1c45f5b87cbf36b4e2f317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:36.772166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e09d53fe-d004-4f33-9840-c87f4568f0d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:36.773126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e09d53fe-d004-4f33-9840-c87f4568f0d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:36.774925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1292/2573] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:36 2022] DELETE /identity/v3/projects/3b0e60e0ec1c45f5b87cbf36b4e2f317 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:36.782397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0bbe-e8f4-4885-bfcf-10187644a9be None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:36.783196 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0bbe-e8f4-4885-bfcf-10187644a9be None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:36.783687 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0bbe-e8f4-4885-bfcf-10187644a9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:36.817418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-8a4c0bbe-e8f4-4885-bfcf-10187644a9be None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:36.818863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8a4c0bbe-e8f4-4885-bfcf-10187644a9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:36.942647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1282/2574] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:36.954966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cb2a5-6b70-45a0-a300-a5921c45c912 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:36.955995 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cb2a5-6b70-45a0-a300-a5921c45c912 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:36.956600 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cb2a5-6b70-45a0-a300-a5921c45c912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:36.999616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fb6cb2a5-6b70-45a0-a300-a5921c45c912 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:37.001273 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fb6cb2a5-6b70-45a0-a300-a5921c45c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:37.018028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1293/2575] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:37.022390 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c0bbe-e8f4-4885-bfcf-10187644a9be None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:37.034122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c0bbe-e8f4-4885-bfcf-10187644a9be None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.041662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc9437-2224-4bd0-affe-1caa27f6a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.042322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc9437-2224-4bd0-affe-1caa27f6a90a admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.042653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc9437-2224-4bd0-affe-1caa27f6a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.042981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc9437-2224-4bd0-affe-1caa27f6a90a admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.043603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc9437-2224-4bd0-affe-1caa27f6a90a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:37.044119 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc9437-2224-4bd0-affe-1caa27f6a90a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.046159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc9437-2224-4bd0-affe-1caa27f6a90a admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:37.060161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1283/2576] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:37.067850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cb2a5-6b70-45a0-a300-a5921c45c912 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:37.085103 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cb2a5-6b70-45a0-a300-a5921c45c912 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.097486 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c52fae-d8c2-4621-af73-9b669db1b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.098527 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c52fae-d8c2-4621-af73-9b669db1b23f admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.098976 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c52fae-d8c2-4621-af73-9b669db1b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.099419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c52fae-d8c2-4621-af73-9b669db1b23f admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.100514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c52fae-d8c2-4621-af73-9b669db1b23f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.103893 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c52fae-d8c2-4621-af73-9b669db1b23f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:37.161666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1294/2577] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:37 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:37.163037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc9437-2224-4bd0-affe-1caa27f6a90a admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:37.175241 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc9437-2224-4bd0-affe-1caa27f6a90a admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.230262 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:37.268682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba4ed6-1ecd-40ef-ab20-789c5a880ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.269556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba4ed6-1ecd-40ef-ab20-789c5a880ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.271313 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba4ed6-1ecd-40ef-ab20-789c5a880ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.271637 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba4ed6-1ecd-40ef-ab20-789c5a880ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.272285 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba4ed6-1ecd-40ef-ab20-789c5a880ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.274453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba4ed6-1ecd-40ef-ab20-789c5a880ac5 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:37.308832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1284/2578] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:37 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:37.310328 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c52fae-d8c2-4621-af73-9b669db1b23f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:37.322933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c52fae-d8c2-4621-af73-9b669db1b23f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.327886 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d7989-6bc9-42dc-9196-d6438aa3c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.328895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7989-6bc9-42dc-9196-d6438aa3c80d admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.329081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7989-6bc9-42dc-9196-d6438aa3c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.329595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7989-6bc9-42dc-9196-d6438aa3c80d admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.330520 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d7989-6bc9-42dc-9196-d6438aa3c80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.332891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d7989-6bc9-42dc-9196-d6438aa3c80d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:37.349663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1295/2579] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:37.351860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba4ed6-1ecd-40ef-ab20-789c5a880ac5 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:37.364411 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba4ed6-1ecd-40ef-ab20-789c5a880ac5 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.372927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3da43-1670-4362-accf-b64321a4ae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.374055 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3da43-1670-4362-accf-b64321a4ae89 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.374506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3da43-1670-4362-accf-b64321a4ae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.375081 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3da43-1670-4362-accf-b64321a4ae89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.376110 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3da43-1670-4362-accf-b64321a4ae89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.378259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3da43-1670-4362-accf-b64321a4ae89 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:37.398077 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1285/2580] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:37.402571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d7989-6bc9-42dc-9196-d6438aa3c80d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:37.413968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d7989-6bc9-42dc-9196-d6438aa3c80d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.418641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac8083-6612-416b-9550-36e9dc4d3a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.419314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac8083-6612-416b-9550-36e9dc4d3a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.419599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac8083-6612-416b-9550-36e9dc4d3a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.419910 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac8083-6612-416b-9550-36e9dc4d3a24 admin admin] PATH_INFO: `/v3/projects/59ec4e8592cb4b08882d1c3ffc21e1fd/users/bed319b2919a40819cc0eeef41cab24b/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.439678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac8083-6612-416b-9550-36e9dc4d3a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ec4e8592cb4b08882d1c3ffc21e1fd, user_id=bed319b2919a40819cc0eeef41cab24b, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.442913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac8083-6612-416b-9550-36e9dc4d3a24 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:37.462720 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1296/2581] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:37 2022] PUT /identity/v3/projects/59ec4e8592cb4b08882d1c3ffc21e1fd/users/bed319b2919a40819cc0eeef41cab24b/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:37.476945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5f374-c095-48ed-8393-6afaf1decda5 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.477346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5f374-c095-48ed-8393-6afaf1decda5 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.477632 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5f374-c095-48ed-8393-6afaf1decda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.513143 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b5c5f374-c095-48ed-8393-6afaf1decda5 None None] MFA Rules not processed for user `bed319b2919a40819cc0eeef41cab24b`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:37.515507 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b5c5f374-c095-48ed-8393-6afaf1decda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:37.613839 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1286/2582] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:37.626006 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac8083-6612-416b-9550-36e9dc4d3a24 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:37.628116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e9ac8083-6612-416b-9550-36e9dc4d3a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:37.707255 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac8083-6612-416b-9550-36e9dc4d3a24 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.712547 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417528b9-3dbb-4bfc-9dd7-8ff9c026d34f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.713486 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417528b9-3dbb-4bfc-9dd7-8ff9c026d34f service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.714350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417528b9-3dbb-4bfc-9dd7-8ff9c026d34f service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.714350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417528b9-3dbb-4bfc-9dd7-8ff9c026d34f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.729116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:37.736567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417528b9-3dbb-4bfc-9dd7-8ff9c026d34f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.738763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417528b9-3dbb-4bfc-9dd7-8ff9c026d34f service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:37.757002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1297/2583] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:37.797720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5f374-c095-48ed-8393-6afaf1decda5 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:37.894433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5f374-c095-48ed-8393-6afaf1decda5 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.899801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.900860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.901303 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.901765 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] PATH_INFO: `/v3/users/bed319b2919a40819cc0eeef41cab24b` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.903297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed319b2919a40819cc0eeef41cab24b)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.905846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:37.969863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:37.972386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed319b2919a40819cc0eeef41cab24b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:37.987277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed319b2919a40819cc0eeef41cab24b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:37.987907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed319b2919a40819cc0eeef41cab24b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:37.988621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed319b2919a40819cc0eeef41cab24b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.012087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed319b2919a40819cc0eeef41cab24b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.034161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1287/2584] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:37 2022] DELETE /identity/v3/users/bed319b2919a40819cc0eeef41cab24b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:38.038867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fac6e6-47b8-47ee-bc4e-b5666ebb6fd0 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.039804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fac6e6-47b8-47ee-bc4e-b5666ebb6fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.039804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fac6e6-47b8-47ee-bc4e-b5666ebb6fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.080805 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-37fac6e6-47b8-47ee-bc4e-b5666ebb6fd0 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:38.082040 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-37fac6e6-47b8-47ee-bc4e-b5666ebb6fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:38.161994 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1298/2585] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:38.174273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:38.176582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:38.257579 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be5c43-f8bb-4cad-9432-2d1b36254236 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:38.261674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe383a-d23b-4c81-89e0-3747a34ca333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:38.263001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe383a-d23b-4c81-89e0-3747a34ca333 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.263001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe383a-d23b-4c81-89e0-3747a34ca333 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.263001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe383a-d23b-4c81-89e0-3747a34ca333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.275744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe383a-d23b-4c81-89e0-3747a34ca333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:38.277802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe383a-d23b-4c81-89e0-3747a34ca333 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:38.290164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1288/2586] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:38.626047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fac6e6-47b8-47ee-bc4e-b5666ebb6fd0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:38.627511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-37fac6e6-47b8-47ee-bc4e-b5666ebb6fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:38.640178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fac6e6-47b8-47ee-bc4e-b5666ebb6fd0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:38.645376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2ab45-c655-49c0-9065-db4a27117bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:38.646128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2ab45-c655-49c0-9065-db4a27117bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.646479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2ab45-c655-49c0-9065-db4a27117bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.646768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2ab45-c655-49c0-9065-db4a27117bae admin admin] PATH_INFO: `/v3/users/ee4becbb8cf24984a68743a1c099fff5` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.648587 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2ab45-c655-49c0-9065-db4a27117bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4becbb8cf24984a68743a1c099fff5)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:38.650575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2ab45-c655-49c0-9065-db4a27117bae admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:38.712946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe383a-d23b-4c81-89e0-3747a34ca333 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:38.714691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d0fe383a-d23b-4c81-89e0-3747a34ca333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:38.728257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-95d2ab45-c655-49c0-9065-db4a27117bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4becbb8cf24984a68743a1c099fff5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.738118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe383a-d23b-4c81-89e0-3747a34ca333 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:38.741549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-95d2ab45-c655-49c0-9065-db4a27117bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4becbb8cf24984a68743a1c099fff5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.756916 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:38.757610 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.758004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.758344 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] PATH_INFO: `/v3/projects/59ec4e8592cb4b08882d1c3ffc21e1fd` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.759550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-95d2ab45-c655-49c0-9065-db4a27117bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4becbb8cf24984a68743a1c099fff5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.759750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ec4e8592cb4b08882d1c3ffc21e1fd)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:38.760351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-95d2ab45-c655-49c0-9065-db4a27117bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4becbb8cf24984a68743a1c099fff5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.762125 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:38.786398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-95d2ab45-c655-49c0-9065-db4a27117bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4becbb8cf24984a68743a1c099fff5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.801924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1299/2587] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:38 2022] DELETE /identity/v3/users/ee4becbb8cf24984a68743a1c099fff5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:38.806385 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0756f-1279-4159-af8c-ce51d475bee3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.806680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0756f-1279-4159-af8c-ce51d475bee3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.806961 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0756f-1279-4159-af8c-ce51d475bee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.829895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-22b0756f-1279-4159-af8c-ce51d475bee3 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:38.831432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-22b0756f-1279-4159-af8c-ce51d475bee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:38.836676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ec4e8592cb4b08882d1c3ffc21e1fd', 'request_id': 'req-0845ff35-ffa0-4b49-b800-56dcb43fde5b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.845454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ec4e8592cb4b08882d1c3ffc21e1fd', 'request_id': 'req-0845ff35-ffa0-4b49-b800-56dcb43fde5b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.853511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ec4e8592cb4b08882d1c3ffc21e1fd', 'request_id': 'req-0845ff35-ffa0-4b49-b800-56dcb43fde5b'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.876246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] The token cache is being invalidate because project 59ec4e8592cb4b08882d1c3ffc21e1fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:38.876553 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.877243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.879259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1289/2588] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:38 2022] DELETE /identity/v3/projects/59ec4e8592cb4b08882d1c3ffc21e1fd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:38.916419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1300/2589] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:38.928216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:38.929767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:39.019122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:39.025013 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845ff35-ffa0-4b49-b800-56dcb43fde5b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:39.030780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf87a4-9b92-4a70-8a38-9542e3145b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:39.031497 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf87a4-9b92-4a70-8a38-9542e3145b8c service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:39.031998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf87a4-9b92-4a70-8a38-9542e3145b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:39.032229 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf87a4-9b92-4a70-8a38-9542e3145b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:39.043804 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf87a4-9b92-4a70-8a38-9542e3145b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:39.045813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf87a4-9b92-4a70-8a38-9542e3145b8c service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:39.056851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1290/2590] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:39.373105 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0756f-1279-4159-af8c-ce51d475bee3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:39.374728 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-22b0756f-1279-4159-af8c-ce51d475bee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:39.401970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0756f-1279-4159-af8c-ce51d475bee3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:39.419536 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:39.420601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:39.420885 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:39.421165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] PATH_INFO: `/v3/projects/3b8ab1516b9b48b789170727f3a2ba3f` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:39.422419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8ab1516b9b48b789170727f3a2ba3f)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:39.424644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:39.429007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:39.484891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8ab1516b9b48b789170727f3a2ba3f', 'request_id': 'req-d5339e6f-6f52-491a-bab0-ea34b649d63d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:39.490745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8ab1516b9b48b789170727f3a2ba3f', 'request_id': 'req-d5339e6f-6f52-491a-bab0-ea34b649d63d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:39.497165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8ab1516b9b48b789170727f3a2ba3f', 'request_id': 'req-d5339e6f-6f52-491a-bab0-ea34b649d63d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:39.511151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] The token cache is being invalidate because project 3b8ab1516b9b48b789170727f3a2ba3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:39.511448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:39.512126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:39.513754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1301/2591] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:39 2022] DELETE /identity/v3/projects/3b8ab1516b9b48b789170727f3a2ba3f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:39.518127 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf87a4-9b92-4a70-8a38-9542e3145b8c service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:39.528182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf87a4-9b92-4a70-8a38-9542e3145b8c service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:39.610659 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555edfe6-a766-4aeb-9a5a-f857f5521482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:39.611326 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555edfe6-a766-4aeb-9a5a-f857f5521482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:39.611603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555edfe6-a766-4aeb-9a5a-f857f5521482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:39.611910 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555edfe6-a766-4aeb-9a5a-f857f5521482 admin admin] PATH_INFO: `/v3/users/1ee96c27aef14d4c9c542aff332cdbed` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:39.613070 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555edfe6-a766-4aeb-9a5a-f857f5521482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee96c27aef14d4c9c542aff332cdbed)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:39.614996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555edfe6-a766-4aeb-9a5a-f857f5521482 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:39.665950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-555edfe6-a766-4aeb-9a5a-f857f5521482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee96c27aef14d4c9c542aff332cdbed'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:39.673360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-555edfe6-a766-4aeb-9a5a-f857f5521482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee96c27aef14d4c9c542aff332cdbed'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:39.674002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-555edfe6-a766-4aeb-9a5a-f857f5521482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee96c27aef14d4c9c542aff332cdbed'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:39.674640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-555edfe6-a766-4aeb-9a5a-f857f5521482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee96c27aef14d4c9c542aff332cdbed'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:39.687101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-555edfe6-a766-4aeb-9a5a-f857f5521482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee96c27aef14d4c9c542aff332cdbed'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:39.700467 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1291/2592] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:39 2022] DELETE /identity/v3/users/1ee96c27aef14d4c9c542aff332cdbed => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:39.994774 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:39.997188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:40.019471 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5339e6f-6f52-491a-bab0-ea34b649d63d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.098804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dfb25-f072-4e06-965a-fd612f3120f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.100542 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dfb25-f072-4e06-965a-fd612f3120f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.100867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dfb25-f072-4e06-965a-fd612f3120f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.101206 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dfb25-f072-4e06-965a-fd612f3120f3 admin admin] PATH_INFO: `/v3/projects/ff97d94ada614afc9a96b0d1fab6e69e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.102601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999dfb25-f072-4e06-965a-fd612f3120f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff97d94ada614afc9a96b0d1fab6e69e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.104753 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999dfb25-f072-4e06-965a-fd612f3120f3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.156532 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-999dfb25-f072-4e06-965a-fd612f3120f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff97d94ada614afc9a96b0d1fab6e69e', 'request_id': 'req-999dfb25-f072-4e06-965a-fd612f3120f3'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:40.162330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-999dfb25-f072-4e06-965a-fd612f3120f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff97d94ada614afc9a96b0d1fab6e69e', 'request_id': 'req-999dfb25-f072-4e06-965a-fd612f3120f3'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:40.169216 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-999dfb25-f072-4e06-965a-fd612f3120f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff97d94ada614afc9a96b0d1fab6e69e', 'request_id': 'req-999dfb25-f072-4e06-965a-fd612f3120f3'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:40.185726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-999dfb25-f072-4e06-965a-fd612f3120f3 admin admin] The token cache is being invalidate because project ff97d94ada614afc9a96b0d1fab6e69e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:40.186514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-999dfb25-f072-4e06-965a-fd612f3120f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:40.187902 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-999dfb25-f072-4e06-965a-fd612f3120f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:40.189885 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1302/2593] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:39 2022] DELETE /identity/v3/projects/ff97d94ada614afc9a96b0d1fab6e69e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:40.194959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55a1c4-077c-4f74-a84e-312e5d90e749 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.195464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55a1c4-077c-4f74-a84e-312e5d90e749 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.195593 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55a1c4-077c-4f74-a84e-312e5d90e749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.217500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-3d55a1c4-077c-4f74-a84e-312e5d90e749 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:40.218921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-3d55a1c4-077c-4f74-a84e-312e5d90e749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:40.294235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1292/2594] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:40.302470 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e6183-8caf-4f0b-b7c9-14b3a71d8462 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.302751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e6183-8caf-4f0b-b7c9-14b3a71d8462 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.303022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e6183-8caf-4f0b-b7c9-14b3a71d8462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.323403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fc9e6183-8caf-4f0b-b7c9-14b3a71d8462 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:40.324559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fc9e6183-8caf-4f0b-b7c9-14b3a71d8462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:40.333384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1303/2595] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:40.337493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55a1c4-077c-4f74-a84e-312e5d90e749 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.347530 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55a1c4-077c-4f74-a84e-312e5d90e749 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.352194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d746716-b3da-411e-aafa-56db31e9cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.352796 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d746716-b3da-411e-aafa-56db31e9cc0d admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.353075 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d746716-b3da-411e-aafa-56db31e9cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.353348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d746716-b3da-411e-aafa-56db31e9cc0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.354003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d746716-b3da-411e-aafa-56db31e9cc0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:40.354306 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d746716-b3da-411e-aafa-56db31e9cc0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.355914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d746716-b3da-411e-aafa-56db31e9cc0d admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.363092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:40.371688 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1293/2596] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:40.377614 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e6183-8caf-4f0b-b7c9-14b3a71d8462 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.387809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e6183-8caf-4f0b-b7c9-14b3a71d8462 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.393154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ad9df-c3ee-4b0c-996c-089cf7c613bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.393779 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ad9df-c3ee-4b0c-996c-089cf7c613bb admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.394088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ad9df-c3ee-4b0c-996c-089cf7c613bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.394356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ad9df-c3ee-4b0c-996c-089cf7c613bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.394981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ad9df-c3ee-4b0c-996c-089cf7c613bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.396916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ad9df-c3ee-4b0c-996c-089cf7c613bb admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.412364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:40.434269 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1304/2597] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:40 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:40.439052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d746716-b3da-411e-aafa-56db31e9cc0d admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.449305 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d746716-b3da-411e-aafa-56db31e9cc0d admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.507841 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4087bbc-6ef3-44ab-8412-bb7e71847e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.508455 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4087bbc-6ef3-44ab-8412-bb7e71847e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.508739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4087bbc-6ef3-44ab-8412-bb7e71847e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.509015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4087bbc-6ef3-44ab-8412-bb7e71847e7c admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.509657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4087bbc-6ef3-44ab-8412-bb7e71847e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.511593 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4087bbc-6ef3-44ab-8412-bb7e71847e7c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.533195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1294/2598] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:40 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:40.537470 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ad9df-c3ee-4b0c-996c-089cf7c613bb admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.548770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ad9df-c3ee-4b0c-996c-089cf7c613bb admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.553499 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a894b7-2ae3-4c63-9b1a-ce2f18128a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.554106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a894b7-2ae3-4c63-9b1a-ce2f18128a18 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.554386 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a894b7-2ae3-4c63-9b1a-ce2f18128a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.554657 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a894b7-2ae3-4c63-9b1a-ce2f18128a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.555301 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a894b7-2ae3-4c63-9b1a-ce2f18128a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.556937 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a894b7-2ae3-4c63-9b1a-ce2f18128a18 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.568357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1305/2599] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:40.572779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4087bbc-6ef3-44ab-8412-bb7e71847e7c admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.583924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4087bbc-6ef3-44ab-8412-bb7e71847e7c admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.591635 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aa939-6033-4270-9933-224350bfc039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.592339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa939-6033-4270-9933-224350bfc039 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.592626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa939-6033-4270-9933-224350bfc039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.592900 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa939-6033-4270-9933-224350bfc039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.593675 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aa939-6033-4270-9933-224350bfc039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.595179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aa939-6033-4270-9933-224350bfc039 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.606644 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1295/2600] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:40.611578 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a894b7-2ae3-4c63-9b1a-ce2f18128a18 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.621891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a894b7-2ae3-4c63-9b1a-ce2f18128a18 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.635070 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e20a-b6b4-4e7c-b613-b6c20fe366ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.635709 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e20a-b6b4-4e7c-b613-b6c20fe366ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.636258 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e20a-b6b4-4e7c-b613-b6c20fe366ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.636550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e20a-b6b4-4e7c-b613-b6c20fe366ba admin admin] PATH_INFO: `/v3/projects/e4ef5b1886124dd8869dd8e81cbbac5c/users/0feeec6a62c24d258ded79aa14709591/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.657368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3e20a-b6b4-4e7c-b613-b6c20fe366ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ef5b1886124dd8869dd8e81cbbac5c, user_id=0feeec6a62c24d258ded79aa14709591, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.660147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3e20a-b6b4-4e7c-b613-b6c20fe366ba admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.675691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1306/2601] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:40 2022] PUT /identity/v3/projects/e4ef5b1886124dd8869dd8e81cbbac5c/users/0feeec6a62c24d258ded79aa14709591/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:40.688383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d9fff-1275-433e-bfbf-c766a581e8b5 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.688679 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d9fff-1275-433e-bfbf-c766a581e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.689072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d9fff-1275-433e-bfbf-c766a581e8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.718118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-456d9fff-1275-433e-bfbf-c766a581e8b5 None None] MFA Rules not processed for user `0feeec6a62c24d258ded79aa14709591`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:40.719352 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-456d9fff-1275-433e-bfbf-c766a581e8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:40.798788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1296/2602] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:40.803562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e20a-b6b4-4e7c-b613-b6c20fe366ba admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.877751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e20a-b6b4-4e7c-b613-b6c20fe366ba admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.883512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457a965-f929-4318-84a3-4109c8726733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.884421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457a965-f929-4318-84a3-4109c8726733 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.884732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457a965-f929-4318-84a3-4109c8726733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.884732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457a965-f929-4318-84a3-4109c8726733 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.885397 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457a965-f929-4318-84a3-4109c8726733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.887549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457a965-f929-4318-84a3-4109c8726733 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.928504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1307/2603] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:40 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:40.934325 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d9fff-1275-433e-bfbf-c766a581e8b5 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.949067 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d9fff-1275-433e-bfbf-c766a581e8b5 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:41.013643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c736f-fed8-45b2-81e7-3c78155ecf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:41.014270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c736f-fed8-45b2-81e7-3c78155ecf91 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:41.014551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c736f-fed8-45b2-81e7-3c78155ecf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:41.014821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c736f-fed8-45b2-81e7-3c78155ecf91 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:41.015479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c736f-fed8-45b2-81e7-3c78155ecf91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:41.017424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c736f-fed8-45b2-81e7-3c78155ecf91 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:41.030341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:41.046210 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1297/2604] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:40 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:41.051452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457a965-f929-4318-84a3-4109c8726733 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:41.064343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457a965-f929-4318-84a3-4109c8726733 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:41.069504 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc977ee-90cb-4eff-9c27-07386838202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:41.070297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc977ee-90cb-4eff-9c27-07386838202d admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:41.070617 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc977ee-90cb-4eff-9c27-07386838202d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:41.070916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc977ee-90cb-4eff-9c27-07386838202d admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:41.071569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc977ee-90cb-4eff-9c27-07386838202d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:41.073224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc977ee-90cb-4eff-9c27-07386838202d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:41.085557 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1308/2605] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:41.090412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c736f-fed8-45b2-81e7-3c78155ecf91 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:41.103618 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c736f-fed8-45b2-81e7-3c78155ecf91 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:41.109866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709378e7-7f01-4e2d-ae00-855e58f1f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:41.110559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709378e7-7f01-4e2d-ae00-855e58f1f4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:41.110845 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709378e7-7f01-4e2d-ae00-855e58f1f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:41.111179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709378e7-7f01-4e2d-ae00-855e58f1f4a7 admin admin] PATH_INFO: `/v3/projects/2e42250fe6454289aed6dd255820f9c7/users/a4b7d7c4c47544da92b78be43dd40137/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:41.128799 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709378e7-7f01-4e2d-ae00-855e58f1f4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e42250fe6454289aed6dd255820f9c7, user_id=a4b7d7c4c47544da92b78be43dd40137, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:41.131762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709378e7-7f01-4e2d-ae00-855e58f1f4a7 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:41.148922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1298/2606] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:41 2022] PUT /identity/v3/projects/2e42250fe6454289aed6dd255820f9c7/users/a4b7d7c4c47544da92b78be43dd40137/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:41.153890 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc977ee-90cb-4eff-9c27-07386838202d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:41.165550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc977ee-90cb-4eff-9c27-07386838202d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:41.249844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a589c2-eb73-4503-b6aa-2b5d9406bc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:41.249844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a589c2-eb73-4503-b6aa-2b5d9406bc41 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:41.249844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a589c2-eb73-4503-b6aa-2b5d9406bc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:41.249844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a589c2-eb73-4503-b6aa-2b5d9406bc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:41.250462 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a589c2-eb73-4503-b6aa-2b5d9406bc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:41.251815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a589c2-eb73-4503-b6aa-2b5d9406bc41 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:41.256633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709378e7-7f01-4e2d-ae00-855e58f1f4a7 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:41.258452 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-709378e7-7f01-4e2d-ae00-855e58f1f4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:41.262974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1309/2607] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:41.268781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a589c2-eb73-4503-b6aa-2b5d9406bc41 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:41.280938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a589c2-eb73-4503-b6aa-2b5d9406bc41 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:41.295641 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9f7d3-edec-4fba-b4bc-72563a5e8a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:41.296939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9f7d3-edec-4fba-b4bc-72563a5e8a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:41.297449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9f7d3-edec-4fba-b4bc-72563a5e8a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:41.297933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9f7d3-edec-4fba-b4bc-72563a5e8a84 admin admin] PATH_INFO: `/v3/projects/2e42250fe6454289aed6dd255820f9c7/users/a4b7d7c4c47544da92b78be43dd40137/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:41.301436 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9f7d3-edec-4fba-b4bc-72563a5e8a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e42250fe6454289aed6dd255820f9c7, user_id=a4b7d7c4c47544da92b78be43dd40137, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:41.306472 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9f7d3-edec-4fba-b4bc-72563a5e8a84 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:41.323962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1310/2608] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:41 2022] PUT /identity/v3/projects/2e42250fe6454289aed6dd255820f9c7/users/a4b7d7c4c47544da92b78be43dd40137/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:41.324433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709378e7-7f01-4e2d-ae00-855e58f1f4a7 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:41.341700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192350c-a254-4610-ab10-5bba64ad97b7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:41.342763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192350c-a254-4610-ab10-5bba64ad97b7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:41.343233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192350c-a254-4610-ab10-5bba64ad97b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:41.376683 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0f790-51f2-4917-a7cf-622f1b5dbdb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:41.377329 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f790-51f2-4917-a7cf-622f1b5dbdb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:41.377673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f790-51f2-4917-a7cf-622f1b5dbdb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:41.377907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f790-51f2-4917-a7cf-622f1b5dbdb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:41.381259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f4e0f790-51f2-4917-a7cf-622f1b5dbdb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:41.383446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c192350c-a254-4610-ab10-5bba64ad97b7 None None] MFA Rules not processed for user `a4b7d7c4c47544da92b78be43dd40137`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:41.385057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c192350c-a254-4610-ab10-5bba64ad97b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:41.391853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:41.455401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0f790-51f2-4917-a7cf-622f1b5dbdb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:41.456940 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0f790-51f2-4917-a7cf-622f1b5dbdb1 service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:41.469472 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1299/2609] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:41.471113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1311/2610] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:41.482726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0f790-51f2-4917-a7cf-622f1b5dbdb1 service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:41.484306 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f4e0f790-51f2-4917-a7cf-622f1b5dbdb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:41.532343 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:41.550305 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0f790-51f2-4917-a7cf-622f1b5dbdb1 service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:41.554008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe7be8-3d5a-427d-98e6-a7edbae3e549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:41.554622 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe7be8-3d5a-427d-98e6-a7edbae3e549 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:41.554902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe7be8-3d5a-427d-98e6-a7edbae3e549 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:41.555170 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe7be8-3d5a-427d-98e6-a7edbae3e549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:41.565358 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe7be8-3d5a-427d-98e6-a7edbae3e549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:41.566819 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe7be8-3d5a-427d-98e6-a7edbae3e549 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:41.577737 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1300/2611] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:42.018006 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192350c-a254-4610-ab10-5bba64ad97b7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:42.034098 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192350c-a254-4610-ab10-5bba64ad97b7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:42.039111 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:42.043307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:42.043604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:42.043918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] PATH_INFO: `/v3/users/0feeec6a62c24d258ded79aa14709591` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:42.045706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0feeec6a62c24d258ded79aa14709591)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:42.047671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:42.114259 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0feeec6a62c24d258ded79aa14709591'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.124970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0feeec6a62c24d258ded79aa14709591'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.138028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0feeec6a62c24d258ded79aa14709591'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.139285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0feeec6a62c24d258ded79aa14709591'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.152535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0feeec6a62c24d258ded79aa14709591'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.159305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1312/2612] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:42 2022] DELETE /identity/v3/users/0feeec6a62c24d258ded79aa14709591 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:42.164234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ae59c-53ca-480e-b280-06b8c4876eb7 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:42.164741 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ae59c-53ca-480e-b280-06b8c4876eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:42.165432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ae59c-53ca-480e-b280-06b8c4876eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:42.188683 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d81ae59c-53ca-480e-b280-06b8c4876eb7 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:42.190016 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d81ae59c-53ca-480e-b280-06b8c4876eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:42.268342 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1301/2613] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:42.280478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:42.286829 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:42.371284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee215c-b7c7-4547-bd33-d1a419df04a2 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:42.376801 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ec7c-d06b-4f3b-a1e8-a3cc8660a981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:42.377611 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ec7c-d06b-4f3b-a1e8-a3cc8660a981 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:42.377803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ec7c-d06b-4f3b-a1e8-a3cc8660a981 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:42.378079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ec7c-d06b-4f3b-a1e8-a3cc8660a981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:42.388721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58ec7c-d06b-4f3b-a1e8-a3cc8660a981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:42.390134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58ec7c-d06b-4f3b-a1e8-a3cc8660a981 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:42.402153 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1313/2614] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:42.488571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ae59c-53ca-480e-b280-06b8c4876eb7 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:42.491757 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d81ae59c-53ca-480e-b280-06b8c4876eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:42.506720 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ae59c-53ca-480e-b280-06b8c4876eb7 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:42.523801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:42.524559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:42.524834 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:42.525140 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] PATH_INFO: `/v3/users/c869f8c46e984a56945966a32a8743c9` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:42.527829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c869f8c46e984a56945966a32a8743c9)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:42.530664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:42.626866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c869f8c46e984a56945966a32a8743c9'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.642566 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c869f8c46e984a56945966a32a8743c9'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.646156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c869f8c46e984a56945966a32a8743c9'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.646945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c869f8c46e984a56945966a32a8743c9'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.681715 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c869f8c46e984a56945966a32a8743c9'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.699311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1302/2615] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:42 2022] DELETE /identity/v3/users/c869f8c46e984a56945966a32a8743c9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:42.705320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a487d59-e3ff-4fcc-9976-305aac7faf49 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:42.706108 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a487d59-e3ff-4fcc-9976-305aac7faf49 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:42.706795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a487d59-e3ff-4fcc-9976-305aac7faf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:42.731978 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3a487d59-e3ff-4fcc-9976-305aac7faf49 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:42.733265 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3a487d59-e3ff-4fcc-9976-305aac7faf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:42.745812 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:42.806899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1314/2616] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:42.817273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:42.818725 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:42.901972 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad02e57-cfd2-4c74-9429-d75fcdd90510 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:42.906626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8b5fc-e6c6-4d24-ac79-2670f6d9682e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:42.907533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8b5fc-e6c6-4d24-ac79-2670f6d9682e service neutron] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:42.907941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8b5fc-e6c6-4d24-ac79-2670f6d9682e service neutron] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:42.908308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8b5fc-e6c6-4d24-ac79-2670f6d9682e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:42.924545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:42.926747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8b5fc-e6c6-4d24-ac79-2670f6d9682e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:42.928744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8b5fc-e6c6-4d24-ac79-2670f6d9682e service neutron] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:42.942404 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1303/2617] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:43.041712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a487d59-e3ff-4fcc-9976-305aac7faf49 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:43.043443 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3a487d59-e3ff-4fcc-9976-305aac7faf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:43.060495 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a487d59-e3ff-4fcc-9976-305aac7faf49 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:43.066940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:43.067665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:43.068034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:43.068903 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] PATH_INFO: `/v3/projects/e4ef5b1886124dd8869dd8e81cbbac5c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:43.069810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4ef5b1886124dd8869dd8e81cbbac5c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:43.072161 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:43.141193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4ef5b1886124dd8869dd8e81cbbac5c', 'request_id': 'req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.147696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4ef5b1886124dd8869dd8e81cbbac5c', 'request_id': 'req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.156949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4ef5b1886124dd8869dd8e81cbbac5c', 'request_id': 'req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.179515 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] The token cache is being invalidate because project e4ef5b1886124dd8869dd8e81cbbac5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:43.179885 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.180664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.182433 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1315/2618] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:43 2022] DELETE /identity/v3/projects/e4ef5b1886124dd8869dd8e81cbbac5c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:43.187156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8b5fc-e6c6-4d24-ac79-2670f6d9682e service neutron] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:43.206397 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8b5fc-e6c6-4d24-ac79-2670f6d9682e service neutron] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:43.294475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:43.295773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:43.296004 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:43.296493 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] PATH_INFO: `/v3/users/a4b7d7c4c47544da92b78be43dd40137` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:43.298676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b7d7c4c47544da92b78be43dd40137)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:43.309133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:43.394469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b7d7c4c47544da92b78be43dd40137'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.407531 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b7d7c4c47544da92b78be43dd40137'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.408461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b7d7c4c47544da92b78be43dd40137'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.409805 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b7d7c4c47544da92b78be43dd40137'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.429799 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b7d7c4c47544da92b78be43dd40137'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.446257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1304/2619] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:43 2022] DELETE /identity/v3/users/a4b7d7c4c47544da92b78be43dd40137 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:43.451991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:43.454077 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:43.471841 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6c1c6-7e1e-4232-8e1d-23ea8fa57881 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:43.594469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:43.595418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:43.595860 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:43.596945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] PATH_INFO: `/v3/projects/6be7b1bbdff64be09642a7d8123912c5` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:43.598199 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be7b1bbdff64be09642a7d8123912c5)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:43.600592 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:43.686151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:43.702171 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be7b1bbdff64be09642a7d8123912c5', 'request_id': 'req-06c8e68b-c5a5-49ce-a9e9-28173356ca10'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.711294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be7b1bbdff64be09642a7d8123912c5', 'request_id': 'req-06c8e68b-c5a5-49ce-a9e9-28173356ca10'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.720998 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be7b1bbdff64be09642a7d8123912c5', 'request_id': 'req-06c8e68b-c5a5-49ce-a9e9-28173356ca10'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.749885 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] The token cache is being invalidate because project 6be7b1bbdff64be09642a7d8123912c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:43.751670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.754232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.759777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1316/2620] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:43 2022] DELETE /identity/v3/projects/6be7b1bbdff64be09642a7d8123912c5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:43.764829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:43.767246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:43.788171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ef2c7-d876-42f0-80de-7632123fc728 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:43.882134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283f97a-ff3d-4d6e-b7cf-c028a6bdbec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:43.883032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283f97a-ff3d-4d6e-b7cf-c028a6bdbec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:43.883611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283f97a-ff3d-4d6e-b7cf-c028a6bdbec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:43.884386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283f97a-ff3d-4d6e-b7cf-c028a6bdbec8 admin admin] PATH_INFO: `/v3/users/536ff54fc44f4e91bf37165232ee6962` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:43.886802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283f97a-ff3d-4d6e-b7cf-c028a6bdbec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536ff54fc44f4e91bf37165232ee6962)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:43.895022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283f97a-ff3d-4d6e-b7cf-c028a6bdbec8 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:43.917878 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:43.984653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c283f97a-ff3d-4d6e-b7cf-c028a6bdbec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536ff54fc44f4e91bf37165232ee6962'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.996907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c283f97a-ff3d-4d6e-b7cf-c028a6bdbec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536ff54fc44f4e91bf37165232ee6962'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.999501 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c283f97a-ff3d-4d6e-b7cf-c028a6bdbec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536ff54fc44f4e91bf37165232ee6962'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.001422 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c283f97a-ff3d-4d6e-b7cf-c028a6bdbec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536ff54fc44f4e91bf37165232ee6962'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.036772 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c283f97a-ff3d-4d6e-b7cf-c028a6bdbec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536ff54fc44f4e91bf37165232ee6962'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.047018 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:44.049170 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:44.073548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1305/2621] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:43 2022] DELETE /identity/v3/users/536ff54fc44f4e91bf37165232ee6962 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:44.084931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8e68b-c5a5-49ce-a9e9-28173356ca10 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:44.187458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:44.188667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.190044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.190756 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] PATH_INFO: `/v3/projects/2e42250fe6454289aed6dd255820f9c7` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.192123 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e42250fe6454289aed6dd255820f9c7)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:44.194088 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:44.280763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e42250fe6454289aed6dd255820f9c7', 'request_id': 'req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.299966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e42250fe6454289aed6dd255820f9c7', 'request_id': 'req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.314478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e42250fe6454289aed6dd255820f9c7', 'request_id': 'req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.341083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] The token cache is being invalidate because project 2e42250fe6454289aed6dd255820f9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:44.341398 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.342140 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.348837 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1317/2622] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:44 2022] DELETE /identity/v3/projects/2e42250fe6454289aed6dd255820f9c7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:44.351034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc09580-a4ba-4321-b02c-44c7bcc86437 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.351491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc09580-a4ba-4321-b02c-44c7bcc86437 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.351582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc09580-a4ba-4321-b02c-44c7bcc86437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.374410 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-0cc09580-a4ba-4321-b02c-44c7bcc86437 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:44.375833 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0cc09580-a4ba-4321-b02c-44c7bcc86437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:44.452763 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:44.454859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:44.503930 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1306/2623] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:44.506963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac8d8b-f4e0-4047-82b2-d3d1e124c41b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.507518 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac8d8b-f4e0-4047-82b2-d3d1e124c41b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.508237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac8d8b-f4e0-4047-82b2-d3d1e124c41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.543744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b0ac8d8b-f4e0-4047-82b2-d3d1e124c41b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:44.545168 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b0ac8d8b-f4e0-4047-82b2-d3d1e124c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:44.569342 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1307/2624] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:44.570830 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac8d8b-f4e0-4047-82b2-d3d1e124c41b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:44.582456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac8d8b-f4e0-4047-82b2-d3d1e124c41b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:44.589050 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15e907-73e0-4ca8-9dfc-a9a73d537bcf admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:44.589851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de271cc3-2212-45a4-910a-7c5fe42fe03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:44.590644 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de271cc3-2212-45a4-910a-7c5fe42fe03c admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.591241 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de271cc3-2212-45a4-910a-7c5fe42fe03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.591691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de271cc3-2212-45a4-910a-7c5fe42fe03c admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.593052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de271cc3-2212-45a4-910a-7c5fe42fe03c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:44.593533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de271cc3-2212-45a4-910a-7c5fe42fe03c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:44.595048 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e17ef-0814-4e14-93fe-a5e3f250613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:44.595495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de271cc3-2212-45a4-910a-7c5fe42fe03c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:44.595695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e17ef-0814-4e14-93fe-a5e3f250613a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.596025 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e17ef-0814-4e14-93fe-a5e3f250613a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.596303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e17ef-0814-4e14-93fe-a5e3f250613a admin admin] PATH_INFO: `/v3/projects/868b1b321ac8407fb87e9472f2ab3991` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.597485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e17ef-0814-4e14-93fe-a5e3f250613a admin admin] RBAC: Authorizing `identity:delete_project(project_id=868b1b321ac8407fb87e9472f2ab3991)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:44.599407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e17ef-0814-4e14-93fe-a5e3f250613a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:44.608062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:44.620172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1308/2625] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:44.625339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de271cc3-2212-45a4-910a-7c5fe42fe03c admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:44.638982 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de271cc3-2212-45a4-910a-7c5fe42fe03c admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:44.644870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389199b-5192-4210-ac8c-6833d7e3bce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:44.645767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389199b-5192-4210-ac8c-6833d7e3bce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.646204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389199b-5192-4210-ac8c-6833d7e3bce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.646617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389199b-5192-4210-ac8c-6833d7e3bce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.647418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389199b-5192-4210-ac8c-6833d7e3bce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:44.649563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389199b-5192-4210-ac8c-6833d7e3bce3 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:44.670358 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6e1e17ef-0814-4e14-93fe-a5e3f250613a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868b1b321ac8407fb87e9472f2ab3991', 'request_id': 'req-6e1e17ef-0814-4e14-93fe-a5e3f250613a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.678956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6e1e17ef-0814-4e14-93fe-a5e3f250613a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868b1b321ac8407fb87e9472f2ab3991', 'request_id': 'req-6e1e17ef-0814-4e14-93fe-a5e3f250613a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.682662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1309/2626] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:44 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:44.686511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6e1e17ef-0814-4e14-93fe-a5e3f250613a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868b1b321ac8407fb87e9472f2ab3991', 'request_id': 'req-6e1e17ef-0814-4e14-93fe-a5e3f250613a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.687434 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389199b-5192-4210-ac8c-6833d7e3bce3 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:44.702038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6e1e17ef-0814-4e14-93fe-a5e3f250613a admin admin] The token cache is being invalidate because project 868b1b321ac8407fb87e9472f2ab3991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:44.702459 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6e1e17ef-0814-4e14-93fe-a5e3f250613a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.703310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6e1e17ef-0814-4e14-93fe-a5e3f250613a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.704909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1318/2627] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:44 2022] DELETE /identity/v3/projects/868b1b321ac8407fb87e9472f2ab3991 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:44.709607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a9e69-382f-425f-bd22-df908d0d2c47 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.709891 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a9e69-382f-425f-bd22-df908d0d2c47 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.710221 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a9e69-382f-425f-bd22-df908d0d2c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.734224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-668a9e69-382f-425f-bd22-df908d0d2c47 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:44.735458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-668a9e69-382f-425f-bd22-df908d0d2c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:44.762175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:44.780908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389199b-5192-4210-ac8c-6833d7e3bce3 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:44.795304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4ee7a-890e-476d-8672-c02936cd4189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:44.796129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4ee7a-890e-476d-8672-c02936cd4189 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.796605 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4ee7a-890e-476d-8672-c02936cd4189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.796959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4ee7a-890e-476d-8672-c02936cd4189 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.797631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4ee7a-890e-476d-8672-c02936cd4189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:44.811585 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4ee7a-890e-476d-8672-c02936cd4189 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:44.822777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1319/2628] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:44.832467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd5fb1-c9e9-425a-967d-a3a3febb04d9 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.832832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd5fb1-c9e9-425a-967d-a3a3febb04d9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.833289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd5fb1-c9e9-425a-967d-a3a3febb04d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.856924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1310/2629] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:44 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:44.861747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4ee7a-890e-476d-8672-c02936cd4189 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:44.862344 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8ebd5fb1-c9e9-425a-967d-a3a3febb04d9 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:44.863699 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8ebd5fb1-c9e9-425a-967d-a3a3febb04d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:44.864148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-fca4ee7a-890e-476d-8672-c02936cd4189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:44.877606 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1320/2630] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:44.881927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd5fb1-c9e9-425a-967d-a3a3febb04d9 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:44.899473 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd5fb1-c9e9-425a-967d-a3a3febb04d9 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:44.922273 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483df60d-4a11-4bdb-8db2-d1e2b014fc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:44.923664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483df60d-4a11-4bdb-8db2-d1e2b014fc0c admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.923994 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483df60d-4a11-4bdb-8db2-d1e2b014fc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.924362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483df60d-4a11-4bdb-8db2-d1e2b014fc0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.924939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483df60d-4a11-4bdb-8db2-d1e2b014fc0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:44.925249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483df60d-4a11-4bdb-8db2-d1e2b014fc0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:44.929904 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483df60d-4a11-4bdb-8db2-d1e2b014fc0c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:44.941177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4ee7a-890e-476d-8672-c02936cd4189 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:44.950333 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1321/2631] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:10:44.953787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b832cfc-ad7f-4877-a5b1-a97d21af9252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:44.954130 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832cfc-ad7f-4877-a5b1-a97d21af9252 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.954416 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832cfc-ad7f-4877-a5b1-a97d21af9252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.954686 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832cfc-ad7f-4877-a5b1-a97d21af9252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.955656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b832cfc-ad7f-4877-a5b1-a97d21af9252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:44.957888 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483df60d-4a11-4bdb-8db2-d1e2b014fc0c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:44.963763 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b832cfc-ad7f-4877-a5b1-a97d21af9252 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:44.970963 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483df60d-4a11-4bdb-8db2-d1e2b014fc0c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:44.976400 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e483-f39e-4fbb-857c-b3e7916b04e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:44.977916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e483-f39e-4fbb-857c-b3e7916b04e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.978396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e483-f39e-4fbb-857c-b3e7916b04e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.978823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e483-f39e-4fbb-857c-b3e7916b04e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.980057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07e483-f39e-4fbb-857c-b3e7916b04e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:44.983200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1311/2632] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:44.983566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07e483-f39e-4fbb-857c-b3e7916b04e4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:44.987239 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b832cfc-ad7f-4877-a5b1-a97d21af9252 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:44.997625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b832cfc-ad7f-4877-a5b1-a97d21af9252 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.005097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6837822-30f1-4d71-90f4-64f40a71da66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.006121 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6837822-30f1-4d71-90f4-64f40a71da66 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.006477 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6837822-30f1-4d71-90f4-64f40a71da66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.006817 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6837822-30f1-4d71-90f4-64f40a71da66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.007534 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6837822-30f1-4d71-90f4-64f40a71da66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.009258 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6837822-30f1-4d71-90f4-64f40a71da66 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.038662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1312/2633] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:45.040462 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6837822-30f1-4d71-90f4-64f40a71da66 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.042597 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1322/2634] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:44 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:45.052023 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e483-f39e-4fbb-857c-b3e7916b04e4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.071930 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6837822-30f1-4d71-90f4-64f40a71da66 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.136033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:45.158013 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e483-f39e-4fbb-857c-b3e7916b04e4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.164430 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1079e2-6bd0-4d44-9fdd-4624a451cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.165391 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1079e2-6bd0-4d44-9fdd-4624a451cbbd admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.165905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1079e2-6bd0-4d44-9fdd-4624a451cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.166031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb472d8-8e10-454f-b51c-1f49cb592b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.166376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1079e2-6bd0-4d44-9fdd-4624a451cbbd admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.166617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb472d8-8e10-454f-b51c-1f49cb592b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.166906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb472d8-8e10-454f-b51c-1f49cb592b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.167181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb472d8-8e10-454f-b51c-1f49cb592b56 admin admin] PATH_INFO: `/v3/projects/82e169fd17374011b88506cd782c5e17/users/979ecf1ae3954a1f925430867560eb6b/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.167360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1079e2-6bd0-4d44-9fdd-4624a451cbbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.169691 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1079e2-6bd0-4d44-9fdd-4624a451cbbd admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.187105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb472d8-8e10-454f-b51c-1f49cb592b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e169fd17374011b88506cd782c5e17, user_id=979ecf1ae3954a1f925430867560eb6b, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.190061 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb472d8-8e10-454f-b51c-1f49cb592b56 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.206047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1323/2635] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:45 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:45.207751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1079e2-6bd0-4d44-9fdd-4624a451cbbd admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.220024 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1313/2636] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:45 2022] PUT /identity/v3/projects/82e169fd17374011b88506cd782c5e17/users/979ecf1ae3954a1f925430867560eb6b/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:45.220885 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1079e2-6bd0-4d44-9fdd-4624a451cbbd admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.222079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaad27-111e-47a7-912f-f1379355428f None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.222423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaad27-111e-47a7-912f-f1379355428f None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.223069 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaad27-111e-47a7-912f-f1379355428f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.270902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-cfcaad27-111e-47a7-912f-f1379355428f None None] MFA Rules not processed for user `979ecf1ae3954a1f925430867560eb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:45.272116 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-cfcaad27-111e-47a7-912f-f1379355428f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:45.379681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410079b3-1e79-4ce1-8e8a-fcca0e4d343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.380487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410079b3-1e79-4ce1-8e8a-fcca0e4d343e admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.380836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410079b3-1e79-4ce1-8e8a-fcca0e4d343e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.381243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410079b3-1e79-4ce1-8e8a-fcca0e4d343e admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.382094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410079b3-1e79-4ce1-8e8a-fcca0e4d343e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.384418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410079b3-1e79-4ce1-8e8a-fcca0e4d343e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.403955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1324/2637] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:45.405807 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410079b3-1e79-4ce1-8e8a-fcca0e4d343e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.410196 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1314/2638] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:45.411652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaad27-111e-47a7-912f-f1379355428f None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.428906 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410079b3-1e79-4ce1-8e8a-fcca0e4d343e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.438232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaad27-111e-47a7-912f-f1379355428f None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.439117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1352802-817c-423d-8554-f3b1f948b3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.440286 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1352802-817c-423d-8554-f3b1f948b3bb admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.440684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1352802-817c-423d-8554-f3b1f948b3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.441068 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1352802-817c-423d-8554-f3b1f948b3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.441816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1352802-817c-423d-8554-f3b1f948b3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.443975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1352802-817c-423d-8554-f3b1f948b3bb admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.446279 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbb97a-2d56-439c-b2ab-579930428293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.447912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbb97a-2d56-439c-b2ab-579930428293 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.448208 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbb97a-2d56-439c-b2ab-579930428293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.448487 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbb97a-2d56-439c-b2ab-579930428293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.449173 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbb97a-2d56-439c-b2ab-579930428293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.452023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbb97a-2d56-439c-b2ab-579930428293 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.463099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1325/2639] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:45.468274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1352802-817c-423d-8554-f3b1f948b3bb admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.484879 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1352802-817c-423d-8554-f3b1f948b3bb admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.496247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0774f0-63d1-471f-8d17-7e3b34535431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.497121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0774f0-63d1-471f-8d17-7e3b34535431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.497957 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0774f0-63d1-471f-8d17-7e3b34535431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.498946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0774f0-63d1-471f-8d17-7e3b34535431 admin admin] PATH_INFO: `/v3/projects/0fdf642a60db4b38a7376651ccc8d937/users/0ac0f573c9ef4a9684a74d6156b524e7/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.520342 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1315/2640] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:45 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:45.524919 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbb97a-2d56-439c-b2ab-579930428293 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.541020 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0774f0-63d1-471f-8d17-7e3b34535431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fdf642a60db4b38a7376651ccc8d937, user_id=0ac0f573c9ef4a9684a74d6156b524e7, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.543845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0774f0-63d1-471f-8d17-7e3b34535431 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.545591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:45.565769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1326/2641] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:45 2022] PUT /identity/v3/projects/0fdf642a60db4b38a7376651ccc8d937/users/0ac0f573c9ef4a9684a74d6156b524e7/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:45.582856 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad40f87-c2c8-4219-8bbc-c6ed6e7c0915 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.583218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad40f87-c2c8-4219-8bbc-c6ed6e7c0915 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.583663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad40f87-c2c8-4219-8bbc-c6ed6e7c0915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.645266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbb97a-2d56-439c-b2ab-579930428293 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.732022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4725732-c8ee-4118-8410-f072e926842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.732836 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4725732-c8ee-4118-8410-f072e926842f admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.733209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4725732-c8ee-4118-8410-f072e926842f admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.733556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4725732-c8ee-4118-8410-f072e926842f admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.734301 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4725732-c8ee-4118-8410-f072e926842f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.742806 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4725732-c8ee-4118-8410-f072e926842f admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.752311 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8ad40f87-c2c8-4219-8bbc-c6ed6e7c0915 None None] MFA Rules not processed for user `0ac0f573c9ef4a9684a74d6156b524e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:45.753902 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8ad40f87-c2c8-4219-8bbc-c6ed6e7c0915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:45.766102 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1316/2642] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:45 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:45.766102 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4725732-c8ee-4118-8410-f072e926842f admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.766404 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e4725732-c8ee-4118-8410-f072e926842f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:45.832986 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1327/2643] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:45.833853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad40f87-c2c8-4219-8bbc-c6ed6e7c0915 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.837764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8ad40f87-c2c8-4219-8bbc-c6ed6e7c0915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:45.849832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad40f87-c2c8-4219-8bbc-c6ed6e7c0915 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.854563 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.855189 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.855464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.855748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] PATH_INFO: `/v3/users/b42b1af0e32a41fba8712334c2acfbc7` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.856351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4725732-c8ee-4118-8410-f072e926842f admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.857094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42b1af0e32a41fba8712334c2acfbc7)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.859121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.862651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364e690-5b80-4285-a102-0a5270dfe4c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccab7239a2474aa093e685d5da97f1a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.863273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e690-5b80-4285-a102-0a5270dfe4c8 service placement] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.863549 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e690-5b80-4285-a102-0a5270dfe4c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.863850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e690-5b80-4285-a102-0a5270dfe4c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.865634 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5364e690-5b80-4285-a102-0a5270dfe4c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:45.877642 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364e690-5b80-4285-a102-0a5270dfe4c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.879372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364e690-5b80-4285-a102-0a5270dfe4c8 service placement] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.884442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:45.891117 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1317/2644] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:45.892820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364e690-5b80-4285-a102-0a5270dfe4c8 service placement] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.907346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364e690-5b80-4285-a102-0a5270dfe4c8 service placement] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.913078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44ced3-48d1-4581-b803-8cc2a4f0cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.913792 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44ced3-48d1-4581-b803-8cc2a4f0cb2f admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.914087 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44ced3-48d1-4581-b803-8cc2a4f0cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.914355 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44ced3-48d1-4581-b803-8cc2a4f0cb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.915014 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44ced3-48d1-4581-b803-8cc2a4f0cb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.916810 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44ced3-48d1-4581-b803-8cc2a4f0cb2f admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.925169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42b1af0e32a41fba8712334c2acfbc7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.929544 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1318/2645] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:45.932294 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44ced3-48d1-4581-b803-8cc2a4f0cb2f admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.937346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42b1af0e32a41fba8712334c2acfbc7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.943042 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44ced3-48d1-4581-b803-8cc2a4f0cb2f admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.944939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42b1af0e32a41fba8712334c2acfbc7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.945706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42b1af0e32a41fba8712334c2acfbc7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.947995 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273093c0-69ba-43b0-9987-577e9cd2ae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.948511 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273093c0-69ba-43b0-9987-577e9cd2ae67 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.948791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273093c0-69ba-43b0-9987-577e9cd2ae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.949230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273093c0-69ba-43b0-9987-577e9cd2ae67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.949863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273093c0-69ba-43b0-9987-577e9cd2ae67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.952336 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273093c0-69ba-43b0-9987-577e9cd2ae67 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.959868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42b1af0e32a41fba8712334c2acfbc7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.966446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1328/2646] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:45 2022] DELETE /identity/v3/users/b42b1af0e32a41fba8712334c2acfbc7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:45.968201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.970496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:45.996695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1319/2647] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:45 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:46.001769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273093c0-69ba-43b0-9987-577e9cd2ae67 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.005280 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-273093c0-69ba-43b0-9987-577e9cd2ae67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.015544 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:46.053292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390eb012-3021-4b53-9fc7-e12d2070b65c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.097228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273093c0-69ba-43b0-9987-577e9cd2ae67 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.103105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c477e60-9cd6-4415-a4eb-e6725ddfa3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.103905 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c477e60-9cd6-4415-a4eb-e6725ddfa3db admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.104307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c477e60-9cd6-4415-a4eb-e6725ddfa3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.104677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c477e60-9cd6-4415-a4eb-e6725ddfa3db admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.105439 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c477e60-9cd6-4415-a4eb-e6725ddfa3db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.108220 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c477e60-9cd6-4415-a4eb-e6725ddfa3db admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.120525 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025b61-f9cf-4adb-b61a-f6c227e206e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.121200 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025b61-f9cf-4adb-b61a-f6c227e206e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.121474 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025b61-f9cf-4adb-b61a-f6c227e206e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.121748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025b61-f9cf-4adb-b61a-f6c227e206e3 admin admin] PATH_INFO: `/v3/projects/69b96b5a63e94f81929357701f66bb28/users/5205a719ed2f4fe2950ea3325fe899a5/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.139531 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1320/2648] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:46 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:46.140337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af025b61-f9cf-4adb-b61a-f6c227e206e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b96b5a63e94f81929357701f66bb28, user_id=5205a719ed2f4fe2950ea3325fe899a5, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.143360 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af025b61-f9cf-4adb-b61a-f6c227e206e3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.143670 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c477e60-9cd6-4415-a4eb-e6725ddfa3db admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.156237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c477e60-9cd6-4415-a4eb-e6725ddfa3db admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.162663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1329/2649] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:45 2022] PUT /identity/v3/projects/69b96b5a63e94f81929357701f66bb28/users/5205a719ed2f4fe2950ea3325fe899a5/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:46.166550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025b61-f9cf-4adb-b61a-f6c227e206e3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.217388 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:46.231625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a31ff-23ad-4f07-a9b7-ca50f0f28406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.232505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a31ff-23ad-4f07-a9b7-ca50f0f28406 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.232971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a31ff-23ad-4f07-a9b7-ca50f0f28406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.233275 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a31ff-23ad-4f07-a9b7-ca50f0f28406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.234123 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a31ff-23ad-4f07-a9b7-ca50f0f28406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.236813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a31ff-23ad-4f07-a9b7-ca50f0f28406 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.247831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1321/2650] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:46.248887 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a31ff-23ad-4f07-a9b7-ca50f0f28406 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.251517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b30a31ff-23ad-4f07-a9b7-ca50f0f28406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.254487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025b61-f9cf-4adb-b61a-f6c227e206e3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.260585 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8501769-34e9-42b8-a793-49581e13f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.262064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8501769-34e9-42b8-a793-49581e13f492 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.262346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8501769-34e9-42b8-a793-49581e13f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.262610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8501769-34e9-42b8-a793-49581e13f492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.263266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8501769-34e9-42b8-a793-49581e13f492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.265003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8501769-34e9-42b8-a793-49581e13f492 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.265123 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a31ff-23ad-4f07-a9b7-ca50f0f28406 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.270390 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.271099 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.271390 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.271664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] PATH_INFO: `/v3/projects/1b486e886a784554a023950b3e45617b` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.272860 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b486e886a784554a023950b3e45617b)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.274827 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.276224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1330/2651] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:46.277081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8501769-34e9-42b8-a793-49581e13f492 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.288219 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8501769-34e9-42b8-a793-49581e13f492 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.293009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5baf7-eb20-4372-a1af-275a53cd553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.293670 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5baf7-eb20-4372-a1af-275a53cd553c admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.294010 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5baf7-eb20-4372-a1af-275a53cd553c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.294292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5baf7-eb20-4372-a1af-275a53cd553c admin admin] PATH_INFO: `/v3/projects/6f1c006a5e484e2a8ed2693155ccc227/users/81fe150c01a64eecb32a7470e600c126/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.313528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5baf7-eb20-4372-a1af-275a53cd553c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1c006a5e484e2a8ed2693155ccc227, user_id=81fe150c01a64eecb32a7470e600c126, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.318674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5baf7-eb20-4372-a1af-275a53cd553c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.335303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1331/2652] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:46 2022] PUT /identity/v3/projects/6f1c006a5e484e2a8ed2693155ccc227/users/81fe150c01a64eecb32a7470e600c126/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:46.336476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5baf7-eb20-4372-a1af-275a53cd553c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.340944 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b486e886a784554a023950b3e45617b', 'request_id': 'req-a15b845a-8213-4fc9-870b-99e9a43a47c8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.347664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b486e886a784554a023950b3e45617b', 'request_id': 'req-a15b845a-8213-4fc9-870b-99e9a43a47c8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.355183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b486e886a784554a023950b3e45617b', 'request_id': 'req-a15b845a-8213-4fc9-870b-99e9a43a47c8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.369164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] The token cache is being invalidate because project 1b486e886a784554a023950b3e45617b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:46.369435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.370103 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.375134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1322/2653] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:46 2022] DELETE /identity/v3/projects/1b486e886a784554a023950b3e45617b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:46.375134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.375134 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.391602 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:46.406233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5baf7-eb20-4372-a1af-275a53cd553c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.411495 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d4685-e508-416e-8a19-7a3d24448925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.412185 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d4685-e508-416e-8a19-7a3d24448925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.412476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d4685-e508-416e-8a19-7a3d24448925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.412776 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d4685-e508-416e-8a19-7a3d24448925 admin admin] PATH_INFO: `/v3/projects/69b96b5a63e94f81929357701f66bb28/users/5205a719ed2f4fe2950ea3325fe899a5/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.414747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d4685-e508-416e-8a19-7a3d24448925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b96b5a63e94f81929357701f66bb28, user_id=5205a719ed2f4fe2950ea3325fe899a5, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.417499 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d4685-e508-416e-8a19-7a3d24448925 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.429932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1332/2654] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:46 2022] PUT /identity/v3/projects/69b96b5a63e94f81929357701f66bb28/users/5205a719ed2f4fe2950ea3325fe899a5/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:46.431014 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d607f-5a45-4f73-9787-17cc32d24661 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.431238 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d607f-5a45-4f73-9787-17cc32d24661 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.431522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d607f-5a45-4f73-9787-17cc32d24661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.451583 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b845a-8213-4fc9-870b-99e9a43a47c8 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.457225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b79d607f-5a45-4f73-9787-17cc32d24661 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:46.458613 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b79d607f-5a45-4f73-9787-17cc32d24661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.515076 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7487fd-5bcc-457d-bb6e-f1484b2f3625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.515602 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7487fd-5bcc-457d-bb6e-f1484b2f3625 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.515924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7487fd-5bcc-457d-bb6e-f1484b2f3625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.516431 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7487fd-5bcc-457d-bb6e-f1484b2f3625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.516849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7487fd-5bcc-457d-bb6e-f1484b2f3625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.518600 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7487fd-5bcc-457d-bb6e-f1484b2f3625 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.529307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1323/2655] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:46.530616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271eda7-57a3-40b6-8708-7d889cb9df5b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.533633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271eda7-57a3-40b6-8708-7d889cb9df5b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.533633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271eda7-57a3-40b6-8708-7d889cb9df5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.540810 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1333/2656] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:46.541700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d607f-5a45-4f73-9787-17cc32d24661 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.552346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d607f-5a45-4f73-9787-17cc32d24661 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.557581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0301d2-d1d9-4087-83cf-f7652754f5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.558248 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0301d2-d1d9-4087-83cf-f7652754f5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.558522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0301d2-d1d9-4087-83cf-f7652754f5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.558789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0301d2-d1d9-4087-83cf-f7652754f5ea admin admin] PATH_INFO: `/v3/projects/6f1c006a5e484e2a8ed2693155ccc227/users/81fe150c01a64eecb32a7470e600c126/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.561328 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0301d2-d1d9-4087-83cf-f7652754f5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1c006a5e484e2a8ed2693155ccc227, user_id=81fe150c01a64eecb32a7470e600c126, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.564244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0301d2-d1d9-4087-83cf-f7652754f5ea admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.566744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-9271eda7-57a3-40b6-8708-7d889cb9df5b None None] MFA Rules not processed for user `5205a719ed2f4fe2950ea3325fe899a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:46.568090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-9271eda7-57a3-40b6-8708-7d889cb9df5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.575279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1334/2657] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:46 2022] PUT /identity/v3/projects/6f1c006a5e484e2a8ed2693155ccc227/users/81fe150c01a64eecb32a7470e600c126/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:46.576728 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07effd3e-71c6-4f2e-9726-32e7b875b8bd None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.577079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07effd3e-71c6-4f2e-9726-32e7b875b8bd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.577414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07effd3e-71c6-4f2e-9726-32e7b875b8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.599576 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-07effd3e-71c6-4f2e-9726-32e7b875b8bd None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:46.601573 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-07effd3e-71c6-4f2e-9726-32e7b875b8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.622745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:46.667617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1324/2658] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:46.672627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac2bce-00ae-4c69-9487-041ab1a2ba7b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.672627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac2bce-00ae-4c69-9487-041ab1a2ba7b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.672627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac2bce-00ae-4c69-9487-041ab1a2ba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.672933 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1335/2659] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:46.675971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07effd3e-71c6-4f2e-9726-32e7b875b8bd None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.690183 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07effd3e-71c6-4f2e-9726-32e7b875b8bd None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.694971 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52771141-8c3f-402f-aff6-8b2e25190047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.695585 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52771141-8c3f-402f-aff6-8b2e25190047 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.695916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52771141-8c3f-402f-aff6-8b2e25190047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.696184 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52771141-8c3f-402f-aff6-8b2e25190047 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.696836 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52771141-8c3f-402f-aff6-8b2e25190047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:46.697136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52771141-8c3f-402f-aff6-8b2e25190047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.698720 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52771141-8c3f-402f-aff6-8b2e25190047 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.712447 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-ddac2bce-00ae-4c69-9487-041ab1a2ba7b None None] MFA Rules not processed for user `81fe150c01a64eecb32a7470e600c126`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:46.714291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ddac2bce-00ae-4c69-9487-041ab1a2ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.722804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1336/2660] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:46.724169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52771141-8c3f-402f-aff6-8b2e25190047 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.725866 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-52771141-8c3f-402f-aff6-8b2e25190047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.753814 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:46.798288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52771141-8c3f-402f-aff6-8b2e25190047 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.802009 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6358de5-d4c5-45bb-bb01-2ff2cdbd8efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.802640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6358de5-d4c5-45bb-bb01-2ff2cdbd8efe service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.803116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6358de5-d4c5-45bb-bb01-2ff2cdbd8efe service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.803233 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1325/2661] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:46.803406 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6358de5-d4c5-45bb-bb01-2ff2cdbd8efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.803890 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac2bce-00ae-4c69-9487-041ab1a2ba7b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.814730 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac2bce-00ae-4c69-9487-041ab1a2ba7b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.819468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03459e6c-21aa-406d-b7f5-39cee4ce0f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.820083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6358de5-d4c5-45bb-bb01-2ff2cdbd8efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.820215 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03459e6c-21aa-406d-b7f5-39cee4ce0f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.820437 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03459e6c-21aa-406d-b7f5-39cee4ce0f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.820713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03459e6c-21aa-406d-b7f5-39cee4ce0f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.821345 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03459e6c-21aa-406d-b7f5-39cee4ce0f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.821528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6358de5-d4c5-45bb-bb01-2ff2cdbd8efe service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.823248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03459e6c-21aa-406d-b7f5-39cee4ce0f73 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.832734 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1337/2662] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:46.834430 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6358de5-d4c5-45bb-bb01-2ff2cdbd8efe service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.836391 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c6358de5-d4c5-45bb-bb01-2ff2cdbd8efe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.854619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6358de5-d4c5-45bb-bb01-2ff2cdbd8efe service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.859230 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de321626-7403-4306-a4ae-c4e1b136f4ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.859700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de321626-7403-4306-a4ae-c4e1b136f4ed service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.859967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de321626-7403-4306-a4ae-c4e1b136f4ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.860169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de321626-7403-4306-a4ae-c4e1b136f4ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.868407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1326/2663] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:46 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:46.871261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03459e6c-21aa-406d-b7f5-39cee4ce0f73 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.876367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de321626-7403-4306-a4ae-c4e1b136f4ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.878452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de321626-7403-4306-a4ae-c4e1b136f4ed service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.892981 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1338/2664] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:46.957338 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de321626-7403-4306-a4ae-c4e1b136f4ed service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.969007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de321626-7403-4306-a4ae-c4e1b136f4ed service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.001939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03459e6c-21aa-406d-b7f5-39cee4ce0f73 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.007187 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c43dd-c60c-4ef1-8c9a-9c91e542e787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.007930 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c43dd-c60c-4ef1-8c9a-9c91e542e787 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.008282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c43dd-c60c-4ef1-8c9a-9c91e542e787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.008627 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c43dd-c60c-4ef1-8c9a-9c91e542e787 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.009396 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c43dd-c60c-4ef1-8c9a-9c91e542e787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.018587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c43dd-c60c-4ef1-8c9a-9c91e542e787 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.046621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1327/2665] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:46 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:47.046621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c43dd-c60c-4ef1-8c9a-9c91e542e787 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.048710 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f8919-6202-4e3c-ac66-f32f93f9e5f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.049291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f8919-6202-4e3c-ac66-f32f93f9e5f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.049567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f8919-6202-4e3c-ac66-f32f93f9e5f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.049837 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f8919-6202-4e3c-ac66-f32f93f9e5f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.051854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-247f8919-6202-4e3c-ac66-f32f93f9e5f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:47.055796 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c43dd-c60c-4ef1-8c9a-9c91e542e787 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.059705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3a710-1abd-4260-9e61-c96c4cb88eea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.060362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a710-1abd-4260-9e61-c96c4cb88eea service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.061199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a710-1abd-4260-9e61-c96c4cb88eea service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.061486 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a710-1abd-4260-9e61-c96c4cb88eea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.063325 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-25c3a710-1abd-4260-9e61-c96c4cb88eea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:47.127561 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:47.129521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3a710-1abd-4260-9e61-c96c4cb88eea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.130369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f8919-6202-4e3c-ac66-f32f93f9e5f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.131068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3a710-1abd-4260-9e61-c96c4cb88eea service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.131878 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f8919-6202-4e3c-ac66-f32f93f9e5f4 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.141655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1328/2666] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:47.142567 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3a710-1abd-4260-9e61-c96c4cb88eea service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.143761 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1339/2667] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:47.153799 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3a710-1abd-4260-9e61-c96c4cb88eea service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.160113 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62031801-9573-44ea-b6f3-c599c7b2eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.160735 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62031801-9573-44ea-b6f3-c599c7b2eb9f admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.161185 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62031801-9573-44ea-b6f3-c599c7b2eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.161651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62031801-9573-44ea-b6f3-c599c7b2eb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.162316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62031801-9573-44ea-b6f3-c599c7b2eb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.164114 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62031801-9573-44ea-b6f3-c599c7b2eb9f admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.177617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1329/2668] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:47.182803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f8919-6202-4e3c-ac66-f32f93f9e5f4 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.213356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f8919-6202-4e3c-ac66-f32f93f9e5f4 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.222063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25584ba3-a97f-4312-944a-fd19f2e4c0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.223434 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25584ba3-a97f-4312-944a-fd19f2e4c0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.223985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25584ba3-a97f-4312-944a-fd19f2e4c0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.224434 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25584ba3-a97f-4312-944a-fd19f2e4c0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.225545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25584ba3-a97f-4312-944a-fd19f2e4c0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.228440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25584ba3-a97f-4312-944a-fd19f2e4c0a1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.245932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1340/2669] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:47.250991 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62031801-9573-44ea-b6f3-c599c7b2eb9f admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.262161 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62031801-9573-44ea-b6f3-c599c7b2eb9f admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.267091 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147e709-492c-4d12-986d-bbef8b36755a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.267796 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147e709-492c-4d12-986d-bbef8b36755a admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.268941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147e709-492c-4d12-986d-bbef8b36755a admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.268941 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147e709-492c-4d12-986d-bbef8b36755a admin admin] PATH_INFO: `/v3/projects/f97e2a39f0c44ed087ed246e5ca184d0/users/9ce43cb7ed8b4ca2bc240c4d8cd02d9c/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.286494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147e709-492c-4d12-986d-bbef8b36755a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97e2a39f0c44ed087ed246e5ca184d0, user_id=9ce43cb7ed8b4ca2bc240c4d8cd02d9c, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.289237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147e709-492c-4d12-986d-bbef8b36755a admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.304767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:47.314402 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1330/2670] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:47 2022] PUT /identity/v3/projects/f97e2a39f0c44ed087ed246e5ca184d0/users/9ce43cb7ed8b4ca2bc240c4d8cd02d9c/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:47.326374 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aad4ed-00a0-4bbc-b632-655d791878f6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.326827 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aad4ed-00a0-4bbc-b632-655d791878f6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.327414 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aad4ed-00a0-4bbc-b632-655d791878f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.364290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e0aad4ed-00a0-4bbc-b632-655d791878f6 None None] MFA Rules not processed for user `9ce43cb7ed8b4ca2bc240c4d8cd02d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:47.365775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e0aad4ed-00a0-4bbc-b632-655d791878f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:47.458303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1341/2671] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:47.463336 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147e709-492c-4d12-986d-bbef8b36755a admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.506082 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aad4ed-00a0-4bbc-b632-655d791878f6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.507830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e0aad4ed-00a0-4bbc-b632-655d791878f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:47.543005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147e709-492c-4d12-986d-bbef8b36755a admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.555790 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5d3b4-38aa-4084-8b4c-a428f0add116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.556584 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5d3b4-38aa-4084-8b4c-a428f0add116 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.556939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5d3b4-38aa-4084-8b4c-a428f0add116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.558082 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5d3b4-38aa-4084-8b4c-a428f0add116 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.558837 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5d3b4-38aa-4084-8b4c-a428f0add116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.560973 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5d3b4-38aa-4084-8b4c-a428f0add116 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.596056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aad4ed-00a0-4bbc-b632-655d791878f6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.601184 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d6236-31f1-410d-a628-0c1dda05b568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.601816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d6236-31f1-410d-a628-0c1dda05b568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.602101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d6236-31f1-410d-a628-0c1dda05b568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.602382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d6236-31f1-410d-a628-0c1dda05b568 admin admin] PATH_INFO: `/v3/users/979ecf1ae3954a1f925430867560eb6b` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.603574 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d6236-31f1-410d-a628-0c1dda05b568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=979ecf1ae3954a1f925430867560eb6b)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.605573 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d6236-31f1-410d-a628-0c1dda05b568 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.609326 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1331/2672] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:47 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:47.610217 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5d3b4-38aa-4084-8b4c-a428f0add116 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.664124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7c4d6236-31f1-410d-a628-0c1dda05b568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979ecf1ae3954a1f925430867560eb6b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.674502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7c4d6236-31f1-410d-a628-0c1dda05b568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979ecf1ae3954a1f925430867560eb6b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.684435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7c4d6236-31f1-410d-a628-0c1dda05b568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979ecf1ae3954a1f925430867560eb6b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.686035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7c4d6236-31f1-410d-a628-0c1dda05b568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979ecf1ae3954a1f925430867560eb6b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.686621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5d3b4-38aa-4084-8b4c-a428f0add116 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.691442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aeb6c-b398-4f6d-8ac5-474c8bb6bba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.692082 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aeb6c-b398-4f6d-8ac5-474c8bb6bba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.692378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aeb6c-b398-4f6d-8ac5-474c8bb6bba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.692657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aeb6c-b398-4f6d-8ac5-474c8bb6bba0 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.693317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aeb6c-b398-4f6d-8ac5-474c8bb6bba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.695210 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aeb6c-b398-4f6d-8ac5-474c8bb6bba0 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.701032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:47.704177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7c4d6236-31f1-410d-a628-0c1dda05b568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979ecf1ae3954a1f925430867560eb6b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.713821 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1342/2673] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:47 2022] DELETE /identity/v3/users/979ecf1ae3954a1f925430867560eb6b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:47.719257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ef01a-4d04-4e4d-83ef-bbf1d0518c94 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.719257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ef01a-4d04-4e4d-83ef-bbf1d0518c94 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.719257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ef01a-4d04-4e4d-83ef-bbf1d0518c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.723334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1332/2674] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:47 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:47.724912 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aeb6c-b398-4f6d-8ac5-474c8bb6bba0 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.726599 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e77aeb6c-b398-4f6d-8ac5-474c8bb6bba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:47.739224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aeb6c-b398-4f6d-8ac5-474c8bb6bba0 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.741582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b59ef01a-4d04-4e4d-83ef-bbf1d0518c94 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:47.742823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b59ef01a-4d04-4e4d-83ef-bbf1d0518c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:47.809460 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee79daa-7de9-4543-8b6a-bac5b70f0e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.810002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee79daa-7de9-4543-8b6a-bac5b70f0e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.810282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee79daa-7de9-4543-8b6a-bac5b70f0e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.811094 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee79daa-7de9-4543-8b6a-bac5b70f0e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.811780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee79daa-7de9-4543-8b6a-bac5b70f0e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.813398 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee79daa-7de9-4543-8b6a-bac5b70f0e13 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.817658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1343/2675] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:47.824418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1333/2676] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:47.829124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ef01a-4d04-4e4d-83ef-bbf1d0518c94 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.829330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee79daa-7de9-4543-8b6a-bac5b70f0e13 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.830543 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b59ef01a-4d04-4e4d-83ef-bbf1d0518c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:47.840259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee79daa-7de9-4543-8b6a-bac5b70f0e13 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.845191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616257f0-33ab-4f12-a6cd-5e8b81761b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.845867 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616257f0-33ab-4f12-a6cd-5e8b81761b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.846156 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616257f0-33ab-4f12-a6cd-5e8b81761b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.846575 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616257f0-33ab-4f12-a6cd-5e8b81761b69 admin admin] PATH_INFO: `/v3/projects/e190259c14004634bdad571f508386b5/users/6becae7285794595a3289bf56f2cc6f8/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.850311 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:47.865428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616257f0-33ab-4f12-a6cd-5e8b81761b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e190259c14004634bdad571f508386b5, user_id=6becae7285794595a3289bf56f2cc6f8, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.868227 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616257f0-33ab-4f12-a6cd-5e8b81761b69 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.884043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1334/2677] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:47 2022] PUT /identity/v3/projects/e190259c14004634bdad571f508386b5/users/6becae7285794595a3289bf56f2cc6f8/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:47.887962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616257f0-33ab-4f12-a6cd-5e8b81761b69 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.898577 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ef01a-4d04-4e4d-83ef-bbf1d0518c94 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.952165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0811841-dfd2-4603-9872-14ce370ac173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.952774 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0811841-dfd2-4603-9872-14ce370ac173 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.953051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0811841-dfd2-4603-9872-14ce370ac173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.953321 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0811841-dfd2-4603-9872-14ce370ac173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.960220 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616257f0-33ab-4f12-a6cd-5e8b81761b69 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.963076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0811841-dfd2-4603-9872-14ce370ac173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.964579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0811841-dfd2-4603-9872-14ce370ac173 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.965533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857e59a-e8a4-4436-a5b4-43b0c3f919f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.966145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857e59a-e8a4-4436-a5b4-43b0c3f919f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.966427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857e59a-e8a4-4436-a5b4-43b0c3f919f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.966734 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857e59a-e8a4-4436-a5b4-43b0c3f919f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.967442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857e59a-e8a4-4436-a5b4-43b0c3f919f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.969084 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857e59a-e8a4-4436-a5b4-43b0c3f919f1 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.975650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1344/2678] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:47.980222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1335/2679] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:47.984942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0811841-dfd2-4603-9872-14ce370ac173 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.995681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0811841-dfd2-4603-9872-14ce370ac173 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:48.001234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d6bda-f8b5-4eb9-8175-c386cb9fa8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:48.001909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d6bda-f8b5-4eb9-8175-c386cb9fa8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.002194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d6bda-f8b5-4eb9-8175-c386cb9fa8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.002469 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d6bda-f8b5-4eb9-8175-c386cb9fa8b4 admin admin] PATH_INFO: `/v3/projects/e190259c14004634bdad571f508386b5/users/6becae7285794595a3289bf56f2cc6f8/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:48.004552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d6bda-f8b5-4eb9-8175-c386cb9fa8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e190259c14004634bdad571f508386b5, user_id=6becae7285794595a3289bf56f2cc6f8, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:48.007163 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d6bda-f8b5-4eb9-8175-c386cb9fa8b4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:48.023924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1345/2680] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:47 2022] PUT /identity/v3/projects/e190259c14004634bdad571f508386b5/users/6becae7285794595a3289bf56f2cc6f8/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:48.035101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30e7a-9045-4fc6-9521-58a8930123ca None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.035620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30e7a-9045-4fc6-9521-58a8930123ca None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.036192 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30e7a-9045-4fc6-9521-58a8930123ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:48.071301 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-95a30e7a-9045-4fc6-9521-58a8930123ca None None] MFA Rules not processed for user `6becae7285794595a3289bf56f2cc6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:48.072834 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-95a30e7a-9045-4fc6-9521-58a8930123ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:48.178058 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1336/2681] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:48.192916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d6bda-f8b5-4eb9-8175-c386cb9fa8b4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:48.197905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-114d6bda-f8b5-4eb9-8175-c386cb9fa8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:48.257324 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:48.278157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d6bda-f8b5-4eb9-8175-c386cb9fa8b4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:48.283626 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8964c-c299-4b53-b129-81db49379741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:48.284297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8964c-c299-4b53-b129-81db49379741 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.284462 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a30e7a-9045-4fc6-9521-58a8930123ca None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:48.284603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8964c-c299-4b53-b129-81db49379741 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.284837 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8964c-c299-4b53-b129-81db49379741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:48.285755 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-95a30e7a-9045-4fc6-9521-58a8930123ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:48.296383 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8964c-c299-4b53-b129-81db49379741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:48.297940 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8964c-c299-4b53-b129-81db49379741 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:48.315188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1346/2682] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:48.367401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a30e7a-9045-4fc6-9521-58a8930123ca None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:48.372403 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:48.373079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.373360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.373640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] PATH_INFO: `/v3/projects/82e169fd17374011b88506cd782c5e17` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:48.374963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e169fd17374011b88506cd782c5e17)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:48.376813 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:48.386856 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:48.437643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e169fd17374011b88506cd782c5e17', 'request_id': 'req-e0998f95-1030-4c1f-84bd-d021c2acbbfc'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.443360 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e169fd17374011b88506cd782c5e17', 'request_id': 'req-e0998f95-1030-4c1f-84bd-d021c2acbbfc'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.449647 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e169fd17374011b88506cd782c5e17', 'request_id': 'req-e0998f95-1030-4c1f-84bd-d021c2acbbfc'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.464776 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] The token cache is being invalidate because project 82e169fd17374011b88506cd782c5e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:48.465372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.465544 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.468506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1337/2683] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:48 2022] DELETE /identity/v3/projects/82e169fd17374011b88506cd782c5e17 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:48.471662 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8964c-c299-4b53-b129-81db49379741 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:48.483056 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8964c-c299-4b53-b129-81db49379741 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:48.556124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d01ef-4b72-41a6-aed3-6470c1e0a4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:48.556771 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d01ef-4b72-41a6-aed3-6470c1e0a4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.557054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d01ef-4b72-41a6-aed3-6470c1e0a4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.557331 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d01ef-4b72-41a6-aed3-6470c1e0a4e3 admin admin] PATH_INFO: `/v3/users/5205a719ed2f4fe2950ea3325fe899a5` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:48.558515 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d01ef-4b72-41a6-aed3-6470c1e0a4e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5205a719ed2f4fe2950ea3325fe899a5)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:48.560659 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d01ef-4b72-41a6-aed3-6470c1e0a4e3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:48.640751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-979d01ef-4b72-41a6-aed3-6470c1e0a4e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5205a719ed2f4fe2950ea3325fe899a5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.650721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-979d01ef-4b72-41a6-aed3-6470c1e0a4e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5205a719ed2f4fe2950ea3325fe899a5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.660331 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-979d01ef-4b72-41a6-aed3-6470c1e0a4e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5205a719ed2f4fe2950ea3325fe899a5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.661154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-979d01ef-4b72-41a6-aed3-6470c1e0a4e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5205a719ed2f4fe2950ea3325fe899a5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.687787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-979d01ef-4b72-41a6-aed3-6470c1e0a4e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5205a719ed2f4fe2950ea3325fe899a5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.697207 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1347/2684] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:48 2022] DELETE /identity/v3/users/5205a719ed2f4fe2950ea3325fe899a5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:48.814177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:48.816561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:48.833705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0998f95-1030-4c1f-84bd-d021c2acbbfc admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:48.922788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:48.928762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.929160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.929669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] PATH_INFO: `/v3/users/9ce43cb7ed8b4ca2bc240c4d8cd02d9c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:48.932302 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce43cb7ed8b4ca2bc240c4d8cd02d9c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:48.934031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:48.995011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce43cb7ed8b4ca2bc240c4d8cd02d9c'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.004695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce43cb7ed8b4ca2bc240c4d8cd02d9c'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.006000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce43cb7ed8b4ca2bc240c4d8cd02d9c'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.006664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce43cb7ed8b4ca2bc240c4d8cd02d9c'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.026232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce43cb7ed8b4ca2bc240c4d8cd02d9c'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.045545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1338/2685] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:48 2022] DELETE /identity/v3/users/9ce43cb7ed8b4ca2bc240c4d8cd02d9c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:49.049769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78710a1-4615-483a-a115-fe43b09f3ee6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.050141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78710a1-4615-483a-a115-fe43b09f3ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.050516 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78710a1-4615-483a-a115-fe43b09f3ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.076053 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.077867 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.082685 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c78710a1-4615-483a-a115-fe43b09f3ee6 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:49.084402 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c78710a1-4615-483a-a115-fe43b09f3ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.103877 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:49.159775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1348/2686] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:49.168613 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99146a1-fb8e-4233-83a6-798207e3ef30 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:49.169813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78710a1-4615-483a-a115-fe43b09f3ee6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.171876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c78710a1-4615-483a-a115-fe43b09f3ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.174632 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:49.175271 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.175551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.175851 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25 admin admin] PATH_INFO: `/v3/projects/69b96b5a63e94f81929357701f66bb28` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.177009 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b96b5a63e94f81929357701f66bb28)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:49.177571 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:49.178968 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:49.234422 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78710a1-4615-483a-a115-fe43b09f3ee6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:49.240998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b96b5a63e94f81929357701f66bb28', 'request_id': 'req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.249369 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b96b5a63e94f81929357701f66bb28', 'request_id': 'req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.257625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b96b5a63e94f81929357701f66bb28', 'request_id': 'req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.273416 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25 admin admin] The token cache is being invalidate because project 69b96b5a63e94f81929357701f66bb28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:49.273710 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.274409 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-5cf4e794-dae2-4a00-8f2e-bbea25ab2a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.276078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1339/2687] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:49 2022] DELETE /identity/v3/projects/69b96b5a63e94f81929357701f66bb28 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:49.281655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cb9de-9aa2-4a3d-93dc-9aa07d32d9aa None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.282001 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cb9de-9aa2-4a3d-93dc-9aa07d32d9aa None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.282357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cb9de-9aa2-4a3d-93dc-9aa07d32d9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.288081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba0c42-9368-4741-b47a-879378549789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:49.288703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba0c42-9368-4741-b47a-879378549789 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.288985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba0c42-9368-4741-b47a-879378549789 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.289257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba0c42-9368-4741-b47a-879378549789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.291054 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4fba0c42-9368-4741-b47a-879378549789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.305213 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-8b7cb9de-9aa2-4a3d-93dc-9aa07d32d9aa None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:49.306489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8b7cb9de-9aa2-4a3d-93dc-9aa07d32d9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.366938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba0c42-9368-4741-b47a-879378549789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:49.368471 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba0c42-9368-4741-b47a-879378549789 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:49.379421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1349/2688] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:49.383651 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1340/2689] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:49.451640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c70d24-63fe-49be-9664-73b85f5fab28 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.451952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c70d24-63fe-49be-9664-73b85f5fab28 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.452232 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c70d24-63fe-49be-9664-73b85f5fab28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.474666 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-51c70d24-63fe-49be-9664-73b85f5fab28 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:49.476035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-51c70d24-63fe-49be-9664-73b85f5fab28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.486632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1350/2690] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:49.491723 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cb9de-9aa2-4a3d-93dc-9aa07d32d9aa None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.504476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cb9de-9aa2-4a3d-93dc-9aa07d32d9aa None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:49.512446 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2689384-0b27-4a51-9c41-9373843b47bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:49.514120 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2689384-0b27-4a51-9c41-9373843b47bc admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.514251 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2689384-0b27-4a51-9c41-9373843b47bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.514611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2689384-0b27-4a51-9c41-9373843b47bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.515319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2689384-0b27-4a51-9c41-9373843b47bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:49.515812 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2689384-0b27-4a51-9c41-9373843b47bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:49.517837 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2689384-0b27-4a51-9c41-9373843b47bc admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:49.535440 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1341/2691] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:49.536712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c70d24-63fe-49be-9664-73b85f5fab28 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.546624 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c70d24-63fe-49be-9664-73b85f5fab28 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:49.554930 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48b97b-01c0-4302-96c5-5586d4bd7415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:49.555191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b97b-01c0-4302-96c5-5586d4bd7415 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.555472 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b97b-01c0-4302-96c5-5586d4bd7415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.555770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b97b-01c0-4302-96c5-5586d4bd7415 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.556403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48b97b-01c0-4302-96c5-5586d4bd7415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:49.558315 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48b97b-01c0-4302-96c5-5586d4bd7415 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:49.594991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1351/2692] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:49 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:49.599202 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2689384-0b27-4a51-9c41-9373843b47bc admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.610824 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2689384-0b27-4a51-9c41-9373843b47bc admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:49.644518 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:49.676689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900af43-011e-4d59-b063-a6d7e8b7c756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:49.677379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900af43-011e-4d59-b063-a6d7e8b7c756 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.677662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900af43-011e-4d59-b063-a6d7e8b7c756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.677935 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900af43-011e-4d59-b063-a6d7e8b7c756 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.678574 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900af43-011e-4d59-b063-a6d7e8b7c756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:49.680705 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900af43-011e-4d59-b063-a6d7e8b7c756 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:49.704748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1342/2693] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:49 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:49.709082 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900af43-011e-4d59-b063-a6d7e8b7c756 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.709642 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48b97b-01c0-4302-96c5-5586d4bd7415 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.710826 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-5900af43-011e-4d59-b063-a6d7e8b7c756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.721794 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48b97b-01c0-4302-96c5-5586d4bd7415 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:49.726783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900af43-011e-4d59-b063-a6d7e8b7c756 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:49.728648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1e5f-fbd1-4722-ab10-01388acf6ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:49.730650 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1e5f-fbd1-4722-ab10-01388acf6ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.731372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1e5f-fbd1-4722-ab10-01388acf6ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.731809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1e5f-fbd1-4722-ab10-01388acf6ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.732552 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:49.732689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c1e5f-fbd1-4722-ab10-01388acf6ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:49.733357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.733715 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.734064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] PATH_INFO: `/v3/projects/f97e2a39f0c44ed087ed246e5ca184d0` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.734835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c1e5f-fbd1-4722-ab10-01388acf6ac3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:49.735495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97e2a39f0c44ed087ed246e5ca184d0)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:49.738106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:49.758503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1352/2694] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:49.760671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1e5f-fbd1-4722-ab10-01388acf6ac3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.772031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1e5f-fbd1-4722-ab10-01388acf6ac3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:49.777593 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22365bad-a1db-43f3-bdd6-151509cba576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:49.778006 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22365bad-a1db-43f3-bdd6-151509cba576 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.778288 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22365bad-a1db-43f3-bdd6-151509cba576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.778562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22365bad-a1db-43f3-bdd6-151509cba576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.779257 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22365bad-a1db-43f3-bdd6-151509cba576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:49.780881 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22365bad-a1db-43f3-bdd6-151509cba576 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:49.791793 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1353/2695] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:49.796028 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22365bad-a1db-43f3-bdd6-151509cba576 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.797175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97e2a39f0c44ed087ed246e5ca184d0', 'request_id': 'req-c792d923-7929-487c-a566-17d719b4c879'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.806854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22365bad-a1db-43f3-bdd6-151509cba576 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:49.812481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97e2a39f0c44ed087ed246e5ca184d0', 'request_id': 'req-c792d923-7929-487c-a566-17d719b4c879'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.819147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97e2a39f0c44ed087ed246e5ca184d0', 'request_id': 'req-c792d923-7929-487c-a566-17d719b4c879'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.820803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:49.837428 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] The token cache is being invalidate because project f97e2a39f0c44ed087ed246e5ca184d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:49.837885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.838909 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.841433 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1343/2696] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:49 2022] DELETE /identity/v3/projects/f97e2a39f0c44ed087ed246e5ca184d0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:49.847153 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.849261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.882962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d6107-7ee1-441b-b129-f594b1b556ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:49.883658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d6107-7ee1-441b-b129-f594b1b556ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.883966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d6107-7ee1-441b-b129-f594b1b556ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.884555 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d6107-7ee1-441b-b129-f594b1b556ad admin admin] PATH_INFO: `/v3/projects/576dca549712483482d0976636e63ec7/users/6826e41c230c46028e024799ca66237d/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.905928 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d6107-7ee1-441b-b129-f594b1b556ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=576dca549712483482d0976636e63ec7, user_id=6826e41c230c46028e024799ca66237d, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:49.908725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d6107-7ee1-441b-b129-f594b1b556ad admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:49.934465 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792d923-7929-487c-a566-17d719b4c879 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:49.934680 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1354/2697] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:49 2022] PUT /identity/v3/projects/576dca549712483482d0976636e63ec7/users/6826e41c230c46028e024799ca66237d/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:49.946166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83abe30-c4b6-4268-9982-77fd4efea080 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.946493 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83abe30-c4b6-4268-9982-77fd4efea080 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.946690 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83abe30-c4b6-4268-9982-77fd4efea080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.981034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b83abe30-c4b6-4268-9982-77fd4efea080 None None] MFA Rules not processed for user `6826e41c230c46028e024799ca66237d`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:49.982359 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b83abe30-c4b6-4268-9982-77fd4efea080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.994612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:50.006066 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.007150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.007748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.008269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] PATH_INFO: `/v3/users/6becae7285794595a3289bf56f2cc6f8` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.009580 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6becae7285794595a3289bf56f2cc6f8)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.011670 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.059764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1355/2698] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:50.061496 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83abe30-c4b6-4268-9982-77fd4efea080 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.062937 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b83abe30-c4b6-4268-9982-77fd4efea080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.077890 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83abe30-c4b6-4268-9982-77fd4efea080 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.082711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d76d27-1d42-4080-8b22-111d5a225bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.083356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d76d27-1d42-4080-8b22-111d5a225bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.083662 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d76d27-1d42-4080-8b22-111d5a225bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.084033 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d76d27-1d42-4080-8b22-111d5a225bfc admin admin] PATH_INFO: `/v3/users/0ac0f573c9ef4a9684a74d6156b524e7` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.085553 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d76d27-1d42-4080-8b22-111d5a225bfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac0f573c9ef4a9684a74d6156b524e7)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.087497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d76d27-1d42-4080-8b22-111d5a225bfc admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.088122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6becae7285794595a3289bf56f2cc6f8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.096993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6becae7285794595a3289bf56f2cc6f8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.097655 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6becae7285794595a3289bf56f2cc6f8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.098291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6becae7285794595a3289bf56f2cc6f8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.111505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6becae7285794595a3289bf56f2cc6f8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.128694 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1344/2699] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:49 2022] DELETE /identity/v3/users/6becae7285794595a3289bf56f2cc6f8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:50.135063 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.137848 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.152990 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d8d76d27-1d42-4080-8b22-111d5a225bfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac0f573c9ef4a9684a74d6156b524e7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.161637 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d8d76d27-1d42-4080-8b22-111d5a225bfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac0f573c9ef4a9684a74d6156b524e7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.171139 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d8d76d27-1d42-4080-8b22-111d5a225bfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac0f573c9ef4a9684a74d6156b524e7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.172037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d8d76d27-1d42-4080-8b22-111d5a225bfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac0f573c9ef4a9684a74d6156b524e7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.189318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d8d76d27-1d42-4080-8b22-111d5a225bfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac0f573c9ef4a9684a74d6156b524e7'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.197926 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1356/2700] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:50 2022] DELETE /identity/v3/users/0ac0f573c9ef4a9684a74d6156b524e7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:50.202489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b9f9e-3bda-4653-bb73-7c0aebeaf946 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.202848 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b9f9e-3bda-4653-bb73-7c0aebeaf946 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.203191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b9f9e-3bda-4653-bb73-7c0aebeaf946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.210622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:50.228475 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9f5b9f9e-3bda-4653-bb73-7c0aebeaf946 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:50.231026 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9f5b9f9e-3bda-4653-bb73-7c0aebeaf946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.233800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec5a23-6dff-40ea-b357-2e61c0dbbab9 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.310147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1357/2701] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:50.317375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ada7-2a97-4c58-9b1d-b7a0264d0b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.318256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ada7-2a97-4c58-9b1d-b7a0264d0b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.318706 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ada7-2a97-4c58-9b1d-b7a0264d0b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.319150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ada7-2a97-4c58-9b1d-b7a0264d0b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.319988 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03ada7-2a97-4c58-9b1d-b7a0264d0b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.321041 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b9f9e-3bda-4653-bb73-7c0aebeaf946 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.323206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03ada7-2a97-4c58-9b1d-b7a0264d0b83 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.323700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9f5b9f9e-3bda-4653-bb73-7c0aebeaf946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.367444 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1345/2702] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:50 2022] POST /identity/v3/projects => generated 383 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:50.371267 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ada7-2a97-4c58-9b1d-b7a0264d0b83 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.374494 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ed03ada7-2a97-4c58-9b1d-b7a0264d0b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.381200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:50.424475 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b9f9e-3bda-4653-bb73-7c0aebeaf946 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.472994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ada7-2a97-4c58-9b1d-b7a0264d0b83 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.480159 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab26b39-7916-495e-b900-4fc31473a9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.481080 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26b39-7916-495e-b900-4fc31473a9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.481475 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26b39-7916-495e-b900-4fc31473a9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.481959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26b39-7916-495e-b900-4fc31473a9e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.483171 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab26b39-7916-495e-b900-4fc31473a9e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.485640 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab26b39-7916-495e-b900-4fc31473a9e3 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.494742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433911e-da4a-4bc7-b71c-8445de38772a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.495912 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433911e-da4a-4bc7-b71c-8445de38772a service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.496297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433911e-da4a-4bc7-b71c-8445de38772a service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.496803 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433911e-da4a-4bc7-b71c-8445de38772a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.509935 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1346/2703] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:50 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:50.513666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab26b39-7916-495e-b900-4fc31473a9e3 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.515125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433911e-da4a-4bc7-b71c-8445de38772a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.516310 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-eab26b39-7916-495e-b900-4fc31473a9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.516658 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433911e-da4a-4bc7-b71c-8445de38772a service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.534124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1358/2704] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:50.534873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab26b39-7916-495e-b900-4fc31473a9e3 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.535069 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433911e-da4a-4bc7-b71c-8445de38772a service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.541998 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3beb0-9df5-4867-906c-04be0142e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.543155 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3beb0-9df5-4867-906c-04be0142e423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.543527 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3beb0-9df5-4867-906c-04be0142e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.544199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3beb0-9df5-4867-906c-04be0142e423 admin admin] PATH_INFO: `/v3/projects/e190259c14004634bdad571f508386b5` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.546204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3beb0-9df5-4867-906c-04be0142e423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e190259c14004634bdad571f508386b5)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.548352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433911e-da4a-4bc7-b71c-8445de38772a service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.548603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3beb0-9df5-4867-906c-04be0142e423 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.553452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1586a77-39d3-40f4-b5f0-1905132b1c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.554062 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1586a77-39d3-40f4-b5f0-1905132b1c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.554347 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1586a77-39d3-40f4-b5f0-1905132b1c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.554623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1586a77-39d3-40f4-b5f0-1905132b1c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.555280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1586a77-39d3-40f4-b5f0-1905132b1c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.556946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1586a77-39d3-40f4-b5f0-1905132b1c06 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.569142 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1359/2705] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:50.572956 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1586a77-39d3-40f4-b5f0-1905132b1c06 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.584749 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1586a77-39d3-40f4-b5f0-1905132b1c06 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.592313 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0127ba-2686-4e9e-bb1d-bcd4f354438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.593369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0127ba-2686-4e9e-bb1d-bcd4f354438e admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.593916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0127ba-2686-4e9e-bb1d-bcd4f354438e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.594274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0127ba-2686-4e9e-bb1d-bcd4f354438e admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.595478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0127ba-2686-4e9e-bb1d-bcd4f354438e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.597930 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0127ba-2686-4e9e-bb1d-bcd4f354438e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.611470 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1360/2706] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:50.612120 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c2f3beb0-9df5-4867-906c-04be0142e423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e190259c14004634bdad571f508386b5', 'request_id': 'req-c2f3beb0-9df5-4867-906c-04be0142e423'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.615863 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0127ba-2686-4e9e-bb1d-bcd4f354438e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.621185 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c2f3beb0-9df5-4867-906c-04be0142e423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e190259c14004634bdad571f508386b5', 'request_id': 'req-c2f3beb0-9df5-4867-906c-04be0142e423'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.629661 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0127ba-2686-4e9e-bb1d-bcd4f354438e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.630451 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c2f3beb0-9df5-4867-906c-04be0142e423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e190259c14004634bdad571f508386b5', 'request_id': 'req-c2f3beb0-9df5-4867-906c-04be0142e423'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.650458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c2f3beb0-9df5-4867-906c-04be0142e423 admin admin] The token cache is being invalidate because project e190259c14004634bdad571f508386b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:50.650945 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c2f3beb0-9df5-4867-906c-04be0142e423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.651934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c2f3beb0-9df5-4867-906c-04be0142e423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.654793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1347/2707] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:50 2022] DELETE /identity/v3/projects/e190259c14004634bdad571f508386b5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:50.663536 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7649b-5009-4770-bde3-2fca879e6427 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.664020 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7649b-5009-4770-bde3-2fca879e6427 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.664435 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7649b-5009-4770-bde3-2fca879e6427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.682579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:50.696383 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-dcc7649b-5009-4770-bde3-2fca879e6427 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:50.697701 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-dcc7649b-5009-4770-bde3-2fca879e6427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.714372 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eeba07-fa4c-43ba-88b5-7e83a97df874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.715513 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeba07-fa4c-43ba-88b5-7e83a97df874 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.715980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeba07-fa4c-43ba-88b5-7e83a97df874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.716443 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeba07-fa4c-43ba-88b5-7e83a97df874 admin admin] PATH_INFO: `/v3/projects/23be57bf25d04cd294294465bf3b174e/users/4a6ed5f0009944c68b669a861297c4ea/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.742550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eeba07-fa4c-43ba-88b5-7e83a97df874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23be57bf25d04cd294294465bf3b174e, user_id=4a6ed5f0009944c68b669a861297c4ea, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.745838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eeba07-fa4c-43ba-88b5-7e83a97df874 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.775118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1361/2708] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:50 2022] PUT /identity/v3/projects/23be57bf25d04cd294294465bf3b174e/users/4a6ed5f0009944c68b669a861297c4ea/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:50.783291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f20e-580d-4254-b76b-1fc1ca95cb16 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.783608 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1348/2709] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:50.783829 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f20e-580d-4254-b76b-1fc1ca95cb16 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.783829 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f20e-580d-4254-b76b-1fc1ca95cb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.786086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6964c4-4e79-42a4-aaad-f0aea260838d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.786417 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6964c4-4e79-42a4-aaad-f0aea260838d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.787049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6964c4-4e79-42a4-aaad-f0aea260838d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.808396 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-1d6964c4-4e79-42a4-aaad-f0aea260838d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:50.809724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1d6964c4-4e79-42a4-aaad-f0aea260838d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.820712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0b73f20e-580d-4254-b76b-1fc1ca95cb16 None None] MFA Rules not processed for user `4a6ed5f0009944c68b669a861297c4ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:50.824152 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:50.824404 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0b73f20e-580d-4254-b76b-1fc1ca95cb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.917708 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1349/2710] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:50.918436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6964c4-4e79-42a4-aaad-f0aea260838d None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.921374 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-1d6964c4-4e79-42a4-aaad-f0aea260838d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.926464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1362/2711] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:50.927530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f20e-580d-4254-b76b-1fc1ca95cb16 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.936259 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6964c4-4e79-42a4-aaad-f0aea260838d None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.938677 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f20e-580d-4254-b76b-1fc1ca95cb16 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.941144 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.941892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.942270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.942616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] PATH_INFO: `/v3/projects/0fdf642a60db4b38a7376651ccc8d937` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.943368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ccab7-d6ee-4eac-820e-e15684ffdfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.943963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fdf642a60db4b38a7376651ccc8d937)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.944072 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ccab7-d6ee-4eac-820e-e15684ffdfdf admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.944262 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ccab7-d6ee-4eac-820e-e15684ffdfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.944530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ccab7-d6ee-4eac-820e-e15684ffdfdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.945181 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ccab7-d6ee-4eac-820e-e15684ffdfdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:50.945478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ccab7-d6ee-4eac-820e-e15684ffdfdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.946306 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.947061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ccab7-d6ee-4eac-820e-e15684ffdfdf admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.963644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1363/2712] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:50.964577 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ccab7-d6ee-4eac-820e-e15684ffdfdf admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.967644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-038ccab7-d6ee-4eac-820e-e15684ffdfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.986305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ccab7-d6ee-4eac-820e-e15684ffdfdf admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.001789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fdf642a60db4b38a7376651ccc8d937', 'request_id': 'req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.007992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fdf642a60db4b38a7376651ccc8d937', 'request_id': 'req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.015211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fdf642a60db4b38a7376651ccc8d937', 'request_id': 'req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.030682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] The token cache is being invalidate because project 0fdf642a60db4b38a7376651ccc8d937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:51.030974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.032032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.033586 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1350/2713] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:50 2022] DELETE /identity/v3/projects/0fdf642a60db4b38a7376651ccc8d937 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:51.034432 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.035807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.049489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e32a0-4999-4e8f-9560-47b8f7df42c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.050112 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e32a0-4999-4e8f-9560-47b8f7df42c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.050535 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e32a0-4999-4e8f-9560-47b8f7df42c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.050814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e32a0-4999-4e8f-9560-47b8f7df42c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.051449 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e32a0-4999-4e8f-9560-47b8f7df42c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.053403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e32a0-4999-4e8f-9560-47b8f7df42c1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.084900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1364/2714] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:50 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:51.085947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e32a0-4999-4e8f-9560-47b8f7df42c1 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.087665 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-543e32a0-4999-4e8f-9560-47b8f7df42c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.117809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:51.118684 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0438c7-4cde-4921-8c5e-5c4f8a1cc9cc admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.175564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e32a0-4999-4e8f-9560-47b8f7df42c1 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.178040 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:51.181615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.182267 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.182546 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.182814 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] PATH_INFO: `/v3/users/81fe150c01a64eecb32a7470e600c126` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.183988 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81fe150c01a64eecb32a7470e600c126)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.186039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.202037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18506129-9edf-46cc-a685-7f9ab36c9712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.202904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18506129-9edf-46cc-a685-7f9ab36c9712 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.203291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18506129-9edf-46cc-a685-7f9ab36c9712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.203784 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18506129-9edf-46cc-a685-7f9ab36c9712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.205157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18506129-9edf-46cc-a685-7f9ab36c9712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.208724 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18506129-9edf-46cc-a685-7f9ab36c9712 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.242367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81fe150c01a64eecb32a7470e600c126'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.246863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1351/2715] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:51 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:51.246863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18506129-9edf-46cc-a685-7f9ab36c9712 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.246863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-18506129-9edf-46cc-a685-7f9ab36c9712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.258949 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81fe150c01a64eecb32a7470e600c126'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.269453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81fe150c01a64eecb32a7470e600c126'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.270425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81fe150c01a64eecb32a7470e600c126'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.286931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81fe150c01a64eecb32a7470e600c126'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.294007 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1365/2716] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:51 2022] DELETE /identity/v3/users/81fe150c01a64eecb32a7470e600c126 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:51.295912 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.297471 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.363685 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18506129-9edf-46cc-a685-7f9ab36c9712 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.397786 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdadd3f-95df-413f-af89-117fbeee4f38 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.403624 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebe6ad-0260-4dc6-9421-9751f3385387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.404894 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebe6ad-0260-4dc6-9421-9751f3385387 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.405192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebe6ad-0260-4dc6-9421-9751f3385387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.405612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebe6ad-0260-4dc6-9421-9751f3385387 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.406394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebe6ad-0260-4dc6-9421-9751f3385387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.408872 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebe6ad-0260-4dc6-9421-9751f3385387 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.451582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1366/2717] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:51 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:51.452232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2ab1b-79ce-42e7-af13-9bbb76bf6139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.453252 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2ab1b-79ce-42e7-af13-9bbb76bf6139 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.453252 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2ab1b-79ce-42e7-af13-9bbb76bf6139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.453479 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2ab1b-79ce-42e7-af13-9bbb76bf6139 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.454181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2ab1b-79ce-42e7-af13-9bbb76bf6139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.455965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebe6ad-0260-4dc6-9421-9751f3385387 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.456977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2ab1b-79ce-42e7-af13-9bbb76bf6139 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.474336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebe6ad-0260-4dc6-9421-9751f3385387 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.480320 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cdcd6-a2e6-459f-b58e-279f7354a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.480952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cdcd6-a2e6-459f-b58e-279f7354a2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.481231 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cdcd6-a2e6-459f-b58e-279f7354a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.481501 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cdcd6-a2e6-459f-b58e-279f7354a2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.482188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cdcd6-a2e6-459f-b58e-279f7354a2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.483880 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cdcd6-a2e6-459f-b58e-279f7354a2a3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.487671 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1352/2718] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:51 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:51.492301 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2ab1b-79ce-42e7-af13-9bbb76bf6139 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.494643 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-43b2ab1b-79ce-42e7-af13-9bbb76bf6139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.500365 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1367/2719] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:51.501351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cdcd6-a2e6-459f-b58e-279f7354a2a3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.511642 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cdcd6-a2e6-459f-b58e-279f7354a2a3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.516469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2ab1b-79ce-42e7-af13-9bbb76bf6139 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.518423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de82ce4-68f0-47d4-b3bb-1790c4f0fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.519035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de82ce4-68f0-47d4-b3bb-1790c4f0fc8b admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.519305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de82ce4-68f0-47d4-b3bb-1790c4f0fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.519572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de82ce4-68f0-47d4-b3bb-1790c4f0fc8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.520258 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de82ce4-68f0-47d4-b3bb-1790c4f0fc8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.521861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de82ce4-68f0-47d4-b3bb-1790c4f0fc8b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.528491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e50dc-c861-410b-a0ab-9329d053bdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.532667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e50dc-c861-410b-a0ab-9329d053bdfa admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.533312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e50dc-c861-410b-a0ab-9329d053bdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.533911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e50dc-c861-410b-a0ab-9329d053bdfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.535266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e50dc-c861-410b-a0ab-9329d053bdfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.538235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e50dc-c861-410b-a0ab-9329d053bdfa admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.539394 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1368/2720] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:51.540308 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de82ce4-68f0-47d4-b3bb-1790c4f0fc8b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.551906 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1353/2721] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:51.556620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e50dc-c861-410b-a0ab-9329d053bdfa admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.556776 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de82ce4-68f0-47d4-b3bb-1790c4f0fc8b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.566849 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449ac06-820a-45ee-9a53-9269468b5da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.567523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e50dc-c861-410b-a0ab-9329d053bdfa admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.567671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449ac06-820a-45ee-9a53-9269468b5da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.567865 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449ac06-820a-45ee-9a53-9269468b5da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.568099 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449ac06-820a-45ee-9a53-9269468b5da7 admin admin] PATH_INFO: `/v3/projects/9b98ea2757be497e8fd746c3a2eb2e75/users/130be03d05ac4e549b1713db5904518f/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.572769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d174542-be22-44de-85c5-5c090d191afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.573454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d174542-be22-44de-85c5-5c090d191afb admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.573739 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d174542-be22-44de-85c5-5c090d191afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.574019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d174542-be22-44de-85c5-5c090d191afb admin admin] PATH_INFO: `/v3/projects/ec2f7be83c57438e968b54bf403ae9a3/users/871fdbe6e5304ad79db552a15c2c5f04/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.580488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:51.595603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d174542-be22-44de-85c5-5c090d191afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2f7be83c57438e968b54bf403ae9a3, user_id=871fdbe6e5304ad79db552a15c2c5f04, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.598620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d174542-be22-44de-85c5-5c090d191afb admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.602444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449ac06-820a-45ee-9a53-9269468b5da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b98ea2757be497e8fd746c3a2eb2e75, user_id=130be03d05ac4e549b1713db5904518f, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.605968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449ac06-820a-45ee-9a53-9269468b5da7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.615126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1354/2722] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:51 2022] PUT /identity/v3/projects/ec2f7be83c57438e968b54bf403ae9a3/users/871fdbe6e5304ad79db552a15c2c5f04/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:51.619616 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d174542-be22-44de-85c5-5c090d191afb admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.624975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1369/2723] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:51 2022] PUT /identity/v3/projects/9b98ea2757be497e8fd746c3a2eb2e75/users/130be03d05ac4e549b1713db5904518f/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:51.637734 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee218fc-b0f1-4a39-9c11-fb6ca603ccfb None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.639340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee218fc-b0f1-4a39-9c11-fb6ca603ccfb None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.639994 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee218fc-b0f1-4a39-9c11-fb6ca603ccfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.686319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:51.688773 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3ee218fc-b0f1-4a39-9c11-fb6ca603ccfb None None] MFA Rules not processed for user `130be03d05ac4e549b1713db5904518f`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:51.690036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3ee218fc-b0f1-4a39-9c11-fb6ca603ccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.717203 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d174542-be22-44de-85c5-5c090d191afb admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.761370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1370/2724] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:51.765975 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee218fc-b0f1-4a39-9c11-fb6ca603ccfb None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.767355 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3ee218fc-b0f1-4a39-9c11-fb6ca603ccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.779636 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf9099-edc9-4eba-b3fa-b6bac27f010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.780277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf9099-edc9-4eba-b3fa-b6bac27f010a admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.780557 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf9099-edc9-4eba-b3fa-b6bac27f010a admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.780831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf9099-edc9-4eba-b3fa-b6bac27f010a admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.781476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf9099-edc9-4eba-b3fa-b6bac27f010a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.783051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf9099-edc9-4eba-b3fa-b6bac27f010a admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.798236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1355/2725] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:51.798236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf9099-edc9-4eba-b3fa-b6bac27f010a admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.804642 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf9099-edc9-4eba-b3fa-b6bac27f010a admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.809641 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d08d43-9213-4381-8693-a0ec78de52db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.810269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d08d43-9213-4381-8693-a0ec78de52db admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.811090 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d08d43-9213-4381-8693-a0ec78de52db admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.811419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d08d43-9213-4381-8693-a0ec78de52db admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.812030 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d08d43-9213-4381-8693-a0ec78de52db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.813975 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d08d43-9213-4381-8693-a0ec78de52db admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.846958 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee218fc-b0f1-4a39-9c11-fb6ca603ccfb None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.854578 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1356/2726] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:51 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:51.854734 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.854849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d08d43-9213-4381-8693-a0ec78de52db admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.854972 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.854972 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.854972 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] PATH_INFO: `/v3/projects/6f1c006a5e484e2a8ed2693155ccc227` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.854972 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1c006a5e484e2a8ed2693155ccc227)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.856095 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.905537 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1c006a5e484e2a8ed2693155ccc227', 'request_id': 'req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.916610 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1c006a5e484e2a8ed2693155ccc227', 'request_id': 'req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.919345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1c006a5e484e2a8ed2693155ccc227', 'request_id': 'req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.932015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d08d43-9213-4381-8693-a0ec78de52db admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.933980 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] The token cache is being invalidate because project 6f1c006a5e484e2a8ed2693155ccc227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:51.934351 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.935041 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.937188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1371/2727] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:51 2022] DELETE /identity/v3/projects/6f1c006a5e484e2a8ed2693155ccc227 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:51.938141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.939499 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.950562 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:52.003836 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fdd27-fd9a-4a09-9e8b-abf5b1d2c62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.004910 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fdd27-fd9a-4a09-9e8b-abf5b1d2c62f admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.005297 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fdd27-fd9a-4a09-9e8b-abf5b1d2c62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.005577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fdd27-fd9a-4a09-9e8b-abf5b1d2c62f admin admin] PATH_INFO: `/v3/projects/ec2f7be83c57438e968b54bf403ae9a3/users/871fdbe6e5304ad79db552a15c2c5f04/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.007586 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fdd27-fd9a-4a09-9e8b-abf5b1d2c62f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2f7be83c57438e968b54bf403ae9a3, user_id=871fdbe6e5304ad79db552a15c2c5f04, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.010246 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fdd27-fd9a-4a09-9e8b-abf5b1d2c62f admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.016273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:52.021262 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd33d2-81bd-4f99-8fd0-3f230506f12d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.022153 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1357/2728] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:51 2022] PUT /identity/v3/projects/ec2f7be83c57438e968b54bf403ae9a3/users/871fdbe6e5304ad79db552a15c2c5f04/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:52.023201 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf4d40-22aa-4c5a-b5ff-2141aee10709 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.023484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf4d40-22aa-4c5a-b5ff-2141aee10709 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.023863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf4d40-22aa-4c5a-b5ff-2141aee10709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.046265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-06cf4d40-22aa-4c5a-b5ff-2141aee10709 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:52.047500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-06cf4d40-22aa-4c5a-b5ff-2141aee10709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:52.087512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431a1f0-fb7e-4624-9f94-bed1305b4069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.088277 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431a1f0-fb7e-4624-9f94-bed1305b4069 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.088567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431a1f0-fb7e-4624-9f94-bed1305b4069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.088843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431a1f0-fb7e-4624-9f94-bed1305b4069 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.089480 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431a1f0-fb7e-4624-9f94-bed1305b4069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.092507 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431a1f0-fb7e-4624-9f94-bed1305b4069 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.112330 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1358/2729] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:52.113745 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e572-d82f-4974-a176-d4def48c6d43 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.114200 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e572-d82f-4974-a176-d4def48c6d43 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.114540 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e572-d82f-4974-a176-d4def48c6d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.119815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1372/2730] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:51 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:52.122532 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55941e-e71f-45b4-a1bc-ead22b847b7b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.124036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55941e-e71f-45b4-a1bc-ead22b847b7b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.124036 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55941e-e71f-45b4-a1bc-ead22b847b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.145337 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-ca71e572-d82f-4974-a176-d4def48c6d43 None None] MFA Rules not processed for user `871fdbe6e5304ad79db552a15c2c5f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:52.146614 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ca71e572-d82f-4974-a176-d4def48c6d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:52.152448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ea55941e-e71f-45b4-a1bc-ead22b847b7b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:52.153656 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ea55941e-e71f-45b4-a1bc-ead22b847b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:52.162085 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1373/2731] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:52.162978 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55941e-e71f-45b4-a1bc-ead22b847b7b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.173705 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55941e-e71f-45b4-a1bc-ead22b847b7b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.178426 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba468432-806a-4ef8-ba6c-d8658101d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.179038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba468432-806a-4ef8-ba6c-d8658101d07a admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.179315 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba468432-806a-4ef8-ba6c-d8658101d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.179582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba468432-806a-4ef8-ba6c-d8658101d07a admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.180260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba468432-806a-4ef8-ba6c-d8658101d07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.181854 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba468432-806a-4ef8-ba6c-d8658101d07a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.196137 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1374/2732] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:52.196137 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba468432-806a-4ef8-ba6c-d8658101d07a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.204465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba468432-806a-4ef8-ba6c-d8658101d07a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.209292 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fd13d-5993-402b-ab9d-96cb259d9b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.209905 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fd13d-5993-402b-ab9d-96cb259d9b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.210189 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fd13d-5993-402b-ab9d-96cb259d9b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.210465 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fd13d-5993-402b-ab9d-96cb259d9b10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.211117 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fd13d-5993-402b-ab9d-96cb259d9b10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:52.211419 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fd13d-5993-402b-ab9d-96cb259d9b10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.213070 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fd13d-5993-402b-ab9d-96cb259d9b10 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.226525 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1375/2733] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:52.227572 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fd13d-5993-402b-ab9d-96cb259d9b10 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.230973 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1359/2734] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:52.231845 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71e572-d82f-4974-a176-d4def48c6d43 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.243038 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71e572-d82f-4974-a176-d4def48c6d43 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.244559 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fd13d-5993-402b-ab9d-96cb259d9b10 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.248181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d42c9-7514-4969-b202-a6b5df46def8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.248823 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d42c9-7514-4969-b202-a6b5df46def8 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.249058 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d42c9-7514-4969-b202-a6b5df46def8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.249327 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d42c9-7514-4969-b202-a6b5df46def8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.249428 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed32ba-dac4-47b1-8ecb-ad87b711a673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.249967 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d42c9-7514-4969-b202-a6b5df46def8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.250122 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed32ba-dac4-47b1-8ecb-ad87b711a673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.250294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed32ba-dac4-47b1-8ecb-ad87b711a673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.250569 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed32ba-dac4-47b1-8ecb-ad87b711a673 admin admin] PATH_INFO: `/v3/projects/078400773abf497eb32b8be0e38a7993/users/e3a951a1ce224c0897a21397eca4d7d1/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.251866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d42c9-7514-4969-b202-a6b5df46def8 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.265847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed32ba-dac4-47b1-8ecb-ad87b711a673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078400773abf497eb32b8be0e38a7993, user_id=e3a951a1ce224c0897a21397eca4d7d1, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.268418 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed32ba-dac4-47b1-8ecb-ad87b711a673 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.282862 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1360/2735] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:52 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:52.283967 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d42c9-7514-4969-b202-a6b5df46def8 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.285305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1376/2736] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:52 2022] PUT /identity/v3/projects/078400773abf497eb32b8be0e38a7993/users/e3a951a1ce224c0897a21397eca4d7d1/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:52.288471 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed32ba-dac4-47b1-8ecb-ad87b711a673 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.288625 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-dd2d42c9-7514-4969-b202-a6b5df46def8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:52.342539 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:52.354043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d42c9-7514-4969-b202-a6b5df46def8 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.358510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed32ba-dac4-47b1-8ecb-ad87b711a673 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.358760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e49878-82ac-43a9-9ac9-c40f59aef23d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.359372 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e49878-82ac-43a9-9ac9-c40f59aef23d service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.359656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e49878-82ac-43a9-9ac9-c40f59aef23d service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.360008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e49878-82ac-43a9-9ac9-c40f59aef23d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.361902 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-22e49878-82ac-43a9-9ac9-c40f59aef23d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:52.376394 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:52.416479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b220e-8d8e-4687-ad6a-7b91beb9a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.417075 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b220e-8d8e-4687-ad6a-7b91beb9a522 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.417357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b220e-8d8e-4687-ad6a-7b91beb9a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.417628 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b220e-8d8e-4687-ad6a-7b91beb9a522 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.418266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b220e-8d8e-4687-ad6a-7b91beb9a522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.420300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b220e-8d8e-4687-ad6a-7b91beb9a522 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.427003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e49878-82ac-43a9-9ac9-c40f59aef23d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.428456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e49878-82ac-43a9-9ac9-c40f59aef23d service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.437993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1361/2737] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:52.440554 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e49878-82ac-43a9-9ac9-c40f59aef23d service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.441754 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1377/2738] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:52 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:52.445677 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b220e-8d8e-4687-ad6a-7b91beb9a522 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.456056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e49878-82ac-43a9-9ac9-c40f59aef23d service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.457808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b220e-8d8e-4687-ad6a-7b91beb9a522 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.460792 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64696511-cd99-4eea-99bc-62caa5968fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.461405 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696511-cd99-4eea-99bc-62caa5968fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.461865 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696511-cd99-4eea-99bc-62caa5968fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.462150 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696511-cd99-4eea-99bc-62caa5968fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.462800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64696511-cd99-4eea-99bc-62caa5968fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.463297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f506f5-0def-49e4-b9a5-89ea90e6cb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.464106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f506f5-0def-49e4-b9a5-89ea90e6cb1a admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.464563 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f506f5-0def-49e4-b9a5-89ea90e6cb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.464731 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64696511-cd99-4eea-99bc-62caa5968fa6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.465169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f506f5-0def-49e4-b9a5-89ea90e6cb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.465997 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f506f5-0def-49e4-b9a5-89ea90e6cb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.468377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f506f5-0def-49e4-b9a5-89ea90e6cb1a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.477604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1362/2739] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:52.479279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1378/2740] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:52.481975 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64696511-cd99-4eea-99bc-62caa5968fa6 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.483920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f506f5-0def-49e4-b9a5-89ea90e6cb1a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.492187 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64696511-cd99-4eea-99bc-62caa5968fa6 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.494815 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f506f5-0def-49e4-b9a5-89ea90e6cb1a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.497209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e83d03-63f3-4114-8041-c81c0cf0c717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.498036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e83d03-63f3-4114-8041-c81c0cf0c717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.498334 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e83d03-63f3-4114-8041-c81c0cf0c717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.498543 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e83d03-63f3-4114-8041-c81c0cf0c717 admin admin] PATH_INFO: `/v3/projects/078400773abf497eb32b8be0e38a7993/users/e3a951a1ce224c0897a21397eca4d7d1/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.501441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e83d03-63f3-4114-8041-c81c0cf0c717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078400773abf497eb32b8be0e38a7993, user_id=e3a951a1ce224c0897a21397eca4d7d1, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.501574 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37725f-e35f-4dc9-b623-8dd33fd2ba50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.501798 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37725f-e35f-4dc9-b623-8dd33fd2ba50 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.502045 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37725f-e35f-4dc9-b623-8dd33fd2ba50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.502352 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37725f-e35f-4dc9-b623-8dd33fd2ba50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.503125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37725f-e35f-4dc9-b623-8dd33fd2ba50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.504414 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e83d03-63f3-4114-8041-c81c0cf0c717 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.504913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37725f-e35f-4dc9-b623-8dd33fd2ba50 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.517112 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1363/2741] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:52 2022] PUT /identity/v3/projects/078400773abf497eb32b8be0e38a7993/users/e3a951a1ce224c0897a21397eca4d7d1/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:52.522013 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1379/2742] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:52.528179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e83d03-63f3-4114-8041-c81c0cf0c717 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.528771 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d92b5-7f46-4f58-820e-30cf9e531530 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.529044 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d92b5-7f46-4f58-820e-30cf9e531530 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.530016 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d92b5-7f46-4f58-820e-30cf9e531530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.560242 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ee5d92b5-7f46-4f58-820e-30cf9e531530 None None] MFA Rules not processed for user `e3a951a1ce224c0897a21397eca4d7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:52.561511 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ee5d92b5-7f46-4f58-820e-30cf9e531530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:52.611427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e83d03-63f3-4114-8041-c81c0cf0c717 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.618458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbc5ca-ebe1-4017-a688-4d50dd1b7b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.619146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbc5ca-ebe1-4017-a688-4d50dd1b7b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.619468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbc5ca-ebe1-4017-a688-4d50dd1b7b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.619753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbc5ca-ebe1-4017-a688-4d50dd1b7b94 admin admin] PATH_INFO: `/v3/projects/0e8fb39b2d974065a7d8fc2605e0d430/users/4f83a556670a453082c26cc17243fdb2/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.638965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbc5ca-ebe1-4017-a688-4d50dd1b7b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8fb39b2d974065a7d8fc2605e0d430, user_id=4f83a556670a453082c26cc17243fdb2, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.642633 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbc5ca-ebe1-4017-a688-4d50dd1b7b94 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.655072 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1380/2743] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:52.659673 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1364/2744] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:52 2022] PUT /identity/v3/projects/0e8fb39b2d974065a7d8fc2605e0d430/users/4f83a556670a453082c26cc17243fdb2/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:52.666958 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d92b5-7f46-4f58-820e-30cf9e531530 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.668482 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ee5d92b5-7f46-4f58-820e-30cf9e531530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:52.670491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5dc6a-d679-4342-a8c3-fc897768037d None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.671005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5dc6a-d679-4342-a8c3-fc897768037d None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.671466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5dc6a-d679-4342-a8c3-fc897768037d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.708388 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-8cf5dc6a-d679-4342-a8c3-fc897768037d None None] MFA Rules not processed for user `4f83a556670a453082c26cc17243fdb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:52.709675 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8cf5dc6a-d679-4342-a8c3-fc897768037d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:52.745243 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:52.754939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d92b5-7f46-4f58-820e-30cf9e531530 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.825361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1365/2745] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:52.848836 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5dc6a-d679-4342-a8c3-fc897768037d None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.849914 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3477ca0-6cd5-4e5f-adc0-c4c22bf37a3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.851027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3477ca0-6cd5-4e5f-adc0-c4c22bf37a3b service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.851448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3477ca0-6cd5-4e5f-adc0-c4c22bf37a3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.851823 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3477ca0-6cd5-4e5f-adc0-c4c22bf37a3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.857621 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:52.868034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5dc6a-d679-4342-a8c3-fc897768037d None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.875989 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d2e7-0c90-4d74-bbb2-ca10d84d8bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.876632 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d2e7-0c90-4d74-bbb2-ca10d84d8bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.876921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d2e7-0c90-4d74-bbb2-ca10d84d8bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.877202 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d2e7-0c90-4d74-bbb2-ca10d84d8bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.887442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0d2e7-0c90-4d74-bbb2-ca10d84d8bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.889668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0d2e7-0c90-4d74-bbb2-ca10d84d8bb9 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.903692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1366/2746] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:52.947247 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3477ca0-6cd5-4e5f-adc0-c4c22bf37a3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.948941 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3477ca0-6cd5-4e5f-adc0-c4c22bf37a3b service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.966379 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1381/2747] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:54.036481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d2e7-0c90-4d74-bbb2-ca10d84d8bb9 service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:54.045999 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d2e7-0c90-4d74-bbb2-ca10d84d8bb9 service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:54.050011 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8c241-c48a-4312-998b-a38c1e7dcf6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:54.050626 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8c241-c48a-4312-998b-a38c1e7dcf6a service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:54.050927 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8c241-c48a-4312-998b-a38c1e7dcf6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:54.051204 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8c241-c48a-4312-998b-a38c1e7dcf6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:54.053086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-02e8c241-c48a-4312-998b-a38c1e7dcf6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:54.114644 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8c241-c48a-4312-998b-a38c1e7dcf6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:54.116118 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8c241-c48a-4312-998b-a38c1e7dcf6a service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:54.126869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1367/2748] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:54.548932 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3477ca0-6cd5-4e5f-adc0-c4c22bf37a3b service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:54.641087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3477ca0-6cd5-4e5f-adc0-c4c22bf37a3b service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:54.646528 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35a71b-12fe-400f-a1af-9bba74d32336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:54.647169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35a71b-12fe-400f-a1af-9bba74d32336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:54.647453 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35a71b-12fe-400f-a1af-9bba74d32336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:54.647750 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35a71b-12fe-400f-a1af-9bba74d32336 admin admin] PATH_INFO: `/v3/users/130be03d05ac4e549b1713db5904518f` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:54.649236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35a71b-12fe-400f-a1af-9bba74d32336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=130be03d05ac4e549b1713db5904518f)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:54.652113 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35a71b-12fe-400f-a1af-9bba74d32336 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:54.722017 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8a35a71b-12fe-400f-a1af-9bba74d32336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130be03d05ac4e549b1713db5904518f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:54.730187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8a35a71b-12fe-400f-a1af-9bba74d32336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130be03d05ac4e549b1713db5904518f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:54.735147 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:54.740168 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8a35a71b-12fe-400f-a1af-9bba74d32336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130be03d05ac4e549b1713db5904518f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:54.741061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8a35a71b-12fe-400f-a1af-9bba74d32336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130be03d05ac4e549b1713db5904518f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:54.757909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8a35a71b-12fe-400f-a1af-9bba74d32336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130be03d05ac4e549b1713db5904518f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:54.761230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8c241-c48a-4312-998b-a38c1e7dcf6a service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:54.765789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1382/2749] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:54 2022] DELETE /identity/v3/users/130be03d05ac4e549b1713db5904518f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:54.769938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a473d68-1407-4b95-9ffc-7a63f881f3b2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:54.770209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a473d68-1407-4b95-9ffc-7a63f881f3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:54.770489 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a473d68-1407-4b95-9ffc-7a63f881f3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:54.772183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8c241-c48a-4312-998b-a38c1e7dcf6a service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:54.791063 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9a473d68-1407-4b95-9ffc-7a63f881f3b2 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:54.792354 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9a473d68-1407-4b95-9ffc-7a63f881f3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:54.839986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f38b7-87a9-46b6-b7c8-f69b0eb855d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:54.840880 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f38b7-87a9-46b6-b7c8-f69b0eb855d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:54.841449 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f38b7-87a9-46b6-b7c8-f69b0eb855d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:54.842645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f38b7-87a9-46b6-b7c8-f69b0eb855d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:54.844037 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-927f38b7-87a9-46b6-b7c8-f69b0eb855d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:54.874922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1383/2750] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:54.887813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a473d68-1407-4b95-9ffc-7a63f881f3b2 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:54.897573 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9a473d68-1407-4b95-9ffc-7a63f881f3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:54.939886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f38b7-87a9-46b6-b7c8-f69b0eb855d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:54.941483 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f38b7-87a9-46b6-b7c8-f69b0eb855d6 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:54.954164 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1368/2751] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:54.985128 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a473d68-1407-4b95-9ffc-7a63f881f3b2 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:54.988947 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e867-7dbd-4101-b6e7-c2d07e4dd92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:54.989595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e867-7dbd-4101-b6e7-c2d07e4dd92d service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:54.989883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e867-7dbd-4101-b6e7-c2d07e4dd92d service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:54.990166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e867-7dbd-4101-b6e7-c2d07e4dd92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:55.001982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87e867-7dbd-4101-b6e7-c2d07e4dd92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:55.003586 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87e867-7dbd-4101-b6e7-c2d07e4dd92d service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:55.025121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1384/2752] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:55.321436 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f38b7-87a9-46b6-b7c8-f69b0eb855d6 service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:55.323033 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-927f38b7-87a9-46b6-b7c8-f69b0eb855d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:55.338837 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f38b7-87a9-46b6-b7c8-f69b0eb855d6 service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:55.344407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:55.345138 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:55.345395 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:55.345642 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] PATH_INFO: `/v3/projects/9b98ea2757be497e8fd746c3a2eb2e75` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:55.346944 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b98ea2757be497e8fd746c3a2eb2e75)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:55.348886 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:55.390415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:55.408657 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b98ea2757be497e8fd746c3a2eb2e75', 'request_id': 'req-94a8dbdb-f5b9-4f12-84e8-5016a6078547'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:55.415577 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b98ea2757be497e8fd746c3a2eb2e75', 'request_id': 'req-94a8dbdb-f5b9-4f12-84e8-5016a6078547'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:55.422130 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b98ea2757be497e8fd746c3a2eb2e75', 'request_id': 'req-94a8dbdb-f5b9-4f12-84e8-5016a6078547'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:55.436863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] The token cache is being invalidate because project 9b98ea2757be497e8fd746c3a2eb2e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:55.437146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:55.437779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:55.439274 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1369/2753] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:55 2022] DELETE /identity/v3/projects/9b98ea2757be497e8fd746c3a2eb2e75 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:55.443396 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e867-7dbd-4101-b6e7-c2d07e4dd92d service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:55.453590 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e867-7dbd-4101-b6e7-c2d07e4dd92d service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:55.515141 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fbb62-4eef-4a4c-86f0-1c1aa6145e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:55.515826 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fbb62-4eef-4a4c-86f0-1c1aa6145e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:55.516094 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fbb62-4eef-4a4c-86f0-1c1aa6145e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:55.516367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fbb62-4eef-4a4c-86f0-1c1aa6145e06 admin admin] PATH_INFO: `/v3/users/e3a951a1ce224c0897a21397eca4d7d1` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:55.517516 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fbb62-4eef-4a4c-86f0-1c1aa6145e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a951a1ce224c0897a21397eca4d7d1)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:55.519431 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fbb62-4eef-4a4c-86f0-1c1aa6145e06 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:55.541165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:55.565976 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-586fbb62-4eef-4a4c-86f0-1c1aa6145e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a951a1ce224c0897a21397eca4d7d1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:55.573188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-586fbb62-4eef-4a4c-86f0-1c1aa6145e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a951a1ce224c0897a21397eca4d7d1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:55.580179 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-586fbb62-4eef-4a4c-86f0-1c1aa6145e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a951a1ce224c0897a21397eca4d7d1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:55.580751 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-586fbb62-4eef-4a4c-86f0-1c1aa6145e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a951a1ce224c0897a21397eca4d7d1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:55.593464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-586fbb62-4eef-4a4c-86f0-1c1aa6145e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a951a1ce224c0897a21397eca4d7d1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:55.599822 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1385/2754] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:55 2022] DELETE /identity/v3/users/e3a951a1ce224c0897a21397eca4d7d1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:55.876796 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:55.878300 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:55.892084 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8dbdb-f5b9-4f12-84e8-5016a6078547 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:55.952787 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52946efa-de29-4b09-89cc-36e92be74e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:55.953413 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946efa-de29-4b09-89cc-36e92be74e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:55.953693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946efa-de29-4b09-89cc-36e92be74e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:55.953965 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946efa-de29-4b09-89cc-36e92be74e24 admin admin] PATH_INFO: `/v3/projects/078400773abf497eb32b8be0e38a7993` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:55.955072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52946efa-de29-4b09-89cc-36e92be74e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078400773abf497eb32b8be0e38a7993)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:55.956986 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52946efa-de29-4b09-89cc-36e92be74e24 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.004185 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-52946efa-de29-4b09-89cc-36e92be74e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078400773abf497eb32b8be0e38a7993', 'request_id': 'req-52946efa-de29-4b09-89cc-36e92be74e24'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.009960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-52946efa-de29-4b09-89cc-36e92be74e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078400773abf497eb32b8be0e38a7993', 'request_id': 'req-52946efa-de29-4b09-89cc-36e92be74e24'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.016284 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-52946efa-de29-4b09-89cc-36e92be74e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078400773abf497eb32b8be0e38a7993', 'request_id': 'req-52946efa-de29-4b09-89cc-36e92be74e24'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.029974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-52946efa-de29-4b09-89cc-36e92be74e24 admin admin] The token cache is being invalidate because project 078400773abf497eb32b8be0e38a7993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:56.030261 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-52946efa-de29-4b09-89cc-36e92be74e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.030894 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-52946efa-de29-4b09-89cc-36e92be74e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.032423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1370/2755] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:55 2022] DELETE /identity/v3/projects/078400773abf497eb32b8be0e38a7993 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:56.037495 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65b36b-a3f3-4877-a5e1-2d985947638d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.037781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65b36b-a3f3-4877-a5e1-2d985947638d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.038055 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65b36b-a3f3-4877-a5e1-2d985947638d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.058160 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0f65b36b-a3f3-4877-a5e1-2d985947638d None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:56.059356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0f65b36b-a3f3-4877-a5e1-2d985947638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.123115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1386/2756] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:56.131003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf5ba-5789-408a-b6f2-d2b2f5147d4b None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.131293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf5ba-5789-408a-b6f2-d2b2f5147d4b None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.131571 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf5ba-5789-408a-b6f2-d2b2f5147d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.152774 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-adadf5ba-5789-408a-b6f2-d2b2f5147d4b None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:56.154668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-adadf5ba-5789-408a-b6f2-d2b2f5147d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.162937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1371/2757] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:56.167439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65b36b-a3f3-4877-a5e1-2d985947638d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.177955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65b36b-a3f3-4877-a5e1-2d985947638d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.182965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0443cb8-fa3e-4f7a-acf2-ee69e94d9133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.183575 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0443cb8-fa3e-4f7a-acf2-ee69e94d9133 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.183893 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0443cb8-fa3e-4f7a-acf2-ee69e94d9133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.184182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0443cb8-fa3e-4f7a-acf2-ee69e94d9133 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.184832 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0443cb8-fa3e-4f7a-acf2-ee69e94d9133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:56.185684 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0443cb8-fa3e-4f7a-acf2-ee69e94d9133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.186769 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0443cb8-fa3e-4f7a-acf2-ee69e94d9133 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.203711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1387/2758] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:56.208191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadf5ba-5789-408a-b6f2-d2b2f5147d4b None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.215564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0443cb8-fa3e-4f7a-acf2-ee69e94d9133 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.218159 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f0443cb8-fa3e-4f7a-acf2-ee69e94d9133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.221005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadf5ba-5789-408a-b6f2-d2b2f5147d4b None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.225773 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8c388-48cd-469e-8b75-663be6d40074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.226448 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8c388-48cd-469e-8b75-663be6d40074 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.226800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8c388-48cd-469e-8b75-663be6d40074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.227304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8c388-48cd-469e-8b75-663be6d40074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.227996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8c388-48cd-469e-8b75-663be6d40074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.229962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8c388-48cd-469e-8b75-663be6d40074 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.233155 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0443cb8-fa3e-4f7a-acf2-ee69e94d9133 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.238043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b13e1c-8df5-4548-b5cc-d6b7cdbaa8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.238679 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b13e1c-8df5-4548-b5cc-d6b7cdbaa8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.238960 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b13e1c-8df5-4548-b5cc-d6b7cdbaa8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.239239 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b13e1c-8df5-4548-b5cc-d6b7cdbaa8ea admin admin] PATH_INFO: `/v3/users/4f83a556670a453082c26cc17243fdb2` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.240570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b13e1c-8df5-4548-b5cc-d6b7cdbaa8ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f83a556670a453082c26cc17243fdb2)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.242498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b13e1c-8df5-4548-b5cc-d6b7cdbaa8ea admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.264386 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1372/2759] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:56 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:56.268516 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8c388-48cd-469e-8b75-663be6d40074 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.303416 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c4b13e1c-8df5-4548-b5cc-d6b7cdbaa8ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f83a556670a453082c26cc17243fdb2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.303957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:56.312692 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c4b13e1c-8df5-4548-b5cc-d6b7cdbaa8ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f83a556670a453082c26cc17243fdb2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.321678 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c4b13e1c-8df5-4548-b5cc-d6b7cdbaa8ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f83a556670a453082c26cc17243fdb2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.322530 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c4b13e1c-8df5-4548-b5cc-d6b7cdbaa8ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f83a556670a453082c26cc17243fdb2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.336423 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:56.337791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c4b13e1c-8df5-4548-b5cc-d6b7cdbaa8ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f83a556670a453082c26cc17243fdb2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.349429 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8c388-48cd-469e-8b75-663be6d40074 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.360893 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839fa53-6946-45ba-9807-a4c617c7f746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.362604 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839fa53-6946-45ba-9807-a4c617c7f746 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.363026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839fa53-6946-45ba-9807-a4c617c7f746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.363357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839fa53-6946-45ba-9807-a4c617c7f746 admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.363816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1388/2760] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:56 2022] DELETE /identity/v3/users/4f83a556670a453082c26cc17243fdb2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:56.364145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839fa53-6946-45ba-9807-a4c617c7f746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.365699 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d598b-678a-45d5-92f2-e1760972c813 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.366058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d598b-678a-45d5-92f2-e1760972c813 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.366424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839fa53-6946-45ba-9807-a4c617c7f746 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.366552 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d598b-678a-45d5-92f2-e1760972c813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.393091 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1c5d598b-678a-45d5-92f2-e1760972c813 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:56.394734 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1c5d598b-678a-45d5-92f2-e1760972c813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.395375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1373/2761] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:56 2022] POST /identity/v3/users => generated 285 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:56.399051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839fa53-6946-45ba-9807-a4c617c7f746 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.402453 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4839fa53-6946-45ba-9807-a4c617c7f746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.422178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839fa53-6946-45ba-9807-a4c617c7f746 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.476151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1389/2762] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:56.487318 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d598b-678a-45d5-92f2-e1760972c813 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.487554 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54caea-e0c7-4100-9ca4-ba678cd6421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.487991 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54caea-e0c7-4100-9ca4-ba678cd6421f admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.488282 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54caea-e0c7-4100-9ca4-ba678cd6421f admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.488560 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54caea-e0c7-4100-9ca4-ba678cd6421f admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.489268 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54caea-e0c7-4100-9ca4-ba678cd6421f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.489395 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1c5d598b-678a-45d5-92f2-e1760972c813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.491341 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54caea-e0c7-4100-9ca4-ba678cd6421f admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.503818 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1374/2763] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:56.506146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54caea-e0c7-4100-9ca4-ba678cd6421f admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.516162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54caea-e0c7-4100-9ca4-ba678cd6421f admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.522056 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a5dd5-87ab-47ed-b3e8-965cf634568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.522645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a5dd5-87ab-47ed-b3e8-965cf634568b admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.522929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a5dd5-87ab-47ed-b3e8-965cf634568b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.523198 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a5dd5-87ab-47ed-b3e8-965cf634568b admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.523869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a5dd5-87ab-47ed-b3e8-965cf634568b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.525465 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a5dd5-87ab-47ed-b3e8-965cf634568b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.537527 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1375/2764] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:56.541532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a5dd5-87ab-47ed-b3e8-965cf634568b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.549739 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d598b-678a-45d5-92f2-e1760972c813 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.551639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a5dd5-87ab-47ed-b3e8-965cf634568b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.553579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba465cb5-2428-40fb-ac13-11fe0611ad61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.554249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba465cb5-2428-40fb-ac13-11fe0611ad61 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.554589 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba465cb5-2428-40fb-ac13-11fe0611ad61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.554929 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba465cb5-2428-40fb-ac13-11fe0611ad61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.556310 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6908d6-e816-4d8a-ac2c-6c5b0cb28572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.556950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6908d6-e816-4d8a-ac2c-6c5b0cb28572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.557237 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6908d6-e816-4d8a-ac2c-6c5b0cb28572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.557514 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6908d6-e816-4d8a-ac2c-6c5b0cb28572 admin admin] PATH_INFO: `/v3/projects/34106fbdc93e4717ab55064910f8b20b/users/0bfea052d1a0425badf10bf723459bc8/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.564969 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba465cb5-2428-40fb-ac13-11fe0611ad61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.566479 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba465cb5-2428-40fb-ac13-11fe0611ad61 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.576682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6908d6-e816-4d8a-ac2c-6c5b0cb28572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34106fbdc93e4717ab55064910f8b20b, user_id=0bfea052d1a0425badf10bf723459bc8, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.579971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6908d6-e816-4d8a-ac2c-6c5b0cb28572 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.586979 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1390/2765] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:56.598573 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1376/2766] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:56 2022] PUT /identity/v3/projects/34106fbdc93e4717ab55064910f8b20b/users/0bfea052d1a0425badf10bf723459bc8/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:56.610185 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b575b-eec9-4ede-b56a-f90de3c96715 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.610482 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b575b-eec9-4ede-b56a-f90de3c96715 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.610753 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b575b-eec9-4ede-b56a-f90de3c96715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.645155 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-439b575b-eec9-4ede-b56a-f90de3c96715 None None] MFA Rules not processed for user `0bfea052d1a0425badf10bf723459bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:56.646827 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-439b575b-eec9-4ede-b56a-f90de3c96715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.734375 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1391/2767] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:56.738689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6908d6-e816-4d8a-ac2c-6c5b0cb28572 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.819286 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6908d6-e816-4d8a-ac2c-6c5b0cb28572 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.824124 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48959-5e7a-4141-8d84-8753cc752771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.824732 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48959-5e7a-4141-8d84-8753cc752771 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.825018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48959-5e7a-4141-8d84-8753cc752771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.825290 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48959-5e7a-4141-8d84-8753cc752771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.825957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e48959-5e7a-4141-8d84-8753cc752771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.827869 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e48959-5e7a-4141-8d84-8753cc752771 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.852771 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:56.862072 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1377/2768] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:56 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:56.865939 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b575b-eec9-4ede-b56a-f90de3c96715 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.878250 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b575b-eec9-4ede-b56a-f90de3c96715 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.907703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:56.941753 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de62eb-fdc8-48f5-b1d3-b8048b02ab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.942382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de62eb-fdc8-48f5-b1d3-b8048b02ab12 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.942737 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de62eb-fdc8-48f5-b1d3-b8048b02ab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.943106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de62eb-fdc8-48f5-b1d3-b8048b02ab12 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.943859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de62eb-fdc8-48f5-b1d3-b8048b02ab12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.945938 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de62eb-fdc8-48f5-b1d3-b8048b02ab12 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.973795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1392/2769] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:56 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:56.976937 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48959-5e7a-4141-8d84-8753cc752771 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.977362 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de62eb-fdc8-48f5-b1d3-b8048b02ab12 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.979103 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-99de62eb-fdc8-48f5-b1d3-b8048b02ab12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.988269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48959-5e7a-4141-8d84-8753cc752771 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.993392 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272fc42-fa18-4953-9d8a-6e66422c59a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.994145 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272fc42-fa18-4953-9d8a-6e66422c59a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.994284 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de62eb-fdc8-48f5-b1d3-b8048b02ab12 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.994391 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272fc42-fa18-4953-9d8a-6e66422c59a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.994624 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272fc42-fa18-4953-9d8a-6e66422c59a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.995456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272fc42-fa18-4953-9d8a-6e66422c59a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.997147 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272fc42-fa18-4953-9d8a-6e66422c59a5 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.000924 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51a359-c3ad-44d0-8174-b7165066344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.001636 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51a359-c3ad-44d0-8174-b7165066344b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.001983 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51a359-c3ad-44d0-8174-b7165066344b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.002334 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51a359-c3ad-44d0-8174-b7165066344b admin admin] PATH_INFO: `/v3/projects/0e8fb39b2d974065a7d8fc2605e0d430` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.003816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51a359-c3ad-44d0-8174-b7165066344b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8fb39b2d974065a7d8fc2605e0d430)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.005921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51a359-c3ad-44d0-8174-b7165066344b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.010175 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1378/2770] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:57.015388 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272fc42-fa18-4953-9d8a-6e66422c59a5 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.027122 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272fc42-fa18-4953-9d8a-6e66422c59a5 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.032222 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d3f6d-d03a-45c6-906e-9f7e4ae9d807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.032878 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d3f6d-d03a-45c6-906e-9f7e4ae9d807 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.033166 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d3f6d-d03a-45c6-906e-9f7e4ae9d807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.033451 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d3f6d-d03a-45c6-906e-9f7e4ae9d807 admin admin] PATH_INFO: `/v3/projects/4d85f393906c4186a51077c745b58cb5/users/c24f9cf34fca43ed8d4a8e2ea2786e1b/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.051660 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d3f6d-d03a-45c6-906e-9f7e4ae9d807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d85f393906c4186a51077c745b58cb5, user_id=c24f9cf34fca43ed8d4a8e2ea2786e1b, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.054354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d3f6d-d03a-45c6-906e-9f7e4ae9d807 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.058442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7e51a359-c3ad-44d0-8174-b7165066344b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8fb39b2d974065a7d8fc2605e0d430', 'request_id': 'req-7e51a359-c3ad-44d0-8174-b7165066344b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:57.066485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7e51a359-c3ad-44d0-8174-b7165066344b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8fb39b2d974065a7d8fc2605e0d430', 'request_id': 'req-7e51a359-c3ad-44d0-8174-b7165066344b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:57.068415 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1379/2771] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:57 2022] PUT /identity/v3/projects/4d85f393906c4186a51077c745b58cb5/users/c24f9cf34fca43ed8d4a8e2ea2786e1b/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:57.072193 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d3f6d-d03a-45c6-906e-9f7e4ae9d807 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.076948 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7e51a359-c3ad-44d0-8174-b7165066344b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8fb39b2d974065a7d8fc2605e0d430', 'request_id': 'req-7e51a359-c3ad-44d0-8174-b7165066344b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:57.092297 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7e51a359-c3ad-44d0-8174-b7165066344b admin admin] The token cache is being invalidate because project 0e8fb39b2d974065a7d8fc2605e0d430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:57.092625 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7e51a359-c3ad-44d0-8174-b7165066344b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:57.093492 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7e51a359-c3ad-44d0-8174-b7165066344b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:57.095261 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1393/2772] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:56 2022] DELETE /identity/v3/projects/0e8fb39b2d974065a7d8fc2605e0d430 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:57.101770 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d1607-bbc1-4106-8313-682ad2a1da73 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.102345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d1607-bbc1-4106-8313-682ad2a1da73 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.102876 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d1607-bbc1-4106-8313-682ad2a1da73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.127212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-236d1607-bbc1-4106-8313-682ad2a1da73 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:57.128849 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-236d1607-bbc1-4106-8313-682ad2a1da73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:57.148521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d3f6d-d03a-45c6-906e-9f7e4ae9d807 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.156241 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f225f-e2d9-4fb2-9d6f-902036e2c1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.157139 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f225f-e2d9-4fb2-9d6f-902036e2c1ba admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.157611 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f225f-e2d9-4fb2-9d6f-902036e2c1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.158009 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f225f-e2d9-4fb2-9d6f-902036e2c1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.159084 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f225f-e2d9-4fb2-9d6f-902036e2c1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.161978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f225f-e2d9-4fb2-9d6f-902036e2c1ba admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.182316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1380/2773] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:57.187326 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f225f-e2d9-4fb2-9d6f-902036e2c1ba admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.189234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b76f225f-e2d9-4fb2-9d6f-902036e2c1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:57.203000 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f225f-e2d9-4fb2-9d6f-902036e2c1ba admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.208293 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d963392-a0e8-451b-919a-3dcca090b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.208961 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d963392-a0e8-451b-919a-3dcca090b375 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.209243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d963392-a0e8-451b-919a-3dcca090b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.209525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d963392-a0e8-451b-919a-3dcca090b375 admin admin] PATH_INFO: `/v3/projects/4d85f393906c4186a51077c745b58cb5/users/c24f9cf34fca43ed8d4a8e2ea2786e1b/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.211533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d963392-a0e8-451b-919a-3dcca090b375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d85f393906c4186a51077c745b58cb5, user_id=c24f9cf34fca43ed8d4a8e2ea2786e1b, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.214427 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d963392-a0e8-451b-919a-3dcca090b375 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.218154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1394/2774] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:57.225662 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd22f20-ba6d-4aca-af2a-42ee858643cf None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.225889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1381/2775] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:57 2022] PUT /identity/v3/projects/4d85f393906c4186a51077c745b58cb5/users/c24f9cf34fca43ed8d4a8e2ea2786e1b/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:57.226066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd22f20-ba6d-4aca-af2a-42ee858643cf None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.231267 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd22f20-ba6d-4aca-af2a-42ee858643cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.236662 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceadd62-f400-431b-bba2-d64e299c4dd1 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.236924 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceadd62-f400-431b-bba2-d64e299c4dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.237206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceadd62-f400-431b-bba2-d64e299c4dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.255087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-acd22f20-ba6d-4aca-af2a-42ee858643cf None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:57.256802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-acd22f20-ba6d-4aca-af2a-42ee858643cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:57.270182 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-7ceadd62-f400-431b-bba2-d64e299c4dd1 None None] MFA Rules not processed for user `c24f9cf34fca43ed8d4a8e2ea2786e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:57.271411 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7ceadd62-f400-431b-bba2-d64e299c4dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:57.302802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:57.328330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1395/2776] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:57.334638 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd22f20-ba6d-4aca-af2a-42ee858643cf None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.346632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd22f20-ba6d-4aca-af2a-42ee858643cf None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.351554 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e9446-d674-4378-a66c-1209d1a49c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.352191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e9446-d674-4378-a66c-1209d1a49c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.352478 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e9446-d674-4378-a66c-1209d1a49c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.352752 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e9446-d674-4378-a66c-1209d1a49c00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.353340 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1382/2777] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:57.354266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e9446-d674-4378-a66c-1209d1a49c00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:57.354266 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e9446-d674-4378-a66c-1209d1a49c00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.355327 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e9446-d674-4378-a66c-1209d1a49c00 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.367976 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceadd62-f400-431b-bba2-d64e299c4dd1 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.369384 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1396/2778] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:57.369594 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7ceadd62-f400-431b-bba2-d64e299c4dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:57.373648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e9446-d674-4378-a66c-1209d1a49c00 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.383612 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e9446-d674-4378-a66c-1209d1a49c00 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.388327 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc3c82-0c4c-4e52-a971-1b5e6a99487e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.388945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc3c82-0c4c-4e52-a971-1b5e6a99487e admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.389236 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc3c82-0c4c-4e52-a971-1b5e6a99487e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.389500 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc3c82-0c4c-4e52-a971-1b5e6a99487e admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.390121 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc3c82-0c4c-4e52-a971-1b5e6a99487e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.394923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc3c82-0c4c-4e52-a971-1b5e6a99487e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.425035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:57.431188 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1397/2779] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:57 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:57.435112 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc3c82-0c4c-4e52-a971-1b5e6a99487e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.455915 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceadd62-f400-431b-bba2-d64e299c4dd1 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.512307 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe455b1-3fb0-42a8-ae12-d0b6992e1109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.513565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe455b1-3fb0-42a8-ae12-d0b6992e1109 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.513950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe455b1-3fb0-42a8-ae12-d0b6992e1109 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.514316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe455b1-3fb0-42a8-ae12-d0b6992e1109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.525512 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc3c82-0c4c-4e52-a971-1b5e6a99487e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.527314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cec18-8dd4-403d-b88b-a16eea7d7ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.528242 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cec18-8dd4-403d-b88b-a16eea7d7ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.529867 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cec18-8dd4-403d-b88b-a16eea7d7ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.530149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cec18-8dd4-403d-b88b-a16eea7d7ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.531556 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cec18-8dd4-403d-b88b-a16eea7d7ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.533631 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cec18-8dd4-403d-b88b-a16eea7d7ed6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.571768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1398/2780] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:57 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:57.575778 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cec18-8dd4-403d-b88b-a16eea7d7ed6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.585844 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cec18-8dd4-403d-b88b-a16eea7d7ed6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.592200 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483dfa6-007f-4b4f-b536-7ecfe3446e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.592877 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483dfa6-007f-4b4f-b536-7ecfe3446e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.593303 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483dfa6-007f-4b4f-b536-7ecfe3446e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.593578 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483dfa6-007f-4b4f-b536-7ecfe3446e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.594270 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483dfa6-007f-4b4f-b536-7ecfe3446e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.596039 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483dfa6-007f-4b4f-b536-7ecfe3446e71 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.608224 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe455b1-3fb0-42a8-ae12-d0b6992e1109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.608382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1399/2781] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:57.612101 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483dfa6-007f-4b4f-b536-7ecfe3446e71 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.612276 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe455b1-3fb0-42a8-ae12-d0b6992e1109 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.623104 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1383/2782] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:57.624842 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483dfa6-007f-4b4f-b536-7ecfe3446e71 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.630218 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ad67c-0359-4ed8-84e5-cd236298df1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.631000 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ad67c-0359-4ed8-84e5-cd236298df1f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.631502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ad67c-0359-4ed8-84e5-cd236298df1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.632168 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ad67c-0359-4ed8-84e5-cd236298df1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.632964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ad67c-0359-4ed8-84e5-cd236298df1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.634700 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ad67c-0359-4ed8-84e5-cd236298df1f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.647108 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1400/2783] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:57.651318 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe455b1-3fb0-42a8-ae12-d0b6992e1109 service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.667656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe455b1-3fb0-42a8-ae12-d0b6992e1109 service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.673755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ad67c-0359-4ed8-84e5-cd236298df1f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.676253 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992e406-cb68-42f9-896a-a39322532b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.676870 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e406-cb68-42f9-896a-a39322532b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.677183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e406-cb68-42f9-896a-a39322532b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.677461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e406-cb68-42f9-896a-a39322532b2d admin admin] PATH_INFO: `/v3/projects/e10ded12d8ee42f39527294ac2ba7f06/users/5fb4f6ad5234452db14a47ef424d08fe/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.686464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ad67c-0359-4ed8-84e5-cd236298df1f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.690964 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae446633-c49a-494c-ad59-981986e8cc5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.691742 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae446633-c49a-494c-ad59-981986e8cc5e service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.692364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae446633-c49a-494c-ad59-981986e8cc5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.692644 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae446633-c49a-494c-ad59-981986e8cc5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.694793 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ae446633-c49a-494c-ad59-981986e8cc5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:57.694921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992e406-cb68-42f9-896a-a39322532b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10ded12d8ee42f39527294ac2ba7f06, user_id=5fb4f6ad5234452db14a47ef424d08fe, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.697677 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992e406-cb68-42f9-896a-a39322532b2d admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.713276 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1384/2784] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:57 2022] PUT /identity/v3/projects/e10ded12d8ee42f39527294ac2ba7f06/users/5fb4f6ad5234452db14a47ef424d08fe/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:57.770405 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae446633-c49a-494c-ad59-981986e8cc5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.772002 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae446633-c49a-494c-ad59-981986e8cc5e service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.782681 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1401/2785] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:57.785639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818a76d-57f6-4498-a0d1-8ff2474053a5 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.785931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818a76d-57f6-4498-a0d1-8ff2474053a5 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.786209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818a76d-57f6-4498-a0d1-8ff2474053a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.821165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-d818a76d-57f6-4498-a0d1-8ff2474053a5 None None] MFA Rules not processed for user `5fb4f6ad5234452db14a47ef424d08fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:57.822482 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-d818a76d-57f6-4498-a0d1-8ff2474053a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:57.924796 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1385/2786] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:57.929620 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae446633-c49a-494c-ad59-981986e8cc5e service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.942209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae446633-c49a-494c-ad59-981986e8cc5e service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.953162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:58.018343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab4eb7-d2be-4e31-8918-02984cef0222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.019370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab4eb7-d2be-4e31-8918-02984cef0222 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.019526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab4eb7-d2be-4e31-8918-02984cef0222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.019965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab4eb7-d2be-4e31-8918-02984cef0222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.020604 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab4eb7-d2be-4e31-8918-02984cef0222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.023144 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab4eb7-d2be-4e31-8918-02984cef0222 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.061551 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1402/2787] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:57 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:58.065748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818a76d-57f6-4498-a0d1-8ff2474053a5 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.074195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:58.090990 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818a76d-57f6-4498-a0d1-8ff2474053a5 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.207177 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637c17a-c5ea-48cf-9f95-9efd39f910cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.208110 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637c17a-c5ea-48cf-9f95-9efd39f910cd admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.208556 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637c17a-c5ea-48cf-9f95-9efd39f910cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.209026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637c17a-c5ea-48cf-9f95-9efd39f910cd admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.209760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637c17a-c5ea-48cf-9f95-9efd39f910cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.211593 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637c17a-c5ea-48cf-9f95-9efd39f910cd admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.233281 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1386/2788] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:58 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:58.237215 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab4eb7-d2be-4e31-8918-02984cef0222 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.247382 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab4eb7-d2be-4e31-8918-02984cef0222 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.252488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d38b5-c0b8-4e81-890a-21dfd8640fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.253079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d38b5-c0b8-4e81-890a-21dfd8640fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.253354 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d38b5-c0b8-4e81-890a-21dfd8640fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.253622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d38b5-c0b8-4e81-890a-21dfd8640fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.254259 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d38b5-c0b8-4e81-890a-21dfd8640fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.255874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d38b5-c0b8-4e81-890a-21dfd8640fc7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.266723 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1403/2789] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:58.271052 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637c17a-c5ea-48cf-9f95-9efd39f910cd admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.281219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637c17a-c5ea-48cf-9f95-9efd39f910cd admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.286022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892f20f-1ebd-4f5e-bc9d-6b7cab9d5381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.286617 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892f20f-1ebd-4f5e-bc9d-6b7cab9d5381 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.286903 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892f20f-1ebd-4f5e-bc9d-6b7cab9d5381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.287179 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892f20f-1ebd-4f5e-bc9d-6b7cab9d5381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.287875 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892f20f-1ebd-4f5e-bc9d-6b7cab9d5381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.289466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892f20f-1ebd-4f5e-bc9d-6b7cab9d5381 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.300006 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1387/2790] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:58.304279 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d38b5-c0b8-4e81-890a-21dfd8640fc7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.314744 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d38b5-c0b8-4e81-890a-21dfd8640fc7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.319895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fd9d0-fa76-4b6c-bc32-f353249898a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.320534 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fd9d0-fa76-4b6c-bc32-f353249898a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.320812 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fd9d0-fa76-4b6c-bc32-f353249898a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.321084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fd9d0-fa76-4b6c-bc32-f353249898a4 admin admin] PATH_INFO: `/v3/projects/27d476f50aaf43bba9b3b140332764b5/users/28938816d83d42c88e779f31e168757e/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.336722 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fd9d0-fa76-4b6c-bc32-f353249898a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d476f50aaf43bba9b3b140332764b5, user_id=28938816d83d42c88e779f31e168757e, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.339336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fd9d0-fa76-4b6c-bc32-f353249898a4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.352703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1404/2791] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:58 2022] PUT /identity/v3/projects/27d476f50aaf43bba9b3b140332764b5/users/28938816d83d42c88e779f31e168757e/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:58.363105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a892965-5b29-490d-9d60-585852a779b6 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.363596 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a892965-5b29-490d-9d60-585852a779b6 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.363698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a892965-5b29-490d-9d60-585852a779b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.392029 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-3a892965-5b29-490d-9d60-585852a779b6 None None] MFA Rules not processed for user `28938816d83d42c88e779f31e168757e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:58.393236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-3a892965-5b29-490d-9d60-585852a779b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:58.458405 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1388/2792] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:58.462887 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fd9d0-fa76-4b6c-bc32-f353249898a4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.525003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fd9d0-fa76-4b6c-bc32-f353249898a4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.529706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216d010-b57c-4732-a4b5-5b60e4a49415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.530310 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216d010-b57c-4732-a4b5-5b60e4a49415 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.530640 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216d010-b57c-4732-a4b5-5b60e4a49415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.530917 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216d010-b57c-4732-a4b5-5b60e4a49415 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.531643 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216d010-b57c-4732-a4b5-5b60e4a49415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.533668 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216d010-b57c-4732-a4b5-5b60e4a49415 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.562635 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1405/2793] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:58 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:58.566707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a892965-5b29-490d-9d60-585852a779b6 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.578312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a892965-5b29-490d-9d60-585852a779b6 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.640932 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478854f-e846-4e33-8307-984ba1a6a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.641539 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478854f-e846-4e33-8307-984ba1a6a58b admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.641823 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478854f-e846-4e33-8307-984ba1a6a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.642097 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478854f-e846-4e33-8307-984ba1a6a58b admin admin] PATH_INFO: `/v3/users` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.642719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478854f-e846-4e33-8307-984ba1a6a58b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.644663 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478854f-e846-4e33-8307-984ba1a6a58b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.665413 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1389/2794] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:58 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:58.670024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216d010-b57c-4732-a4b5-5b60e4a49415 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.680688 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216d010-b57c-4732-a4b5-5b60e4a49415 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.686090 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37540900-580f-4906-9f6d-5193a9bb9d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.686689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37540900-580f-4906-9f6d-5193a9bb9d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.686974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37540900-580f-4906-9f6d-5193a9bb9d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.687249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37540900-580f-4906-9f6d-5193a9bb9d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.687921 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37540900-580f-4906-9f6d-5193a9bb9d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.689519 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37540900-580f-4906-9f6d-5193a9bb9d3a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.700314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1406/2795] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:58.705361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478854f-e846-4e33-8307-984ba1a6a58b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.710630 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:58.716825 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478854f-e846-4e33-8307-984ba1a6a58b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.723079 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6d7bb-082e-401e-9d2f-86b781f00c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.723960 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6d7bb-082e-401e-9d2f-86b781f00c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.724351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6d7bb-082e-401e-9d2f-86b781f00c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.724733 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6d7bb-082e-401e-9d2f-86b781f00c3a admin admin] PATH_INFO: `/v3/projects/e548334041294cd880ac1ab59a42ec2b/users/1e580e6b644e4249bf3ebff95447c256/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.743003 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6d7bb-082e-401e-9d2f-86b781f00c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e548334041294cd880ac1ab59a42ec2b, user_id=1e580e6b644e4249bf3ebff95447c256, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.745670 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6d7bb-082e-401e-9d2f-86b781f00c3a admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.761158 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1390/2796] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:58 2022] PUT /identity/v3/projects/e548334041294cd880ac1ab59a42ec2b/users/1e580e6b644e4249bf3ebff95447c256/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:58.765869 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37540900-580f-4906-9f6d-5193a9bb9d3a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.777393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37540900-580f-4906-9f6d-5193a9bb9d3a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.812135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:58.836041 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3fbad-0798-48bc-a5cd-d3612077f9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.836663 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3fbad-0798-48bc-a5cd-d3612077f9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.836936 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3fbad-0798-48bc-a5cd-d3612077f9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.837221 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3fbad-0798-48bc-a5cd-d3612077f9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.837859 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3fbad-0798-48bc-a5cd-d3612077f9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.839996 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3fbad-0798-48bc-a5cd-d3612077f9d7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.849976 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1407/2797] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:58.854083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6d7bb-082e-401e-9d2f-86b781f00c3a admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.865083 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6d7bb-082e-401e-9d2f-86b781f00c3a admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.869789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e9986-0633-42e0-8e72-c18fff70d7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.870437 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e9986-0633-42e0-8e72-c18fff70d7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.870750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e9986-0633-42e0-8e72-c18fff70d7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.871025 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e9986-0633-42e0-8e72-c18fff70d7ce admin admin] PATH_INFO: `/v3/projects/e548334041294cd880ac1ab59a42ec2b/users/1e580e6b644e4249bf3ebff95447c256/roles/a0a09ee010c441c88c25f7a1b6cac40c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.872997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e9986-0633-42e0-8e72-c18fff70d7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e548334041294cd880ac1ab59a42ec2b, user_id=1e580e6b644e4249bf3ebff95447c256, role_id=a0a09ee010c441c88c25f7a1b6cac40c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.875689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e9986-0633-42e0-8e72-c18fff70d7ce admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.886223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1391/2798] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:58 2022] PUT /identity/v3/projects/e548334041294cd880ac1ab59a42ec2b/users/1e580e6b644e4249bf3ebff95447c256/roles/a0a09ee010c441c88c25f7a1b6cac40c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:58.902118 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f194b-3914-40a1-a527-a103ddabdbee None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.902738 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f194b-3914-40a1-a527-a103ddabdbee None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.902895 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f194b-3914-40a1-a527-a103ddabdbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.933688 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-606f194b-3914-40a1-a527-a103ddabdbee None None] MFA Rules not processed for user `1e580e6b644e4249bf3ebff95447c256`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:58.935043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-606f194b-3914-40a1-a527-a103ddabdbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:58.953707 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e9986-0633-42e0-8e72-c18fff70d7ce admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.955129 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-7e5e9986-0633-42e0-8e72-c18fff70d7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:59.005149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1408/2799] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:59.017285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f194b-3914-40a1-a527-a103ddabdbee None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:59.018777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-606f194b-3914-40a1-a527-a103ddabdbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:59.022346 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e9986-0633-42e0-8e72-c18fff70d7ce admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:59.027537 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20952b-dc1f-44bb-b41f-6b84c6082afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:59.028196 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20952b-dc1f-44bb-b41f-6b84c6082afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:59.028488 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20952b-dc1f-44bb-b41f-6b84c6082afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:59.028796 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20952b-dc1f-44bb-b41f-6b84c6082afa admin admin] PATH_INFO: `/v3/users/6826e41c230c46028e024799ca66237d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:59.030742 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20952b-dc1f-44bb-b41f-6b84c6082afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6826e41c230c46028e024799ca66237d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:59.033666 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20952b-dc1f-44bb-b41f-6b84c6082afa admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:59.084458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f194b-3914-40a1-a527-a103ddabdbee None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:59.087521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0b20952b-dc1f-44bb-b41f-6b84c6082afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6826e41c230c46028e024799ca66237d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.088368 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38264-f38b-4035-90f2-9dbfb95f7d15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:59.089026 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38264-f38b-4035-90f2-9dbfb95f7d15 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:59.089370 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38264-f38b-4035-90f2-9dbfb95f7d15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:59.089775 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38264-f38b-4035-90f2-9dbfb95f7d15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:59.095798 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0b20952b-dc1f-44bb-b41f-6b84c6082afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6826e41c230c46028e024799ca66237d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.096446 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0b20952b-dc1f-44bb-b41f-6b84c6082afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6826e41c230c46028e024799ca66237d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.097104 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0b20952b-dc1f-44bb-b41f-6b84c6082afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6826e41c230c46028e024799ca66237d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.110272 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0b20952b-dc1f-44bb-b41f-6b84c6082afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6826e41c230c46028e024799ca66237d'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.123219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1392/2800] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:58 2022] DELETE /identity/v3/users/6826e41c230c46028e024799ca66237d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:59.127993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7af9d0-379b-4fdf-b14c-5bef8835d215 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:59.128283 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7af9d0-379b-4fdf-b14c-5bef8835d215 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:59.128560 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7af9d0-379b-4fdf-b14c-5bef8835d215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:59.149221 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-fe7af9d0-379b-4fdf-b14c-5bef8835d215 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:59.149890 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf38264-f38b-4035-90f2-9dbfb95f7d15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:59.150482 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-fe7af9d0-379b-4fdf-b14c-5bef8835d215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:59.151322 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf38264-f38b-4035-90f2-9dbfb95f7d15 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:59.160598 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1409/2801] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:59.193464 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:59.218049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1393/2802] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:59.227718 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38264-f38b-4035-90f2-9dbfb95f7d15 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:59.229172 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-bbf38264-f38b-4035-90f2-9dbfb95f7d15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:59.244551 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:59.330142 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38264-f38b-4035-90f2-9dbfb95f7d15 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:59.408568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04a201-5a4b-4333-b9ae-9ce450766d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:59.409444 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04a201-5a4b-4333-b9ae-9ce450766d2e service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:59.409927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04a201-5a4b-4333-b9ae-9ce450766d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:59.410380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04a201-5a4b-4333-b9ae-9ce450766d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:59.426498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04a201-5a4b-4333-b9ae-9ce450766d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:59.429923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04a201-5a4b-4333-b9ae-9ce450766d2e service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:59.445768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1410/2803] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:59.818819 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7af9d0-379b-4fdf-b14c-5bef8835d215 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:59.820892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-fe7af9d0-379b-4fdf-b14c-5bef8835d215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:59.836257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7af9d0-379b-4fdf-b14c-5bef8835d215 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:59.843719 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:59.844526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:59.844892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:59.845169 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] PATH_INFO: `/v3/projects/576dca549712483482d0976636e63ec7` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:59.846618 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=576dca549712483482d0976636e63ec7)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:59.848631 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:59.907879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576dca549712483482d0976636e63ec7', 'request_id': 'req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.914889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576dca549712483482d0976636e63ec7', 'request_id': 'req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.922700 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576dca549712483482d0976636e63ec7', 'request_id': 'req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.938923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] The token cache is being invalidate because project 576dca549712483482d0976636e63ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:59.939219 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.940009 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.941559 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1394/2804] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:59 2022] DELETE /identity/v3/projects/576dca549712483482d0976636e63ec7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:59.945780 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04a201-5a4b-4333-b9ae-9ce450766d2e service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:59.956058 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04a201-5a4b-4333-b9ae-9ce450766d2e service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:00.018942 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:00.019485 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:00.019785 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:00.020064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] PATH_INFO: `/v3/users/4a6ed5f0009944c68b669a861297c4ea` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:00.021176 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a6ed5f0009944c68b669a861297c4ea)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:00.023081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:00.070126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a6ed5f0009944c68b669a861297c4ea'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.077285 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a6ed5f0009944c68b669a861297c4ea'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.084194 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a6ed5f0009944c68b669a861297c4ea'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.084834 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a6ed5f0009944c68b669a861297c4ea'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.092517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:00.107789 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a6ed5f0009944c68b669a861297c4ea'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.114781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1411/2805] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:59 2022] DELETE /identity/v3/users/4a6ed5f0009944c68b669a861297c4ea => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:00.399005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:00.400609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:00.415502 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eed9d-1139-4034-a089-cfcf4ed96f7e admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:00.474278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:00.474909 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:00.475190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:00.475463 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] PATH_INFO: `/v3/projects/23be57bf25d04cd294294465bf3b174e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:00.476664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23be57bf25d04cd294294465bf3b174e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:00.478581 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:00.540513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23be57bf25d04cd294294465bf3b174e', 'request_id': 'req-8cac14cb-e18f-49eb-82fe-cbe422365fb9'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.547540 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23be57bf25d04cd294294465bf3b174e', 'request_id': 'req-8cac14cb-e18f-49eb-82fe-cbe422365fb9'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.554911 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23be57bf25d04cd294294465bf3b174e', 'request_id': 'req-8cac14cb-e18f-49eb-82fe-cbe422365fb9'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.564321 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:00.569760 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] The token cache is being invalidate because project 23be57bf25d04cd294294465bf3b174e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:00.570051 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.570701 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.572951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1395/2806] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:00 2022] DELETE /identity/v3/projects/23be57bf25d04cd294294465bf3b174e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:00.576787 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:00.578289 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:00.595776 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9b68f-c983-4858-9679-45184b99432c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:00.667622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:00.668302 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:00.668583 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:00.668856 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] PATH_INFO: `/v3/users/871fdbe6e5304ad79db552a15c2c5f04` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:00.670534 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=871fdbe6e5304ad79db552a15c2c5f04)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:00.672466 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:00.722448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871fdbe6e5304ad79db552a15c2c5f04'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.731654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871fdbe6e5304ad79db552a15c2c5f04'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.740193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871fdbe6e5304ad79db552a15c2c5f04'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.741020 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871fdbe6e5304ad79db552a15c2c5f04'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.753914 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871fdbe6e5304ad79db552a15c2c5f04'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.760380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1412/2807] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:00 2022] DELETE /identity/v3/users/871fdbe6e5304ad79db552a15c2c5f04 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:00.823522 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:00.825100 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:00.904850 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac14cb-e18f-49eb-82fe-cbe422365fb9 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:01.001277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae8bd7-b271-42a9-99c6-d87ffdce61c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:01.001970 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae8bd7-b271-42a9-99c6-d87ffdce61c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:01.002364 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae8bd7-b271-42a9-99c6-d87ffdce61c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:01.002698 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae8bd7-b271-42a9-99c6-d87ffdce61c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:01.004859 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-40ae8bd7-b271-42a9-99c6-d87ffdce61c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:01.080586 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae8bd7-b271-42a9-99c6-d87ffdce61c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:01.082491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae8bd7-b271-42a9-99c6-d87ffdce61c0 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:01.090021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:01.092317 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:01.105992 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1396/2808] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:01.177838 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727c925-2ee4-4ec4-9876-d4778ef35c7d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:01.183484 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27426982-25f8-43a7-ad50-c306b7a0bb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:01.184166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27426982-25f8-43a7-ad50-c306b7a0bb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:01.184446 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27426982-25f8-43a7-ad50-c306b7a0bb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:01.184725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27426982-25f8-43a7-ad50-c306b7a0bb18 admin admin] PATH_INFO: `/v3/projects/ec2f7be83c57438e968b54bf403ae9a3` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:01.186514 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27426982-25f8-43a7-ad50-c306b7a0bb18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec2f7be83c57438e968b54bf403ae9a3)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:01.188529 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27426982-25f8-43a7-ad50-c306b7a0bb18 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:01.201329 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:01.253249 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-27426982-25f8-43a7-ad50-c306b7a0bb18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec2f7be83c57438e968b54bf403ae9a3', 'request_id': 'req-27426982-25f8-43a7-ad50-c306b7a0bb18'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.260989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-27426982-25f8-43a7-ad50-c306b7a0bb18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec2f7be83c57438e968b54bf403ae9a3', 'request_id': 'req-27426982-25f8-43a7-ad50-c306b7a0bb18'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.268421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-27426982-25f8-43a7-ad50-c306b7a0bb18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec2f7be83c57438e968b54bf403ae9a3', 'request_id': 'req-27426982-25f8-43a7-ad50-c306b7a0bb18'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.286721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-27426982-25f8-43a7-ad50-c306b7a0bb18 admin admin] The token cache is being invalidate because project ec2f7be83c57438e968b54bf403ae9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:01.287127 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-27426982-25f8-43a7-ad50-c306b7a0bb18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.287870 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-27426982-25f8-43a7-ad50-c306b7a0bb18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.290667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1413/2809] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:01 2022] DELETE /identity/v3/projects/ec2f7be83c57438e968b54bf403ae9a3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:01.521349 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae8bd7-b271-42a9-99c6-d87ffdce61c0 service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:01.522923 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-40ae8bd7-b271-42a9-99c6-d87ffdce61c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:01.539326 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae8bd7-b271-42a9-99c6-d87ffdce61c0 service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:01.614770 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:01.615470 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:01.615781 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:01.616064 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] PATH_INFO: `/v3/users/0bfea052d1a0425badf10bf723459bc8` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:01.617287 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bfea052d1a0425badf10bf723459bc8)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:01.619365 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:01.632492 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:01.685489 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bfea052d1a0425badf10bf723459bc8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.699981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bfea052d1a0425badf10bf723459bc8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.699981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bfea052d1a0425badf10bf723459bc8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.699981 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bfea052d1a0425badf10bf723459bc8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.729336 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bfea052d1a0425badf10bf723459bc8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.753455 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1397/2810] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:01 2022] DELETE /identity/v3/users/0bfea052d1a0425badf10bf723459bc8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:01.761833 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126a9e8-9363-4c92-8557-c01141b0a3d7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:01.762124 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126a9e8-9363-4c92-8557-c01141b0a3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:01.762408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126a9e8-9363-4c92-8557-c01141b0a3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:01.784727 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2126a9e8-9363-4c92-8557-c01141b0a3d7 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:01.785982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2126a9e8-9363-4c92-8557-c01141b0a3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:01.792333 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:01.794366 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:01.856570 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1414/2811] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:01.863109 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dccd5-a3fc-404a-a7c8-827286d50268 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:01.866596 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126a9e8-9363-4c92-8557-c01141b0a3d7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:01.867412 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48034f6-b0dd-41ba-8a59-1f627098882f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:01.868108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48034f6-b0dd-41ba-8a59-1f627098882f service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:01.868234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2126a9e8-9363-4c92-8557-c01141b0a3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:01.868393 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48034f6-b0dd-41ba-8a59-1f627098882f service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:01.868697 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48034f6-b0dd-41ba-8a59-1f627098882f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:01.870468 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b48034f6-b0dd-41ba-8a59-1f627098882f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:01.933955 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126a9e8-9363-4c92-8557-c01141b0a3d7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:01.938178 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595fb99-9c2f-4ae1-ae31-9aa4c790284e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:01.938782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595fb99-9c2f-4ae1-ae31-9aa4c790284e service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:01.939064 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595fb99-9c2f-4ae1-ae31-9aa4c790284e service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:01.939336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595fb99-9c2f-4ae1-ae31-9aa4c790284e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:01.943002 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48034f6-b0dd-41ba-8a59-1f627098882f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:01.944648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48034f6-b0dd-41ba-8a59-1f627098882f service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:01.948439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595fb99-9c2f-4ae1-ae31-9aa4c790284e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:01.950326 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595fb99-9c2f-4ae1-ae31-9aa4c790284e service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:01.955963 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1398/2812] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:01.960008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1415/2813] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:02.253687 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48034f6-b0dd-41ba-8a59-1f627098882f service cinder] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:02.256190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b48034f6-b0dd-41ba-8a59-1f627098882f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:02.273563 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48034f6-b0dd-41ba-8a59-1f627098882f service cinder] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:02.278445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:02.279160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:02.279490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:02.279715 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] PATH_INFO: `/v3/projects/34106fbdc93e4717ab55064910f8b20b` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:02.280961 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34106fbdc93e4717ab55064910f8b20b)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:02.282917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:02.322959 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:02.338028 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34106fbdc93e4717ab55064910f8b20b', 'request_id': 'req-bd332202-0a11-4e71-a07b-6205cfef5898'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.343950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34106fbdc93e4717ab55064910f8b20b', 'request_id': 'req-bd332202-0a11-4e71-a07b-6205cfef5898'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.350476 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34106fbdc93e4717ab55064910f8b20b', 'request_id': 'req-bd332202-0a11-4e71-a07b-6205cfef5898'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.364979 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] The token cache is being invalidate because project 34106fbdc93e4717ab55064910f8b20b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:02.365206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.365891 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.367509 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1399/2814] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:02 2022] DELETE /identity/v3/projects/34106fbdc93e4717ab55064910f8b20b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:02.372146 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595fb99-9c2f-4ae1-ae31-9aa4c790284e service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:02.382968 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595fb99-9c2f-4ae1-ae31-9aa4c790284e service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:02.429653 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:02.447893 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b49283-f342-47b2-84a2-d3e17e5c333b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:02.448599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b49283-f342-47b2-84a2-d3e17e5c333b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:02.448922 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b49283-f342-47b2-84a2-d3e17e5c333b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:02.449201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b49283-f342-47b2-84a2-d3e17e5c333b admin admin] PATH_INFO: `/v3/users/c24f9cf34fca43ed8d4a8e2ea2786e1b` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:02.450487 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b49283-f342-47b2-84a2-d3e17e5c333b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24f9cf34fca43ed8d4a8e2ea2786e1b)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:02.452488 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b49283-f342-47b2-84a2-d3e17e5c333b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:02.505187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-89b49283-f342-47b2-84a2-d3e17e5c333b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24f9cf34fca43ed8d4a8e2ea2786e1b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.513851 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-89b49283-f342-47b2-84a2-d3e17e5c333b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24f9cf34fca43ed8d4a8e2ea2786e1b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.521995 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-89b49283-f342-47b2-84a2-d3e17e5c333b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24f9cf34fca43ed8d4a8e2ea2786e1b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.522781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-89b49283-f342-47b2-84a2-d3e17e5c333b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24f9cf34fca43ed8d4a8e2ea2786e1b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.535782 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-89b49283-f342-47b2-84a2-d3e17e5c333b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24f9cf34fca43ed8d4a8e2ea2786e1b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.541694 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1416/2815] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:02 2022] DELETE /identity/v3/users/c24f9cf34fca43ed8d4a8e2ea2786e1b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:02.824458 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:02.826032 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:02.840223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd332202-0a11-4e71-a07b-6205cfef5898 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:02.908308 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5baba-ce22-472e-803a-454e850689cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:02.908978 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5baba-ce22-472e-803a-454e850689cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:02.909173 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5baba-ce22-472e-803a-454e850689cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:02.909390 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5baba-ce22-472e-803a-454e850689cf admin admin] PATH_INFO: `/v3/projects/4d85f393906c4186a51077c745b58cb5` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:02.910546 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5baba-ce22-472e-803a-454e850689cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d85f393906c4186a51077c745b58cb5)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:02.913551 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5baba-ce22-472e-803a-454e850689cf admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:02.964726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-65e5baba-ce22-472e-803a-454e850689cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d85f393906c4186a51077c745b58cb5', 'request_id': 'req-65e5baba-ce22-472e-803a-454e850689cf'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.971190 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-65e5baba-ce22-472e-803a-454e850689cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d85f393906c4186a51077c745b58cb5', 'request_id': 'req-65e5baba-ce22-472e-803a-454e850689cf'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.977674 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-65e5baba-ce22-472e-803a-454e850689cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d85f393906c4186a51077c745b58cb5', 'request_id': 'req-65e5baba-ce22-472e-803a-454e850689cf'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.989904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-65e5baba-ce22-472e-803a-454e850689cf admin admin] The token cache is being invalidate because project 4d85f393906c4186a51077c745b58cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:02.990195 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-65e5baba-ce22-472e-803a-454e850689cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.990864 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-65e5baba-ce22-472e-803a-454e850689cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:02.992430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1400/2816] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:02 2022] DELETE /identity/v3/projects/4d85f393906c4186a51077c745b58cb5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:02.997607 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7a185-21d3-4666-8898-a93edb2bd378 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:02.997966 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7a185-21d3-4666-8898-a93edb2bd378 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:02.998332 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7a185-21d3-4666-8898-a93edb2bd378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.020061 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4eb7a185-21d3-4666-8898-a93edb2bd378 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:03.021391 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4eb7a185-21d3-4666-8898-a93edb2bd378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:03.080909 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1417/2817] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:03.088914 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02774e1-c929-481b-a04d-fa799493488c None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.089206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02774e1-c929-481b-a04d-fa799493488c None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.089486 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02774e1-c929-481b-a04d-fa799493488c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.110506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-c02774e1-c929-481b-a04d-fa799493488c None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:03.111713 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-c02774e1-c929-481b-a04d-fa799493488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:03.119753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1401/2818] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:03.124066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7a185-21d3-4666-8898-a93edb2bd378 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.133706 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7a185-21d3-4666-8898-a93edb2bd378 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.138796 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347237f-0af5-4650-9e6b-bb8cad6a18dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.139388 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347237f-0af5-4650-9e6b-bb8cad6a18dd admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.139671 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347237f-0af5-4650-9e6b-bb8cad6a18dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.139973 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347237f-0af5-4650-9e6b-bb8cad6a18dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.140622 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347237f-0af5-4650-9e6b-bb8cad6a18dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:03.140925 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347237f-0af5-4650-9e6b-bb8cad6a18dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.142502 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347237f-0af5-4650-9e6b-bb8cad6a18dd admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.154693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1418/2819] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:11:03.159244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02774e1-c929-481b-a04d-fa799493488c None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.170248 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02774e1-c929-481b-a04d-fa799493488c None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.175362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e61a02-7caa-4915-bcec-b9a9035d814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.175991 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e61a02-7caa-4915-bcec-b9a9035d814d admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.176273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e61a02-7caa-4915-bcec-b9a9035d814d admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.176548 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e61a02-7caa-4915-bcec-b9a9035d814d admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.177181 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e61a02-7caa-4915-bcec-b9a9035d814d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.179082 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e61a02-7caa-4915-bcec-b9a9035d814d admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.210035 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1402/2820] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:03 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:11:03.214216 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347237f-0af5-4650-9e6b-bb8cad6a18dd admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.231568 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347237f-0af5-4650-9e6b-bb8cad6a18dd admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.302151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:03.319240 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7f6e2-7d7a-4602-b421-eeb18564bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.320824 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7f6e2-7d7a-4602-b421-eeb18564bbef admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.321435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7f6e2-7d7a-4602-b421-eeb18564bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.322201 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7f6e2-7d7a-4602-b421-eeb18564bbef admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.323920 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7f6e2-7d7a-4602-b421-eeb18564bbef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.328367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7f6e2-7d7a-4602-b421-eeb18564bbef admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.358715 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1419/2821] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:03 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:03.362791 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e61a02-7caa-4915-bcec-b9a9035d814d admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.374743 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e61a02-7caa-4915-bcec-b9a9035d814d admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.384216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdeb79-bfb3-4c5e-a560-34a36c5d3942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.384852 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdeb79-bfb3-4c5e-a560-34a36c5d3942 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.385132 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdeb79-bfb3-4c5e-a560-34a36c5d3942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.385555 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdeb79-bfb3-4c5e-a560-34a36c5d3942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.386228 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdeb79-bfb3-4c5e-a560-34a36c5d3942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.389053 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdeb79-bfb3-4c5e-a560-34a36c5d3942 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.405892 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1403/2822] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:03.411605 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7f6e2-7d7a-4602-b421-eeb18564bbef admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.422209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7f6e2-7d7a-4602-b421-eeb18564bbef admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.427547 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7adf2-bc14-462f-8555-e9ba0ab8ab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.428197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7adf2-bc14-462f-8555-e9ba0ab8ab9a admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.428480 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7adf2-bc14-462f-8555-e9ba0ab8ab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.428755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7adf2-bc14-462f-8555-e9ba0ab8ab9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.429424 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7adf2-bc14-462f-8555-e9ba0ab8ab9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.431019 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7adf2-bc14-462f-8555-e9ba0ab8ab9a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.446083 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1420/2823] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:11:03.447542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdeb79-bfb3-4c5e-a560-34a36c5d3942 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.460588 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdeb79-bfb3-4c5e-a560-34a36c5d3942 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.466481 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57184e05-1e04-4ec1-8187-8b7350ea3309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.467173 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57184e05-1e04-4ec1-8187-8b7350ea3309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.467454 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57184e05-1e04-4ec1-8187-8b7350ea3309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.467747 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57184e05-1e04-4ec1-8187-8b7350ea3309 admin admin] PATH_INFO: `/v3/projects/422059174f4f4715be03bf1157694048/users/5e1ebc651a2f4b87b0d70ebb96c7a40d/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.476748 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:03.484993 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57184e05-1e04-4ec1-8187-8b7350ea3309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422059174f4f4715be03bf1157694048, user_id=5e1ebc651a2f4b87b0d70ebb96c7a40d, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.488133 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57184e05-1e04-4ec1-8187-8b7350ea3309 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.502589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1404/2824] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:03 2022] PUT /identity/v3/projects/422059174f4f4715be03bf1157694048/users/5e1ebc651a2f4b87b0d70ebb96c7a40d/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:03.514197 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215d972-41b4-4e9b-8941-c1a1539e10ad None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.514483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215d972-41b4-4e9b-8941-c1a1539e10ad None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.514757 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215d972-41b4-4e9b-8941-c1a1539e10ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.543008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a215d972-41b4-4e9b-8941-c1a1539e10ad None None] MFA Rules not processed for user `5e1ebc651a2f4b87b0d70ebb96c7a40d`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:03.544931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a215d972-41b4-4e9b-8941-c1a1539e10ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:03.618074 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1421/2825] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:03.631362 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57184e05-1e04-4ec1-8187-8b7350ea3309 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.633291 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-57184e05-1e04-4ec1-8187-8b7350ea3309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:03.694653 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57184e05-1e04-4ec1-8187-8b7350ea3309 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.698486 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb05612-7f3d-4b32-90aa-c2763eeb3940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.699114 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05612-7f3d-4b32-90aa-c2763eeb3940 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.699423 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05612-7f3d-4b32-90aa-c2763eeb3940 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.699703 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05612-7f3d-4b32-90aa-c2763eeb3940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.709235 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb05612-7f3d-4b32-90aa-c2763eeb3940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.710695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb05612-7f3d-4b32-90aa-c2763eeb3940 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.720542 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1405/2826] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:11:05.918043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215d972-41b4-4e9b-8941-c1a1539e10ad None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:05.919522 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a215d972-41b4-4e9b-8941-c1a1539e10ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:05.988156 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215d972-41b4-4e9b-8941-c1a1539e10ad None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:05.992788 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:05.993425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:05.993712 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:05.993995 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] PATH_INFO: `/v3/users/5fb4f6ad5234452db14a47ef424d08fe` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:05.995157 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb4f6ad5234452db14a47ef424d08fe)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:05.997148 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:06.045743 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb4f6ad5234452db14a47ef424d08fe'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.054440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb4f6ad5234452db14a47ef424d08fe'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.059945 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:06.062376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb4f6ad5234452db14a47ef424d08fe'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.063184 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb4f6ad5234452db14a47ef424d08fe'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.077843 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb4f6ad5234452db14a47ef424d08fe'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.084367 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1422/2827] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:05 2022] DELETE /identity/v3/users/5fb4f6ad5234452db14a47ef424d08fe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:06.088953 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d870919-13d0-4c1c-bba7-185830a4e2f3 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:06.089495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d870919-13d0-4c1c-bba7-185830a4e2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:06.089495 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d870919-13d0-4c1c-bba7-185830a4e2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:06.109381 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-4d870919-13d0-4c1c-bba7-185830a4e2f3 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:06.110532 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4d870919-13d0-4c1c-bba7-185830a4e2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:06.171838 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1406/2828] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:06.182021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:06.183599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:06.242350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d50b9-6636-4442-a187-f37185eb15f6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:06.246246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25d442-4caa-4af0-85a2-2c964985ec56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:06.246883 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25d442-4caa-4af0-85a2-2c964985ec56 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:06.247809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25d442-4caa-4af0-85a2-2c964985ec56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:06.248076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25d442-4caa-4af0-85a2-2c964985ec56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:06.257566 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25d442-4caa-4af0-85a2-2c964985ec56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:06.259008 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25d442-4caa-4af0-85a2-2c964985ec56 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:06.270209 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1423/2829] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:06.688665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d870919-13d0-4c1c-bba7-185830a4e2f3 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:06.691394 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4d870919-13d0-4c1c-bba7-185830a4e2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:06.733558 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d870919-13d0-4c1c-bba7-185830a4e2f3 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:06.738789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:06.739486 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:06.739800 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:06.740186 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] PATH_INFO: `/v3/projects/e10ded12d8ee42f39527294ac2ba7f06` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:06.741270 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10ded12d8ee42f39527294ac2ba7f06)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:06.743153 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:06.794802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10ded12d8ee42f39527294ac2ba7f06', 'request_id': 'req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.800922 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10ded12d8ee42f39527294ac2ba7f06', 'request_id': 'req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.807528 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10ded12d8ee42f39527294ac2ba7f06', 'request_id': 'req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.821269 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] The token cache is being invalidate because project e10ded12d8ee42f39527294ac2ba7f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:06.821561 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.822232 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.823957 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1407/2830] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:06 2022] DELETE /identity/v3/projects/e10ded12d8ee42f39527294ac2ba7f06 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:06.828702 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25d442-4caa-4af0-85a2-2c964985ec56 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:06.839322 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25d442-4caa-4af0-85a2-2c964985ec56 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:06.905314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:06.906282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:06.906282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:06.906579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] PATH_INFO: `/v3/users/28938816d83d42c88e779f31e168757e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:06.907676 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=28938816d83d42c88e779f31e168757e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:06.909987 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:06.971057 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28938816d83d42c88e779f31e168757e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.982225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28938816d83d42c88e779f31e168757e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.999300 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28938816d83d42c88e779f31e168757e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.000669 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28938816d83d42c88e779f31e168757e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.019154 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28938816d83d42c88e779f31e168757e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.021581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:07.028134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1424/2831] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:06 2022] DELETE /identity/v3/users/28938816d83d42c88e779f31e168757e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:07.479223 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:07.482005 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:07.497671 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a7450-e2f2-48e0-bd67-491c8d178bc8 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:07.519137 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:07.577408 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:07.578068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:07.578354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:07.578639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] PATH_INFO: `/v3/projects/27d476f50aaf43bba9b3b140332764b5` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:07.579874 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d476f50aaf43bba9b3b140332764b5)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:07.581907 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:07.640366 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d476f50aaf43bba9b3b140332764b5', 'request_id': 'req-116afd70-a866-468c-8a00-10fbe0f4f965'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.646742 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d476f50aaf43bba9b3b140332764b5', 'request_id': 'req-116afd70-a866-468c-8a00-10fbe0f4f965'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.654565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d476f50aaf43bba9b3b140332764b5', 'request_id': 'req-116afd70-a866-468c-8a00-10fbe0f4f965'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.670498 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] The token cache is being invalidate because project 27d476f50aaf43bba9b3b140332764b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:07.670794 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.673249 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.673425 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1408/2832] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:07 2022] DELETE /identity/v3/projects/27d476f50aaf43bba9b3b140332764b5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:07.677661 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:07.679233 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:07.702460 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f00b7-f853-45a7-89fb-6cc0d2f1e7ec admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:07.774087 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429af999-6e6f-4a77-948b-5eb05da9daa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:07.775403 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429af999-6e6f-4a77-948b-5eb05da9daa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:07.775777 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429af999-6e6f-4a77-948b-5eb05da9daa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:07.776129 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429af999-6e6f-4a77-948b-5eb05da9daa7 admin admin] PATH_INFO: `/v3/users/1e580e6b644e4249bf3ebff95447c256` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:07.777381 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429af999-6e6f-4a77-948b-5eb05da9daa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e580e6b644e4249bf3ebff95447c256)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:07.779767 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429af999-6e6f-4a77-948b-5eb05da9daa7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:07.834345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-429af999-6e6f-4a77-948b-5eb05da9daa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e580e6b644e4249bf3ebff95447c256'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.844335 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-429af999-6e6f-4a77-948b-5eb05da9daa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e580e6b644e4249bf3ebff95447c256'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.853021 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-429af999-6e6f-4a77-948b-5eb05da9daa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e580e6b644e4249bf3ebff95447c256'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.853748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-429af999-6e6f-4a77-948b-5eb05da9daa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e580e6b644e4249bf3ebff95447c256'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.866747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-429af999-6e6f-4a77-948b-5eb05da9daa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e580e6b644e4249bf3ebff95447c256'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.873595 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1425/2833] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:07 2022] DELETE /identity/v3/users/1e580e6b644e4249bf3ebff95447c256 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:08.145331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.147026 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:08.163023 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116afd70-a866-468c-8a00-10fbe0f4f965 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.228315 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.229545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.229545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.229794 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2 admin admin] PATH_INFO: `/v3/projects/e548334041294cd880ac1ab59a42ec2b` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.230962 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e548334041294cd880ac1ab59a42ec2b)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.233092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.276929 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:08.280407 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e548334041294cd880ac1ab59a42ec2b', 'request_id': 'req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.287789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e548334041294cd880ac1ab59a42ec2b', 'request_id': 'req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.294723 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e548334041294cd880ac1ab59a42ec2b', 'request_id': 'req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.307471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2 admin admin] The token cache is being invalidate because project e548334041294cd880ac1ab59a42ec2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:08.307699 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.308357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-6caa6cb4-19dd-4b6a-8f9e-976f8ae95eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.310450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1409/2834] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:08 2022] DELETE /identity/v3/projects/e548334041294cd880ac1ab59a42ec2b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:08.315472 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266db4-be99-4a5f-a222-4ab9e92f2689 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.315898 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266db4-be99-4a5f-a222-4ab9e92f2689 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.316105 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266db4-be99-4a5f-a222-4ab9e92f2689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.337974 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2b266db4-be99-4a5f-a222-4ab9e92f2689 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:08.339219 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2b266db4-be99-4a5f-a222-4ab9e92f2689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:08.401872 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1426/2835] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:08.410419 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b28f9-7eb2-4f53-98bb-12919eb6fb26 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.410704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b28f9-7eb2-4f53-98bb-12919eb6fb26 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.410983 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b28f9-7eb2-4f53-98bb-12919eb6fb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.432821 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e71b28f9-7eb2-4f53-98bb-12919eb6fb26 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:08.434043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e71b28f9-7eb2-4f53-98bb-12919eb6fb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:08.447339 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1410/2836] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:08.452282 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b266db4-be99-4a5f-a222-4ab9e92f2689 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.462192 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b266db4-be99-4a5f-a222-4ab9e92f2689 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.467443 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e19fb-45d2-4eec-ad9e-c4e269e6635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.468081 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e19fb-45d2-4eec-ad9e-c4e269e6635c admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.468357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e19fb-45d2-4eec-ad9e-c4e269e6635c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.468627 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e19fb-45d2-4eec-ad9e-c4e269e6635c admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.469280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e19fb-45d2-4eec-ad9e-c4e269e6635c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:08.469579 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e19fb-45d2-4eec-ad9e-c4e269e6635c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.471163 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e19fb-45d2-4eec-ad9e-c4e269e6635c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.482984 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1427/2837] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:08.487500 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b28f9-7eb2-4f53-98bb-12919eb6fb26 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.497735 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b28f9-7eb2-4f53-98bb-12919eb6fb26 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.509062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca12d6-a98f-472f-92f6-4c5b99a73fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.510105 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca12d6-a98f-472f-92f6-4c5b99a73fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.510609 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca12d6-a98f-472f-92f6-4c5b99a73fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.511106 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca12d6-a98f-472f-92f6-4c5b99a73fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.512322 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca12d6-a98f-472f-92f6-4c5b99a73fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.516686 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca12d6-a98f-472f-92f6-4c5b99a73fa8 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.562149 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1411/2838] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:08 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:08.566312 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e19fb-45d2-4eec-ad9e-c4e269e6635c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.577182 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e19fb-45d2-4eec-ad9e-c4e269e6635c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.580952 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:08.642234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0318a-827d-47ee-866b-1272e4ca1eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.642845 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0318a-827d-47ee-866b-1272e4ca1eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.643131 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0318a-827d-47ee-866b-1272e4ca1eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.643412 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0318a-827d-47ee-866b-1272e4ca1eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.644078 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0318a-827d-47ee-866b-1272e4ca1eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.645994 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0318a-827d-47ee-866b-1272e4ca1eb9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.669181 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1428/2839] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:08 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:11:08.673645 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca12d6-a98f-472f-92f6-4c5b99a73fa8 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.684527 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca12d6-a98f-472f-92f6-4c5b99a73fa8 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.690048 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8de06-87c5-464f-93ae-a5b21f35a285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.690665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8de06-87c5-464f-93ae-a5b21f35a285 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.690976 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8de06-87c5-464f-93ae-a5b21f35a285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.691257 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8de06-87c5-464f-93ae-a5b21f35a285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.691954 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8de06-87c5-464f-93ae-a5b21f35a285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.693589 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8de06-87c5-464f-93ae-a5b21f35a285 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.704934 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1412/2840] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:08.709125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0318a-827d-47ee-866b-1272e4ca1eb9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.719809 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0318a-827d-47ee-866b-1272e4ca1eb9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.724654 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe89a3-142e-4757-b005-d362cce1f524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.725246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe89a3-142e-4757-b005-d362cce1f524 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.725524 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe89a3-142e-4757-b005-d362cce1f524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.725794 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe89a3-142e-4757-b005-d362cce1f524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.726425 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe89a3-142e-4757-b005-d362cce1f524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.728035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe89a3-142e-4757-b005-d362cce1f524 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.739104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1429/2841] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:08.743471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8de06-87c5-464f-93ae-a5b21f35a285 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.754564 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8de06-87c5-464f-93ae-a5b21f35a285 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.759357 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c53eb-7229-45f0-9d59-efd68fd43139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.760062 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c53eb-7229-45f0-9d59-efd68fd43139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.760345 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c53eb-7229-45f0-9d59-efd68fd43139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.760620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c53eb-7229-45f0-9d59-efd68fd43139 admin admin] PATH_INFO: `/v3/projects/8363a443299f487fb1e2a37ef9cd7ba7/users/2b98216c7a4742f78b12c36af4283a32/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.778084 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c53eb-7229-45f0-9d59-efd68fd43139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8363a443299f487fb1e2a37ef9cd7ba7, user_id=2b98216c7a4742f78b12c36af4283a32, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.780792 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c53eb-7229-45f0-9d59-efd68fd43139 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.793536 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1413/2842] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:08 2022] PUT /identity/v3/projects/8363a443299f487fb1e2a37ef9cd7ba7/users/2b98216c7a4742f78b12c36af4283a32/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:08.804145 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7187e-065b-42da-bb89-937439a1b111 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.804432 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7187e-065b-42da-bb89-937439a1b111 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.804705 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7187e-065b-42da-bb89-937439a1b111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.841714 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e9c7187e-065b-42da-bb89-937439a1b111 None None] MFA Rules not processed for user `2b98216c7a4742f78b12c36af4283a32`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:08.842900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e9c7187e-065b-42da-bb89-937439a1b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:08.921204 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1430/2843] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:08.932370 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c53eb-7229-45f0-9d59-efd68fd43139 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.934165 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-028c53eb-7229-45f0-9d59-efd68fd43139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:08.997944 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c53eb-7229-45f0-9d59-efd68fd43139 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.001832 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ec3eb-f794-4547-ab21-ea94255dac50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.002519 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ec3eb-f794-4547-ab21-ea94255dac50 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.002808 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ec3eb-f794-4547-ab21-ea94255dac50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.003086 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ec3eb-f794-4547-ab21-ea94255dac50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.011917 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ec3eb-f794-4547-ab21-ea94255dac50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.013884 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ec3eb-f794-4547-ab21-ea94255dac50 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.023955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1414/2844] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:09.213439 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7187e-065b-42da-bb89-937439a1b111 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.215526 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e9c7187e-065b-42da-bb89-937439a1b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:09.292510 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7187e-065b-42da-bb89-937439a1b111 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.298029 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.298900 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.299356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.299852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] PATH_INFO: `/v3/users/5e1ebc651a2f4b87b0d70ebb96c7a40d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.301732 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1ebc651a2f4b87b0d70ebb96c7a40d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.304281 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.329598 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:09.370616 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1ebc651a2f4b87b0d70ebb96c7a40d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:09.380873 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1ebc651a2f4b87b0d70ebb96c7a40d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:09.389874 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1ebc651a2f4b87b0d70ebb96c7a40d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:09.390493 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1ebc651a2f4b87b0d70ebb96c7a40d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:09.405855 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1ebc651a2f4b87b0d70ebb96c7a40d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:09.412927 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1431/2845] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:09 2022] DELETE /identity/v3/users/5e1ebc651a2f4b87b0d70ebb96c7a40d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:09.417505 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a1f12-5080-47b3-9203-46c6b72f2391 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.417822 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a1f12-5080-47b3-9203-46c6b72f2391 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.418102 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a1f12-5080-47b3-9203-46c6b72f2391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.440199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b20a1f12-5080-47b3-9203-46c6b72f2391 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:09.441331 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b20a1f12-5080-47b3-9203-46c6b72f2391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:09.503414 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1415/2846] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:09.514868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.516343 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:09.592380 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c33ea-a884-4a55-9ec4-9fbbf858c7ad admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.597429 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cead855-ab19-4f6f-ba7b-88da01dd3481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.598034 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cead855-ab19-4f6f-ba7b-88da01dd3481 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.598314 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cead855-ab19-4f6f-ba7b-88da01dd3481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.598581 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cead855-ab19-4f6f-ba7b-88da01dd3481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.607908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cead855-ab19-4f6f-ba7b-88da01dd3481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.609274 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cead855-ab19-4f6f-ba7b-88da01dd3481 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.618703 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1432/2847] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:09.927019 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a1f12-5080-47b3-9203-46c6b72f2391 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.928669 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b20a1f12-5080-47b3-9203-46c6b72f2391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:09.941849 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a1f12-5080-47b3-9203-46c6b72f2391 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.948955 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.949950 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.950205 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.950488 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe admin admin] PATH_INFO: `/v3/projects/422059174f4f4715be03bf1157694048` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.951893 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=422059174f4f4715be03bf1157694048)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.953762 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.963508 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:10.008518 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422059174f4f4715be03bf1157694048', 'request_id': 'req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:10.014418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422059174f4f4715be03bf1157694048', 'request_id': 'req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:10.020946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422059174f4f4715be03bf1157694048', 'request_id': 'req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:10.035278 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe admin admin] The token cache is being invalidate because project 422059174f4f4715be03bf1157694048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:10.035590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:10.036292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-2097ccc3-daa2-48d7-b0c6-3932326bbcbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:10.037931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1416/2848] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:09 2022] DELETE /identity/v3/projects/422059174f4f4715be03bf1157694048 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:10.043066 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da75883-014a-4e64-b847-47103937d9b2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.043354 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da75883-014a-4e64-b847-47103937d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.043632 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da75883-014a-4e64-b847-47103937d9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.064970 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0da75883-014a-4e64-b847-47103937d9b2 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:10.066246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0da75883-014a-4e64-b847-47103937d9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:10.130816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1433/2849] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:10.138971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769008b-297a-45ac-845e-92352f911e87 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.139430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769008b-297a-45ac-845e-92352f911e87 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.139802 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769008b-297a-45ac-845e-92352f911e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.161036 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-e769008b-297a-45ac-845e-92352f911e87 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:10.162554 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e769008b-297a-45ac-845e-92352f911e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:10.173948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1417/2850] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:10.179662 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da75883-014a-4e64-b847-47103937d9b2 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:10.192467 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da75883-014a-4e64-b847-47103937d9b2 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:10.197174 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71d55c-9bfd-44f0-9649-5891b6bfd9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:10.197792 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71d55c-9bfd-44f0-9649-5891b6bfd9db admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.198076 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71d55c-9bfd-44f0-9649-5891b6bfd9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.198348 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71d55c-9bfd-44f0-9649-5891b6bfd9db admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.199003 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71d55c-9bfd-44f0-9649-5891b6bfd9db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:10.199336 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71d55c-9bfd-44f0-9649-5891b6bfd9db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:10.201024 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71d55c-9bfd-44f0-9649-5891b6bfd9db admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:10.213167 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1434/2851] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:10.218126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769008b-297a-45ac-845e-92352f911e87 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:10.228252 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769008b-297a-45ac-845e-92352f911e87 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:10.233781 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93af0d-71f9-47fb-9767-662329d1799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:10.234375 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93af0d-71f9-47fb-9767-662329d1799e admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.234682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93af0d-71f9-47fb-9767-662329d1799e admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.234951 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93af0d-71f9-47fb-9767-662329d1799e admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.235591 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93af0d-71f9-47fb-9767-662329d1799e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:10.237527 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93af0d-71f9-47fb-9767-662329d1799e admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:10.266753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1418/2852] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:10 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:11:10.270847 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71d55c-9bfd-44f0-9649-5891b6bfd9db admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:10.283915 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71d55c-9bfd-44f0-9649-5891b6bfd9db admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:10.306376 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:10.347350 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55e9e3-59ae-43b3-83f6-1a5346d2f8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:10.348052 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55e9e3-59ae-43b3-83f6-1a5346d2f8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.348312 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55e9e3-59ae-43b3-83f6-1a5346d2f8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.348802 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55e9e3-59ae-43b3-83f6-1a5346d2f8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.349621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55e9e3-59ae-43b3-83f6-1a5346d2f8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:10.352696 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55e9e3-59ae-43b3-83f6-1a5346d2f8e9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:10.377931 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1435/2853] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:10 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:10.383068 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93af0d-71f9-47fb-9767-662329d1799e admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:10.402041 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93af0d-71f9-47fb-9767-662329d1799e admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:10.410513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420750f-49ca-4212-a55c-1dc945efcc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:10.410513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420750f-49ca-4212-a55c-1dc945efcc7c admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.410513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420750f-49ca-4212-a55c-1dc945efcc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.410513 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420750f-49ca-4212-a55c-1dc945efcc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.410904 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420750f-49ca-4212-a55c-1dc945efcc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:10.411577 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53638150-9c83-4f1f-8337-8e2134d9bfec None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.411813 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53638150-9c83-4f1f-8337-8e2134d9bfec None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.412089 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53638150-9c83-4f1f-8337-8e2134d9bfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.413676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420750f-49ca-4212-a55c-1dc945efcc7c admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:10.426947 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1419/2854] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:10.431866 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420750f-49ca-4212-a55c-1dc945efcc7c admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:10.441989 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-53638150-9c83-4f1f-8337-8e2134d9bfec None None] MFA Rules not processed for user `2b98216c7a4742f78b12c36af4283a32`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:10.443341 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-53638150-9c83-4f1f-8337-8e2134d9bfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:10.453234 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420750f-49ca-4212-a55c-1dc945efcc7c admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:10.458319 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbd39f-e90b-4225-ba29-4e35fc6ca8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:10.458946 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbd39f-e90b-4225-ba29-4e35fc6ca8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.459236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbd39f-e90b-4225-ba29-4e35fc6ca8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.459506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbd39f-e90b-4225-ba29-4e35fc6ca8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.460183 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbd39f-e90b-4225-ba29-4e35fc6ca8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:10.461789 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbd39f-e90b-4225-ba29-4e35fc6ca8c6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:10.480939 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1420/2855] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:11:10.482632 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbd39f-e90b-4225-ba29-4e35fc6ca8c6 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:10.494749 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbd39f-e90b-4225-ba29-4e35fc6ca8c6 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:10.500523 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac681a8e-dd46-41da-9ac4-a5498b1e7656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:10.501199 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac681a8e-dd46-41da-9ac4-a5498b1e7656 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.501485 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac681a8e-dd46-41da-9ac4-a5498b1e7656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.501767 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac681a8e-dd46-41da-9ac4-a5498b1e7656 admin admin] PATH_INFO: `/v3/projects/e95b55a7ac1c4505b5e7a4f22cb5ab88/users/4ed2ff9f167940769e6ce2522d942e27/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.520452 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac681a8e-dd46-41da-9ac4-a5498b1e7656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95b55a7ac1c4505b5e7a4f22cb5ab88, user_id=4ed2ff9f167940769e6ce2522d942e27, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:10.523518 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac681a8e-dd46-41da-9ac4-a5498b1e7656 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:10.539491 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1436/2856] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:10.549313 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1421/2857] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:10 2022] PUT /identity/v3/projects/e95b55a7ac1c4505b5e7a4f22cb5ab88/users/4ed2ff9f167940769e6ce2522d942e27/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:10.563898 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e32a3-9351-41ac-b829-90734ca82788 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.564323 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e32a3-9351-41ac-b829-90734ca82788 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.564688 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e32a3-9351-41ac-b829-90734ca82788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.602448 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-145e32a3-9351-41ac-b829-90734ca82788 None None] MFA Rules not processed for user `4ed2ff9f167940769e6ce2522d942e27`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:10.603893 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-145e32a3-9351-41ac-b829-90734ca82788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:10.695079 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1437/2858] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:10.706491 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac681a8e-dd46-41da-9ac4-a5498b1e7656 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:10.708316 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-ac681a8e-dd46-41da-9ac4-a5498b1e7656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:10.780126 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac681a8e-dd46-41da-9ac4-a5498b1e7656 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:10.785378 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3303681-d15c-467b-afc5-ce0e648c79ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:10.786012 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3303681-d15c-467b-afc5-ce0e648c79ae service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.786299 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3303681-d15c-467b-afc5-ce0e648c79ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.786587 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3303681-d15c-467b-afc5-ce0e648c79ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.802868 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3303681-d15c-467b-afc5-ce0e648c79ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:10.804459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3303681-d15c-467b-afc5-ce0e648c79ae service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:10.817783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1422/2859] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:20.694053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:20.810045 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:22.452946 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e32a3-9351-41ac-b829-90734ca82788 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.514791 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e32a3-9351-41ac-b829-90734ca82788 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.520175 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.521357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.521357 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.521599 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] PATH_INFO: `/v3/users/4ed2ff9f167940769e6ce2522d942e27` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.523139 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed2ff9f167940769e6ce2522d942e27)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.525774 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.574290 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed2ff9f167940769e6ce2522d942e27'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:22.581991 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed2ff9f167940769e6ce2522d942e27'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:22.589038 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed2ff9f167940769e6ce2522d942e27'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:22.589816 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed2ff9f167940769e6ce2522d942e27'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:22.603795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed2ff9f167940769e6ce2522d942e27'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:22.610307 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1438/2860] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:22 2022] DELETE /identity/v3/users/4ed2ff9f167940769e6ce2522d942e27 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:22.614801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e18fea-913b-4ab7-b8bd-5c5866dd9e64 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.615256 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e18fea-913b-4ab7-b8bd-5c5866dd9e64 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.615355 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e18fea-913b-4ab7-b8bd-5c5866dd9e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.634639 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-03e18fea-913b-4ab7-b8bd-5c5866dd9e64 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:22.635873 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-03e18fea-913b-4ab7-b8bd-5c5866dd9e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:22.694885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1423/2861] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:22.704795 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.706199 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:22.765059 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20bb24-9a9f-4077-b7b5-bd5640dda1dd admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.768781 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efb640-2a4c-4cf3-b12a-0745a008e103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.769393 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb640-2a4c-4cf3-b12a-0745a008e103 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.769674 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb640-2a4c-4cf3-b12a-0745a008e103 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.769948 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb640-2a4c-4cf3-b12a-0745a008e103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.779861 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efb640-2a4c-4cf3-b12a-0745a008e103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.781294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efb640-2a4c-4cf3-b12a-0745a008e103 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.791130 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1439/2862] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:23.149943 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e18fea-913b-4ab7-b8bd-5c5866dd9e64 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.151603 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-03e18fea-913b-4ab7-b8bd-5c5866dd9e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:23.164582 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e18fea-913b-4ab7-b8bd-5c5866dd9e64 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.169484 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea2cd4-a355-4528-be8e-1b3880c4fdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.170178 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea2cd4-a355-4528-be8e-1b3880c4fdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.170520 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea2cd4-a355-4528-be8e-1b3880c4fdda admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.170744 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea2cd4-a355-4528-be8e-1b3880c4fdda admin admin] PATH_INFO: `/v3/projects/e95b55a7ac1c4505b5e7a4f22cb5ab88` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.172016 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea2cd4-a355-4528-be8e-1b3880c4fdda admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95b55a7ac1c4505b5e7a4f22cb5ab88)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.174279 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea2cd4-a355-4528-be8e-1b3880c4fdda admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.234473 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-18ea2cd4-a355-4528-be8e-1b3880c4fdda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95b55a7ac1c4505b5e7a4f22cb5ab88', 'request_id': 'req-18ea2cd4-a355-4528-be8e-1b3880c4fdda'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.239948 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-18ea2cd4-a355-4528-be8e-1b3880c4fdda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95b55a7ac1c4505b5e7a4f22cb5ab88', 'request_id': 'req-18ea2cd4-a355-4528-be8e-1b3880c4fdda'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.246348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-18ea2cd4-a355-4528-be8e-1b3880c4fdda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95b55a7ac1c4505b5e7a4f22cb5ab88', 'request_id': 'req-18ea2cd4-a355-4528-be8e-1b3880c4fdda'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.268545 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-18ea2cd4-a355-4528-be8e-1b3880c4fdda admin admin] The token cache is being invalidate because project e95b55a7ac1c4505b5e7a4f22cb5ab88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:23.268933 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-18ea2cd4-a355-4528-be8e-1b3880c4fdda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.269977 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-18ea2cd4-a355-4528-be8e-1b3880c4fdda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.271517 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1424/2863] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:23 2022] DELETE /identity/v3/projects/e95b55a7ac1c4505b5e7a4f22cb5ab88 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:23.276458 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbf8fa-6fa3-417f-97db-5fa5fb9fef68 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.276745 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbf8fa-6fa3-417f-97db-5fa5fb9fef68 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.277020 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbf8fa-6fa3-417f-97db-5fa5fb9fef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.296764 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2fdbf8fa-6fa3-417f-97db-5fa5fb9fef68 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:23.298237 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2fdbf8fa-6fa3-417f-97db-5fa5fb9fef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:23.314923 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:23.362623 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1440/2864] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:23.370726 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b4031-8fa7-43fc-800c-bac4c9fcb044 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.371016 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b4031-8fa7-43fc-800c-bac4c9fcb044 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.371295 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b4031-8fa7-43fc-800c-bac4c9fcb044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.392273 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-420b4031-8fa7-43fc-800c-bac4c9fcb044 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:23.393450 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-420b4031-8fa7-43fc-800c-bac4c9fcb044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:23.402112 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1425/2865] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:23.407042 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbf8fa-6fa3-417f-97db-5fa5fb9fef68 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.416818 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbf8fa-6fa3-417f-97db-5fa5fb9fef68 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.421564 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae23e3a-23ef-4e6d-94af-e769fca5ed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.422166 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae23e3a-23ef-4e6d-94af-e769fca5ed34 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.422445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae23e3a-23ef-4e6d-94af-e769fca5ed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.422967 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae23e3a-23ef-4e6d-94af-e769fca5ed34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.423619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae23e3a-23ef-4e6d-94af-e769fca5ed34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:23.423962 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae23e3a-23ef-4e6d-94af-e769fca5ed34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.425551 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae23e3a-23ef-4e6d-94af-e769fca5ed34 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.437689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1441/2866] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:23.441987 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b4031-8fa7-43fc-800c-bac4c9fcb044 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.451974 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b4031-8fa7-43fc-800c-bac4c9fcb044 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.456736 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990d3af-4ebf-4cdd-8b30-67554440f01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.457336 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990d3af-4ebf-4cdd-8b30-67554440f01b admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.457618 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990d3af-4ebf-4cdd-8b30-67554440f01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.457893 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990d3af-4ebf-4cdd-8b30-67554440f01b admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.458521 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990d3af-4ebf-4cdd-8b30-67554440f01b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.460438 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990d3af-4ebf-4cdd-8b30-67554440f01b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.488324 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1426/2867] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:23 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:23.492908 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae23e3a-23ef-4e6d-94af-e769fca5ed34 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.503748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae23e3a-23ef-4e6d-94af-e769fca5ed34 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.561476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4074788-c6ac-4505-8336-b3da83dcc0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.562084 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4074788-c6ac-4505-8336-b3da83dcc0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.562364 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4074788-c6ac-4505-8336-b3da83dcc0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.562631 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4074788-c6ac-4505-8336-b3da83dcc0a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.563259 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4074788-c6ac-4505-8336-b3da83dcc0a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.565187 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4074788-c6ac-4505-8336-b3da83dcc0a8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.590525 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1442/2868] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:23 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:23.594693 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990d3af-4ebf-4cdd-8b30-67554440f01b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.606125 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990d3af-4ebf-4cdd-8b30-67554440f01b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.610829 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d204a48-5985-4471-8732-f217c826e6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.611430 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d204a48-5985-4471-8732-f217c826e6dd admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.611712 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d204a48-5985-4471-8732-f217c826e6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.612014 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d204a48-5985-4471-8732-f217c826e6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.612656 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d204a48-5985-4471-8732-f217c826e6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.614230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d204a48-5985-4471-8732-f217c826e6dd admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.624908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1427/2869] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:23.629601 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4074788-c6ac-4505-8336-b3da83dcc0a8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.640582 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4074788-c6ac-4505-8336-b3da83dcc0a8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.645634 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f0b54-4990-4a3d-ad0a-f6510b6ca4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.646200 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f0b54-4990-4a3d-ad0a-f6510b6ca4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.646483 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f0b54-4990-4a3d-ad0a-f6510b6ca4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.646758 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f0b54-4990-4a3d-ad0a-f6510b6ca4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.647407 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f0b54-4990-4a3d-ad0a-f6510b6ca4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.649051 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f0b54-4990-4a3d-ad0a-f6510b6ca4a7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.660047 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1443/2870] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:23.664347 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d204a48-5985-4471-8732-f217c826e6dd admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.674590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d204a48-5985-4471-8732-f217c826e6dd admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.679231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6165f68-0ecc-4eb1-b089-869756375a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.679908 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6165f68-0ecc-4eb1-b089-869756375a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.680194 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6165f68-0ecc-4eb1-b089-869756375a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.680471 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6165f68-0ecc-4eb1-b089-869756375a7a admin admin] PATH_INFO: `/v3/projects/5e5cbd57dbb84a98a6f32221b82c700c/users/323382d3bd5a499dacadf248e85b2c89/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.696247 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6165f68-0ecc-4eb1-b089-869756375a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5cbd57dbb84a98a6f32221b82c700c, user_id=323382d3bd5a499dacadf248e85b2c89, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.698863 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6165f68-0ecc-4eb1-b089-869756375a7a admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.712467 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1428/2871] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:23 2022] PUT /identity/v3/projects/5e5cbd57dbb84a98a6f32221b82c700c/users/323382d3bd5a499dacadf248e85b2c89/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:23.722621 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9acc-9219-4016-98b7-954f809e1c43 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.722916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9acc-9219-4016-98b7-954f809e1c43 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.723190 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9acc-9219-4016-98b7-954f809e1c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.750934 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-557a9acc-9219-4016-98b7-954f809e1c43 None None] MFA Rules not processed for user `323382d3bd5a499dacadf248e85b2c89`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:23.752224 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-557a9acc-9219-4016-98b7-954f809e1c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:23.818445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1444/2872] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:23.830157 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6165f68-0ecc-4eb1-b089-869756375a7a admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.831971 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b6165f68-0ecc-4eb1-b089-869756375a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:23.853779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:23.890125 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6165f68-0ecc-4eb1-b089-869756375a7a admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.893921 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3797e4f-a695-4117-87aa-4bf61824c8d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553916344aaf40ae8abb050540f10559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.894524 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3797e4f-a695-4117-87aa-4bf61824c8d9 service glance] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.894807 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3797e4f-a695-4117-87aa-4bf61824c8d9 service glance] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.895078 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3797e4f-a695-4117-87aa-4bf61824c8d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.906445 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3797e4f-a695-4117-87aa-4bf61824c8d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.907831 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3797e4f-a695-4117-87aa-4bf61824c8d9 service glance] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.917287 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1429/2873] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:27.980408 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17b368-cd6f-4f94-bced-02d050a13113 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:27.981065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17b368-cd6f-4f94-bced-02d050a13113 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:27.981065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17b368-cd6f-4f94-bced-02d050a13113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:28.000916 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1f17b368-cd6f-4f94-bced-02d050a13113 None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:28.002135 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1f17b368-cd6f-4f94-bced-02d050a13113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:28.014950 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:28.061771 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1445/2874] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:11:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:28.110354 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3797e4f-a695-4117-87aa-4bf61824c8d9 service glance] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:28.111820 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-e3797e4f-a695-4117-87aa-4bf61824c8d9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:28.197327 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3797e4f-a695-4117-87aa-4bf61824c8d9 service glance] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:28.203253 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72476e-f01b-4329-b7db-e7aa99138976 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:28.203898 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72476e-f01b-4329-b7db-e7aa99138976 service swift] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:28.204185 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72476e-f01b-4329-b7db-e7aa99138976 service swift] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:28.204459 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72476e-f01b-4329-b7db-e7aa99138976 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:28.213580 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72476e-f01b-4329-b7db-e7aa99138976 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:28.215173 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72476e-f01b-4329-b7db-e7aa99138976 service swift] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:28.225620 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1430/2875] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:11:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:11:28.737191 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13add5-b63a-4b7f-861f-697731313b2b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:28.737475 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13add5-b63a-4b7f-861f-697731313b2b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:28.737749 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13add5-b63a-4b7f-861f-697731313b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:28.758177 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0d13add5-b63a-4b7f-861f-697731313b2b None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:28.759378 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0d13add5-b63a-4b7f-861f-697731313b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:28.766493 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1446/2876] 10.222.0.30 () {58 vars in 967 bytes} [Wed Aug 10 08:11:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:28.779457 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72476e-f01b-4329-b7db-e7aa99138976 service swift] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:28.790769 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72476e-f01b-4329-b7db-e7aa99138976 service swift] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:28.796044 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55559b-9e32-49f5-935e-b9e73b466dfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:28.796648 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55559b-9e32-49f5-935e-b9e73b466dfb service swift] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:28.796931 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55559b-9e32-49f5-935e-b9e73b466dfb service swift] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:28.797206 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55559b-9e32-49f5-935e-b9e73b466dfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:28.805823 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55559b-9e32-49f5-935e-b9e73b466dfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:28.807456 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55559b-9e32-49f5-935e-b9e73b466dfb service swift] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:28.816049 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1431/2877] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:11:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:11:29.050498 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825ef32-bdad-443c-b179-06d3d7080d77 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.051106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825ef32-bdad-443c-b179-06d3d7080d77 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.051106 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825ef32-bdad-443c-b179-06d3d7080d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.072149 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e825ef32-bdad-443c-b179-06d3d7080d77 None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:29.073377 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e825ef32-bdad-443c-b179-06d3d7080d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:29.081053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1447/2878] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 10 08:11:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:29.094230 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55559b-9e32-49f5-935e-b9e73b466dfb service swift] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:29.106424 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55559b-9e32-49f5-935e-b9e73b466dfb service swift] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:29.116670 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e935cb3-bee2-4da5-96a7-b525246e3a99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:29.117629 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e935cb3-bee2-4da5-96a7-b525246e3a99 service swift] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.118108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e935cb3-bee2-4da5-96a7-b525246e3a99 service swift] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.118492 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e935cb3-bee2-4da5-96a7-b525246e3a99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.127550 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e935cb3-bee2-4da5-96a7-b525246e3a99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:29.130442 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e935cb3-bee2-4da5-96a7-b525246e3a99 service swift] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:29.140526 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1432/2879] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:11:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:11:29.475436 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43065972-9f3d-493c-8488-2c8815dd8691 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.475747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43065972-9f3d-493c-8488-2c8815dd8691 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.476027 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43065972-9f3d-493c-8488-2c8815dd8691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.496689 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-43065972-9f3d-493c-8488-2c8815dd8691 None None] MFA Rules not processed for user `15690a9236a74f518837f7d47d9797b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:29.497907 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-43065972-9f3d-493c-8488-2c8815dd8691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:29.505340 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1448/2880] 10.222.0.30 () {58 vars in 967 bytes} [Wed Aug 10 08:11:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:29.518160 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e935cb3-bee2-4da5-96a7-b525246e3a99 service swift] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:29.529510 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e935cb3-bee2-4da5-96a7-b525246e3a99 service swift] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:29.534879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1089284-1ac5-4114-aafd-6872bae78b65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867485ce37eb41359a8e53b2b78061f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:29.536244 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1089284-1ac5-4114-aafd-6872bae78b65 service swift] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.536544 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1089284-1ac5-4114-aafd-6872bae78b65 service swift] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.536844 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1089284-1ac5-4114-aafd-6872bae78b65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.545692 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1089284-1ac5-4114-aafd-6872bae78b65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:29.547266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1089284-1ac5-4114-aafd-6872bae78b65 service swift] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:29.556398 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1433/2881] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Aug 10 08:11:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:11:31.758259 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43065972-9f3d-493c-8488-2c8815dd8691 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:31.759693 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-43065972-9f3d-493c-8488-2c8815dd8691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:31.830165 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43065972-9f3d-493c-8488-2c8815dd8691 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:31.834748 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:31.835420 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:31.835704 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:31.836010 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] PATH_INFO: `/v3/users/2b98216c7a4742f78b12c36af4283a32` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:31.837169 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b98216c7a4742f78b12c36af4283a32)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:31.839102 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:31.888880 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b98216c7a4742f78b12c36af4283a32'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.898533 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b98216c7a4742f78b12c36af4283a32'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.906212 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b98216c7a4742f78b12c36af4283a32'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.906965 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b98216c7a4742f78b12c36af4283a32'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.919545 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b98216c7a4742f78b12c36af4283a32'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.926713 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1449/2882] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:31 2022] DELETE /identity/v3/users/2b98216c7a4742f78b12c36af4283a32 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:31.931198 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa4f8b-78ef-4ff7-b197-824d83f42f43 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:31.931702 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa4f8b-78ef-4ff7-b197-824d83f42f43 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:31.931846 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa4f8b-78ef-4ff7-b197-824d83f42f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:31.952565 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-8baa4f8b-78ef-4ff7-b197-824d83f42f43 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:31.953779 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8baa4f8b-78ef-4ff7-b197-824d83f42f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:32.019351 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1434/2883] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:32.029753 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.031338 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:32.060435 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:32.096902 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ef275-31bd-4c5c-8cae-8b335fc23cb0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.100725 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa815b-a9d3-464c-b7ae-95d0a9c0c279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.101337 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa815b-a9d3-464c-b7ae-95d0a9c0c279 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.101615 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa815b-a9d3-464c-b7ae-95d0a9c0c279 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.101884 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa815b-a9d3-464c-b7ae-95d0a9c0c279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.111267 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa815b-a9d3-464c-b7ae-95d0a9c0c279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.112768 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa815b-a9d3-464c-b7ae-95d0a9c0c279 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.123567 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1450/2884] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:32.315082 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa4f8b-78ef-4ff7-b197-824d83f42f43 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.316574 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8baa4f8b-78ef-4ff7-b197-824d83f42f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:32.329266 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa4f8b-78ef-4ff7-b197-824d83f42f43 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.334547 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95258023-f1b6-411b-9e24-18746cdbb7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.335369 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95258023-f1b6-411b-9e24-18746cdbb7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.335668 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95258023-f1b6-411b-9e24-18746cdbb7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.336015 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95258023-f1b6-411b-9e24-18746cdbb7b6 admin admin] PATH_INFO: `/v3/projects/8363a443299f487fb1e2a37ef9cd7ba7` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.337191 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95258023-f1b6-411b-9e24-18746cdbb7b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8363a443299f487fb1e2a37ef9cd7ba7)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.339096 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95258023-f1b6-411b-9e24-18746cdbb7b6 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.348209 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=100 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:32.390703 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-95258023-f1b6-411b-9e24-18746cdbb7b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8363a443299f487fb1e2a37ef9cd7ba7', 'request_id': 'req-95258023-f1b6-411b-9e24-18746cdbb7b6'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:32.396202 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-95258023-f1b6-411b-9e24-18746cdbb7b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8363a443299f487fb1e2a37ef9cd7ba7', 'request_id': 'req-95258023-f1b6-411b-9e24-18746cdbb7b6'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:32.402658 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-95258023-f1b6-411b-9e24-18746cdbb7b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8363a443299f487fb1e2a37ef9cd7ba7', 'request_id': 'req-95258023-f1b6-411b-9e24-18746cdbb7b6'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:32.416801 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-95258023-f1b6-411b-9e24-18746cdbb7b6 admin admin] The token cache is being invalidate because project 8363a443299f487fb1e2a37ef9cd7ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:32.417092 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-95258023-f1b6-411b-9e24-18746cdbb7b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:32.417718 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-95258023-f1b6-411b-9e24-18746cdbb7b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:32.419871 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1435/2885] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:32 2022] DELETE /identity/v3/projects/8363a443299f487fb1e2a37ef9cd7ba7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:32.425189 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f13ae4-646f-4164-8187-cfa5d71f8607 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.425476 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f13ae4-646f-4164-8187-cfa5d71f8607 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.425747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f13ae4-646f-4164-8187-cfa5d71f8607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.446918 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a9f13ae4-646f-4164-8187-cfa5d71f8607 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:32.448267 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a9f13ae4-646f-4164-8187-cfa5d71f8607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:32.510366 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1451/2886] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:32.518652 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a0a87-009d-4776-b407-754c06377d36 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.518935 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a0a87-009d-4776-b407-754c06377d36 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.519211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a0a87-009d-4776-b407-754c06377d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.540441 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-b79a0a87-009d-4776-b407-754c06377d36 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:32.541783 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-b79a0a87-009d-4776-b407-754c06377d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:32.551172 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1436/2887] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:32.555850 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f13ae4-646f-4164-8187-cfa5d71f8607 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.565899 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f13ae4-646f-4164-8187-cfa5d71f8607 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.571868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a8e5e-60e6-4bb9-889f-0c076296c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.571868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8e5e-60e6-4bb9-889f-0c076296c5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.571868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8e5e-60e6-4bb9-889f-0c076296c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.571868 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8e5e-60e6-4bb9-889f-0c076296c5ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.572464 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a8e5e-60e6-4bb9-889f-0c076296c5ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:32.572589 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a8e5e-60e6-4bb9-889f-0c076296c5ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.574195 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a8e5e-60e6-4bb9-889f-0c076296c5ca admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.586648 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1452/2888] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:32.594022 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a0a87-009d-4776-b407-754c06377d36 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.614007 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a0a87-009d-4776-b407-754c06377d36 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.620780 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa888f5-afe0-44f0-bfa2-77bc9ad0d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.621704 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa888f5-afe0-44f0-bfa2-77bc9ad0d48a admin admin] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.622031 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa888f5-afe0-44f0-bfa2-77bc9ad0d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.622359 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa888f5-afe0-44f0-bfa2-77bc9ad0d48a admin admin] PATH_INFO: `/v3/projects` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.623108 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa888f5-afe0-44f0-bfa2-77bc9ad0d48a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.625231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa888f5-afe0-44f0-bfa2-77bc9ad0d48a admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.655214 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1437/2889] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:32 2022] POST /identity/v3/projects => generated 391 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:32.659470 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a8e5e-60e6-4bb9-889f-0c076296c5ca admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.672280 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a8e5e-60e6-4bb9-889f-0c076296c5ca admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.736136 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a1990-7218-44c9-9c22-1f588ebaa932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.736747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a1990-7218-44c9-9c22-1f588ebaa932 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.737097 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a1990-7218-44c9-9c22-1f588ebaa932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.737397 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a1990-7218-44c9-9c22-1f588ebaa932 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.738037 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a1990-7218-44c9-9c22-1f588ebaa932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.739985 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a1990-7218-44c9-9c22-1f588ebaa932 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.762346 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1453/2890] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:32 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:32.767043 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa888f5-afe0-44f0-bfa2-77bc9ad0d48a admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.778675 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa888f5-afe0-44f0-bfa2-77bc9ad0d48a admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.783371 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff028-5a08-4221-b850-150e02c7c644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.784034 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff028-5a08-4221-b850-150e02c7c644 admin admin] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.784292 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff028-5a08-4221-b850-150e02c7c644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.784723 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff028-5a08-4221-b850-150e02c7c644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.785401 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ff028-5a08-4221-b850-150e02c7c644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.787101 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ff028-5a08-4221-b850-150e02c7c644 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.798889 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1438/2891] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:32.802537 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a1990-7218-44c9-9c22-1f588ebaa932 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.813608 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a1990-7218-44c9-9c22-1f588ebaa932 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.818643 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b082014-483e-4b64-a5f7-08fad466b794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.820760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b082014-483e-4b64-a5f7-08fad466b794 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.820760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b082014-483e-4b64-a5f7-08fad466b794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.820760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b082014-483e-4b64-a5f7-08fad466b794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.820760 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b082014-483e-4b64-a5f7-08fad466b794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.822031 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b082014-483e-4b64-a5f7-08fad466b794 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.833134 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1454/2892] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:32.837753 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff028-5a08-4221-b850-150e02c7c644 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.848918 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff028-5a08-4221-b850-150e02c7c644 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.868231 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ff65c-d852-44ed-a69d-4e338a68e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.868885 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ff65c-d852-44ed-a69d-4e338a68e814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.869216 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ff65c-d852-44ed-a69d-4e338a68e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.869667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ff65c-d852-44ed-a69d-4e338a68e814 admin admin] PATH_INFO: `/v3/projects/c0d082e2d455427e9b02a499c672953e/users/62cf7ee304a0443dbfc8bcbf476c5ba2/roles/9d10ee7e27e242ba801222cf0264ea8d` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.886356 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ff65c-d852-44ed-a69d-4e338a68e814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d082e2d455427e9b02a499c672953e, user_id=62cf7ee304a0443dbfc8bcbf476c5ba2, role_id=9d10ee7e27e242ba801222cf0264ea8d)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.889711 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ff65c-d852-44ed-a69d-4e338a68e814 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.905701 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1439/2893] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:32 2022] PUT /identity/v3/projects/c0d082e2d455427e9b02a499c672953e/users/62cf7ee304a0443dbfc8bcbf476c5ba2/roles/9d10ee7e27e242ba801222cf0264ea8d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:32.920328 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb1ce0-ba70-4a0b-b0f4-15c4622f2437 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.920828 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb1ce0-ba70-4a0b-b0f4-15c4622f2437 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.921313 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb1ce0-ba70-4a0b-b0f4-15c4622f2437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.966852 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-39bb1ce0-ba70-4a0b-b0f4-15c4622f2437 None None] MFA Rules not processed for user `62cf7ee304a0443dbfc8bcbf476c5ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:32.968585 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-39bb1ce0-ba70-4a0b-b0f4-15c4622f2437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:32.988032 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:33.037618 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1455/2894] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:33.049060 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ff65c-d852-44ed-a69d-4e338a68e814 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:33.050879 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-8e8ff65c-d852-44ed-a69d-4e338a68e814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:33.110768 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ff65c-d852-44ed-a69d-4e338a68e814 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:33.114619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f74f1-4b76-46d0-ae86-2689bf5159a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0470979f1643a390c667efc55c4069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:33.115236 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f74f1-4b76-46d0-ae86-2689bf5159a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:33.115525 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f74f1-4b76-46d0-ae86-2689bf5159a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:33.115844 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f74f1-4b76-46d0-ae86-2689bf5159a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:33.125612 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f74f1-4b76-46d0-ae86-2689bf5159a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:33.127506 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f74f1-4b76-46d0-ae86-2689bf5159a0 service cinder] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:33.139151 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1440/2895] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:43.034497 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=18 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:43.133925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:43.260291 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb1ce0-ba70-4a0b-b0f4-15c4622f2437 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:43.369475 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb1ce0-ba70-4a0b-b0f4-15c4622f2437 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:43.374885 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:43.375517 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:43.375835 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:43.376116 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] PATH_INFO: `/v3/users/62cf7ee304a0443dbfc8bcbf476c5ba2` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:43.377294 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62cf7ee304a0443dbfc8bcbf476c5ba2)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:43.379215 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:43.427563 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62cf7ee304a0443dbfc8bcbf476c5ba2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:43.435853 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62cf7ee304a0443dbfc8bcbf476c5ba2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:43.442808 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62cf7ee304a0443dbfc8bcbf476c5ba2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:43.443472 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62cf7ee304a0443dbfc8bcbf476c5ba2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:43.456445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62cf7ee304a0443dbfc8bcbf476c5ba2'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:43.463603 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1456/2896] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:43 2022] DELETE /identity/v3/users/62cf7ee304a0443dbfc8bcbf476c5ba2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:43.468162 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2e40e-89ac-455f-b12c-969932028208 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:43.468533 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2e40e-89ac-455f-b12c-969932028208 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:43.469045 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2e40e-89ac-455f-b12c-969932028208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:43.523321 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-50c2e40e-89ac-455f-b12c-969932028208 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:43.524590 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-50c2e40e-89ac-455f-b12c-969932028208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:43.588008 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1441/2897] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:43.598254 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:43.599747 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:43.642442 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:43.675445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5028d9-aa2c-4b08-98e8-2736826105c6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:43.680151 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d5e62-58d8-455b-977d-8405edec933b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:43.680702 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d5e62-58d8-455b-977d-8405edec933b service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:43.680982 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d5e62-58d8-455b-977d-8405edec933b service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:43.681256 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d5e62-58d8-455b-977d-8405edec933b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:43.695992 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d5e62-58d8-455b-977d-8405edec933b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:43.697468 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d5e62-58d8-455b-977d-8405edec933b service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:43.707053 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1457/2898] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:43.986461 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2e40e-89ac-455f-b12c-969932028208 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:43.988154 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-50c2e40e-89ac-455f-b12c-969932028208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:44.000499 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2e40e-89ac-455f-b12c-969932028208 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:44.005366 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f7bba-2c04-4d11-bdda-bc4e839349f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:44.006570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7bba-2c04-4d11-bdda-bc4e839349f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:44.006570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7bba-2c04-4d11-bdda-bc4e839349f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:44.006570 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7bba-2c04-4d11-bdda-bc4e839349f5 admin admin] PATH_INFO: `/v3/projects/c0d082e2d455427e9b02a499c672953e` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:44.007665 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f7bba-2c04-4d11-bdda-bc4e839349f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d082e2d455427e9b02a499c672953e)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:44.009601 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f7bba-2c04-4d11-bdda-bc4e839349f5 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:44.061418 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c83f7bba-2c04-4d11-bdda-bc4e839349f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d082e2d455427e9b02a499c672953e', 'request_id': 'req-c83f7bba-2c04-4d11-bdda-bc4e839349f5'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:44.067167 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c83f7bba-2c04-4d11-bdda-bc4e839349f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d082e2d455427e9b02a499c672953e', 'request_id': 'req-c83f7bba-2c04-4d11-bdda-bc4e839349f5'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:44.073676 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c83f7bba-2c04-4d11-bdda-bc4e839349f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d082e2d455427e9b02a499c672953e', 'request_id': 'req-c83f7bba-2c04-4d11-bdda-bc4e839349f5'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:44.086691 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c83f7bba-2c04-4d11-bdda-bc4e839349f5 admin admin] The token cache is being invalidate because project c0d082e2d455427e9b02a499c672953e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:44.086989 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c83f7bba-2c04-4d11-bdda-bc4e839349f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:44.087667 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-c83f7bba-2c04-4d11-bdda-bc4e839349f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:44.089834 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1442/2899] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:43 2022] DELETE /identity/v3/projects/c0d082e2d455427e9b02a499c672953e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:46.655046 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d5e62-58d8-455b-977d-8405edec933b service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:46.656472 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3f9d5e62-58d8-455b-977d-8405edec933b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:46.669137 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d5e62-58d8-455b-977d-8405edec933b service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:46.726126 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:46.726759 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:46.727043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:46.727321 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] PATH_INFO: `/v3/users/323382d3bd5a499dacadf248e85b2c89` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:46.728549 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=323382d3bd5a499dacadf248e85b2c89)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:46.730503 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:46.779162 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323382d3bd5a499dacadf248e85b2c89'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:46.787193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323382d3bd5a499dacadf248e85b2c89'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:46.794699 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323382d3bd5a499dacadf248e85b2c89'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:46.795356 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323382d3bd5a499dacadf248e85b2c89'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:46.807369 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323382d3bd5a499dacadf248e85b2c89'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:46.813804 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1458/2900] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:46 2022] DELETE /identity/v3/users/323382d3bd5a499dacadf248e85b2c89 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:46.818312 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b373de1-c0da-4beb-b0a4-41575a1ceea1 None None] REQUEST_METHOD: `POST` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:46.818803 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b373de1-c0da-4beb-b0a4-41575a1ceea1 None None] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:46.818930 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b373de1-c0da-4beb-b0a4-41575a1ceea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:46.838317 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.auth.core [None req-4b373de1-c0da-4beb-b0a4-41575a1ceea1 None None] MFA Rules not processed for user `0923d37e739345a694121096914c323e`. Rule list: `[]` (Enabled: `True`). {{(pid=80195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:46.839531 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4b373de1-c0da-4beb-b0a4-41575a1ceea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:46.896469 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:46.911146 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1443/2901] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 10 08:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:46.921544 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:46.923234 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:46.970711 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:46.982830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb71fe-b926-4817-a56f-adb3858a2cc5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:46.986445 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dfa90-ecec-4c26-af40-113763584907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3537ce04d24347b155855d2e29cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:46.987043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dfa90-ecec-4c26-af40-113763584907 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:46.987321 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dfa90-ecec-4c26-af40-113763584907 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:46.987589 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dfa90-ecec-4c26-af40-113763584907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:46.997246 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dfa90-ecec-4c26-af40-113763584907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:46.998664 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dfa90-ecec-4c26-af40-113763584907 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:47.008109 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1459/2902] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:47.281619 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b373de1-c0da-4beb-b0a4-41575a1ceea1 None None] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:47.283082 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-4b373de1-c0da-4beb-b0a4-41575a1ceea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:47.297858 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b373de1-c0da-4beb-b0a4-41575a1ceea1 None None] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:47.302689 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:47.303406 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:47.303695 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:47.303997 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] PATH_INFO: `/v3/projects/5e5cbd57dbb84a98a6f32221b82c700c` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:47.305148 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5cbd57dbb84a98a6f32221b82c700c)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:47.307116 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:47.355750 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5cbd57dbb84a98a6f32221b82c700c', 'request_id': 'req-43a94013-fcdb-46b1-bce9-8a6750248f29'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:47.361421 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5cbd57dbb84a98a6f32221b82c700c', 'request_id': 'req-43a94013-fcdb-46b1-bce9-8a6750248f29'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:47.367529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5cbd57dbb84a98a6f32221b82c700c', 'request_id': 'req-43a94013-fcdb-46b1-bce9-8a6750248f29'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:47.380844 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] The token cache is being invalidate because project 5e5cbd57dbb84a98a6f32221b82c700c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:47.381131 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:47.381755 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:47.383243 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1444/2903] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:47 2022] DELETE /identity/v3/projects/5e5cbd57dbb84a98a6f32221b82c700c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:57.003913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=6 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:57.377529 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:32.206244 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dfa90-ecec-4c26-af40-113763584907 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:32.208421 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f04dfa90-ecec-4c26-af40-113763584907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:32.310772 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dfa90-ecec-4c26-af40-113763584907 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:32.371115 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2dde8-958b-49f9-b386-2c2f18037af8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccab7239a2474aa093e685d5da97f1a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bad7eba8964f4acf9c6c1397df7cd1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:32.371750 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2dde8-958b-49f9-b386-2c2f18037af8 service placement] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:32.372035 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2dde8-958b-49f9-b386-2c2f18037af8 service placement] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:32.372305 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2dde8-958b-49f9-b386-2c2f18037af8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:32.374043 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e0e2dde8-958b-49f9-b386-2c2f18037af8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:32.385695 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2dde8-958b-49f9-b386-2c2f18037af8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:32.387260 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2dde8-958b-49f9-b386-2c2f18037af8 service placement] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:32.397225 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1460/2904] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:12:40.494682 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:40.496379 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:40.575449 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a94013-fcdb-46b1-bce9-8a6750248f29 admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:40.580277 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:40.580994 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:40.581343 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:40.581632 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] PATH_INFO: `/v3/users/0197f75312724968b26e64774d0717d0` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:40.582788 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0197f75312724968b26e64774d0717d0)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:40.584818 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:40.642373 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0197f75312724968b26e64774d0717d0'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:40.652361 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0197f75312724968b26e64774d0717d0'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:40.653018 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0197f75312724968b26e64774d0717d0'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:40.653664 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0197f75312724968b26e64774d0717d0'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:40.672486 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0197f75312724968b26e64774d0717d0'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:40.688996 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1445/2905] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:40 2022] DELETE /identity/v3/users/0197f75312724968b26e64774d0717d0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:40.886004 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2dde8-958b-49f9-b386-2c2f18037af8 service placement] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:40.907830 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2dde8-958b-49f9-b386-2c2f18037af8 service placement] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:40.986797 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:40.987440 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:40.987721 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:40.988022 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] PATH_INFO: `/v3/projects/11c7dd211726496ab1def1f9d18103ad` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:40.989193 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c7dd211726496ab1def1f9d18103ad)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:40.991163 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:41.009523 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:41.048722 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c7dd211726496ab1def1f9d18103ad', 'request_id': 'req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.059541 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c7dd211726496ab1def1f9d18103ad', 'request_id': 'req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.066452 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c7dd211726496ab1def1f9d18103ad', 'request_id': 'req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.079371 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] The token cache is being invalidate because project 11c7dd211726496ab1def1f9d18103ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:41.079667 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.080330 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.082104 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1461/2906] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:40 2022] DELETE /identity/v3/projects/11c7dd211726496ab1def1f9d18103ad => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:41.086168 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] Authenticating user token {{(pid=80195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:41.088211 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.fernet_utils [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:41.101925 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2896c-f068-4768-879f-03413f3ad06b admin admin] Validating token access rules against request {{(pid=80195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:41.162466 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce1a8-b212-469d-8c45-e9ba9abc0260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:41.163021 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce1a8-b212-469d-8c45-e9ba9abc0260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:41.163304 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce1a8-b212-469d-8c45-e9ba9abc0260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:41.163580 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce1a8-b212-469d-8c45-e9ba9abc0260 admin admin] PATH_INFO: `/v3/users/fef07329305a4b408e91cd219806a347` {{(pid=80195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:41.164799 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ce1a8-b212-469d-8c45-e9ba9abc0260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef07329305a4b408e91cd219806a347)` {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:41.166793 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ce1a8-b212-469d-8c45-e9ba9abc0260 admin admin] RBAC: Authorization granted {{(pid=80195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:41.190736 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:41.221265 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-573ce1a8-b212-469d-8c45-e9ba9abc0260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef07329305a4b408e91cd219806a347'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.228690 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-573ce1a8-b212-469d-8c45-e9ba9abc0260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef07329305a4b408e91cd219806a347'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.229348 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-573ce1a8-b212-469d-8c45-e9ba9abc0260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef07329305a4b408e91cd219806a347'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.229976 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-573ce1a8-b212-469d-8c45-e9ba9abc0260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef07329305a4b408e91cd219806a347'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.242721 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG keystone.notifications [None req-573ce1a8-b212-469d-8c45-e9ba9abc0260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef07329305a4b408e91cd219806a347'} {{(pid=80195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.256578 dv-cinder-781032-4-smb devstack@keystone.service[80195]: [pid: 80195|app: 0|req: 1446/2907] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:41 2022] DELETE /identity/v3/users/fef07329305a4b408e91cd219806a347 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:41.444726 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:41.446913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:41.461125 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578cd44-9e52-4c6e-bba8-fb3ff134f3dc admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:41.520431 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0923d37e739345a694121096914c323e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5422809609a44bf7a3e055f250264a66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:41.521065 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:41.521345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:41.521619 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02 admin admin] PATH_INFO: `/v3/projects/baa524d2afb844058ca1d2175f78bb90` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:41.522772 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa524d2afb844058ca1d2175f78bb90)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:41.524755 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:41.574242 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa524d2afb844058ca1d2175f78bb90', 'request_id': 'req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.579713 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa524d2afb844058ca1d2175f78bb90', 'request_id': 'req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.585930 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa524d2afb844058ca1d2175f78bb90', 'request_id': 'req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.599345 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02 admin admin] The token cache is being invalidate because project baa524d2afb844058ca1d2175f78bb90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:41.599913 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.600550 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-64fd2506-92ea-4ef6-88e7-47ef7b3d1a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:41.602668 dv-cinder-781032-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1462/2908] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:41 2022] DELETE /identity/v3/projects/baa524d2afb844058ca1d2175f78bb90 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:51.251490 dv-cinder-781032-4-smb devstack@keystone.service[80195]: DEBUG dbcounter [-] [80195] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:51.595685 dv-cinder-781032-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=69,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}